-- Logs begin at Thu 2022-05-26 20:10:12 UTC, end at Thu 2022-05-26 21:25:50 UTC. -- May 26 20:53:19.290519 dv-cinder-828806-3-smb systemd[1]: Starting Devstack devstack@keystone.service... May 26 20:53:19.298060 dv-cinder-828806-3-smb devstack@keystone.service[80313]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 20:53:19.300094 dv-cinder-828806-3-smb devstack@keystone.service[80313]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 20:53:19 2022] *** May 26 20:53:19.300094 dv-cinder-828806-3-smb devstack@keystone.service[80313]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 20:53:19.300094 dv-cinder-828806-3-smb devstack@keystone.service[80313]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 20:53:19.300094 dv-cinder-828806-3-smb devstack@keystone.service[80313]: nodename: dv-cinder-828806-3-smb May 26 20:53:19.300094 dv-cinder-828806-3-smb devstack@keystone.service[80313]: machine: x86_64 May 26 20:53:19.300094 dv-cinder-828806-3-smb devstack@keystone.service[80313]: clock source: unix May 26 20:53:19.300094 dv-cinder-828806-3-smb devstack@keystone.service[80313]: pcre jit disabled May 26 20:53:19.300094 dv-cinder-828806-3-smb devstack@keystone.service[80313]: detected number of CPU cores: 4 May 26 20:53:19.300094 dv-cinder-828806-3-smb devstack@keystone.service[80313]: current working directory: / May 26 20:53:19.300094 dv-cinder-828806-3-smb devstack@keystone.service[80313]: detected binary path: /usr/bin/uwsgi-core May 26 20:53:19.300814 dv-cinder-828806-3-smb devstack@keystone.service[80313]: your processes number limit is 47680 May 26 20:53:19.300814 dv-cinder-828806-3-smb devstack@keystone.service[80313]: your memory page size is 4096 bytes May 26 20:53:19.300814 dv-cinder-828806-3-smb devstack@keystone.service[80313]: detected max file descriptor number: 2048 May 26 20:53:19.300814 dv-cinder-828806-3-smb devstack@keystone.service[80313]: lock engine: pthread robust mutexes May 26 20:53:19.300814 dv-cinder-828806-3-smb devstack@keystone.service[80313]: thunder lock: enabled May 26 20:53:19.300814 dv-cinder-828806-3-smb devstack@keystone.service[80313]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 20:53:19.300814 dv-cinder-828806-3-smb devstack@keystone.service[80313]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 20:53:19.345560 dv-cinder-828806-3-smb devstack@keystone.service[80313]: Python main interpreter initialized at 0x55f499ddf9c0 May 26 20:53:19.345560 dv-cinder-828806-3-smb devstack@keystone.service[80313]: python threads support enabled May 26 20:53:19.345560 dv-cinder-828806-3-smb devstack@keystone.service[80313]: your server socket listen backlog is limited to 100 connections May 26 20:53:19.345560 dv-cinder-828806-3-smb devstack@keystone.service[80313]: your mercy for graceful operations on workers is 90 seconds May 26 20:53:19.345971 dv-cinder-828806-3-smb devstack@keystone.service[80313]: mapped 403077 bytes (393 KB) for 2 cores May 26 20:53:19.346046 dv-cinder-828806-3-smb devstack@keystone.service[80313]: *** Operational MODE: preforking *** May 26 20:53:19.346324 dv-cinder-828806-3-smb devstack@keystone.service[80313]: *** uWSGI is running in multiple interpreter mode *** May 26 20:53:19.346324 dv-cinder-828806-3-smb devstack@keystone.service[80313]: spawned uWSGI master process (pid: 80313) May 26 20:53:19.346653 dv-cinder-828806-3-smb systemd[1]: Started Devstack devstack@keystone.service. May 26 20:53:19.349616 dv-cinder-828806-3-smb devstack@keystone.service[80313]: spawned uWSGI worker 1 (pid: 80323, cores: 1) May 26 20:53:19.349616 dv-cinder-828806-3-smb devstack@keystone.service[80313]: spawned uWSGI worker 2 (pid: 80324, cores: 1) May 26 20:53:19.349616 dv-cinder-828806-3-smb devstack@keystone.service[80313]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 20:53:24.898552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 20:53:24.898552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: from cryptography.utils import int_from_bytes May 26 20:53:24.899375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 20:53:24.899375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: from cryptography.utils import int_from_bytes May 26 20:53:24.948766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 20:53:24.948948 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 20:53:24.949118 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] command line args: [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 20:53:24.949408 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 20:53:24.949554 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ================================================================================ {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 20:53:24.949828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] admin_token = **** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.950111 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] config_dir = [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.950253 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.950467 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] config_source = [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.950599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] debug = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.950832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.951218 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.951368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.951640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.951891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.952124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] list_limit = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.952274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] log_config_append = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.952477 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.952636 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] log_dir = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.952811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] log_file = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.953048 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.953297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.953544 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.953818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.953996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.954168 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.954413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.954662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.954884 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.955120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.955354 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.955592 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.955898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.956179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.956523 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.956609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 20:53:24.956609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: from cryptography.utils import int_from_bytes May 26 20:53:24.957113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 20:53:24.957113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: from cryptography.utils import int_from_bytes May 26 20:53:24.957295 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.957295 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] publish_errors = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.957490 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.957622 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.957818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.958070 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.958308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.958545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] standard_threads = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.958779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.959024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.959200 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.959377 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] use_journal = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.959552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] use_json = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.959725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] use_stderr = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.959900 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] use_syslog = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.960134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:24.960393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.960633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.960897 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.961139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.961730 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.962008 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.962261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.962502 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.962752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.963003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.963258 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.963498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.963747 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.963984 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.964236 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.964485 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.964724 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.964980 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.965236 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.965483 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.965725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.966007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.966272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.966528 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.966781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.967013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.967246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.967478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.967716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.967968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.968217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.968449 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.968683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.968930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.969178 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.969417 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.969668 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.969923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.970162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.970403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.970635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.970867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.971101 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.971399 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.971741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.972001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.972237 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.972475 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.972709 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.972948 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.973189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.973440 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.973673 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.973942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.974182 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.974421 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.974659 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.974901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.975134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.975383 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.975623 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.975870 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.976106 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.976370 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.976611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.976844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.977083 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.977322 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.977591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.977850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.978105 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.978352 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.978592 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.978832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.979070 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.979320 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.979559 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.979798 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.980043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.980283 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.980521 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.980759 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.980996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.981234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.981498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.981738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.982008 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.982249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.982492 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.982731 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.982968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.983206 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.983439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.983670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.983901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.984139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.984371 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.984612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.984849 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.985097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.985336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.985592 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.985881 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.986124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.986359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] auth.external = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.986590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.986890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.987180 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.987407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] auth.password = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.987642 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] auth.token = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.987913 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.988160 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.988409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.988642 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.988892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.989142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.989374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.989612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] credential.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.989886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.990137 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.990384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.990624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.990870 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.991108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.991363 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.991619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.991858 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.992114 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.992400 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.992648 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.992943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.993154 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.993416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.993652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] federation.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.993920 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.994173 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.994423 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.994656 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.994909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.995148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.995401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.995640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.995900 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.996138 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.996389 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.996627 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.996878 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.997126 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.997364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.997602 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.997880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.998116 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.998357 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.998608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.998861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.999098 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.999329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.999563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:24.999803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.000051 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.000301 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.000572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.000822 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.001116 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.001358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.001598 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.001853 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.002095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.002329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.002611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.002858 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.003104 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.003352 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.003585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.003776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 20:53:25.003903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.004034 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 20:53:25.004162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.004239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] command line args: [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 20:53:25.004353 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.004464 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 20:53:25.004544 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.004618 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ================================================================================ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 20:53:25.004770 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.004890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] admin_token = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.005004 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.005082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] config_dir = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.005207 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.005293 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.005389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] config_source = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.005467 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.005569 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] debug = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.005696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.005782 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.005959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.006039 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.006189 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.006265 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.006432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.006521 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.006674 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.006751 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.006901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.006978 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.007077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_config_append = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.007163 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.007237 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.007380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.007458 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_dir = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.007570 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_file = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.007646 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.007803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.007882 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.008049 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.008125 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.008292 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.008369 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.008521 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.008595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.008695 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.008774 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.008875 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.008962 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.009120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.009199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.009364 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.009442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.009598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.009683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.009852 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.009933 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.010087 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.010164 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.010319 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.010408 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.010565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.010647 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.010808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.010885 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.011060 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.011136 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.011299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.011539 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.011616 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.011732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] publish_errors = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.011815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.011964 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.012041 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.012193 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.012269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.012367 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.012478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.012616 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.012728 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.012850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.012976 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.013083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] standard_threads = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.013209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.013314 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.013549 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.013628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.013720 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.013827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.013918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] use_journal = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.014081 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] use_json = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.014171 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.014288 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] use_stderr = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.014370 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.014449 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] use_syslog = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.014553 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.014631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 20:53:25.014803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.014883 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.015055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.015133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.015297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.015379 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.015558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.015637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.015801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.015878 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.016036 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.016114 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.016278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.016362 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.016515 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.016592 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.016755 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.016833 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.017000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.017084 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.017241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.017319 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.017473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.017550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.017708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.017787 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.017968 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.018045 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] resource.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.018278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.018363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.018538 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.018619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.018777 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.018856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.019031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.019108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.019282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.019361 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.019522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.019600 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.019754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.019830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.019997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.020076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.020241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.020321 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.020479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] role.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.020564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.020729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] role.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.020810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.020958 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.021036 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.021190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.021268 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.021428 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.021509 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.021664 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.021749 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.021938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.022101 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.022178 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.022250 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.022402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.022530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.022631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.022787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.022868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.023046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.023124 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.023287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.023366 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.023540 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.023626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.023780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.023864 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.024027 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.024105 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.024272 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.024352 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.024501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.024687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.024765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.024932 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.025018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.025163 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.025240 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.025399 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.025477 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.025647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.025735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.025901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.025982 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.026139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.026218 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.026371 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.026462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.026614 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.026694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.026849 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.026936 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.027095 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.027182 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.027325 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.027410 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.027560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.027639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.027795 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.027882 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.028029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.028108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.028263 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.028342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.028498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.028579 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.028725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.028817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.028963 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.029041 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.029196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.029275 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] token.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.029431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.029509 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.029661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.029748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.029931 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.030023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.030167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.030246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.030401 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.030481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.030637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.030724 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.030883 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.030961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.031130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.031208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.031373 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.031459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.031612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.031690 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.031853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.031931 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.032089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.032178 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.032319 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.032396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.032553 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.032632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.032795 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.032880 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.033028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.033106 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.033264 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.033342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.033504 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.033584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.connection = **** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.033739 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.033928 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.034090 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.034170 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.034357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.034436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.034598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.034678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.034834 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.034912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.035078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.035157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.035318 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.035397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.035556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.035641 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.035796 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.035874 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.036036 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.036115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.036270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.036347 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.036506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.036583 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.036740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.036825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.036971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.037051 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.037200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.037278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.037429 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.037509 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.037664 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.037743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.037920 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.038000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.038085 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 20:53:25.038160 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.038381 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.038628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.038862 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.039116 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.039375 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.039614 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.039844 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.external = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.040072 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.040366 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.040597 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.040827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.password = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.041057 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.token = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.041294 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.041612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.041777 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.042030 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.042277 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.042522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.042753 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.042997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.043246 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.043494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.043742 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.043979 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.044225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.044462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.044730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.044985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.045224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.045479 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.045760 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.046029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.046292 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.046540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.046793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.047030 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.047266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.047512 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.047758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.047986 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.048232 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.048468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.048722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.048957 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.049209 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.049480 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.049732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.050652 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.051131 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.051131 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.051259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.051538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.051841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.052079 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.052793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.052793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.052793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.053014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.053230 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.053460 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.053707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.053986 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.054234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.054489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.054736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.055005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.055241 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.055477 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.055709 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.055945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.056173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.056407 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.056648 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.056895 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.057142 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.057374 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.057620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.057893 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.058132 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.058387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.058636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.058866 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.059105 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.059334 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.059571 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.059808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.060050 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.060286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.060525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.060774 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.061025 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.061256 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.061487 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.061737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.062012 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.062250 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.062487 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.062722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.062956 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.063197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.063456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.063706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.063983 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.064232 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.064478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.064714 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.064944 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.065266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.065520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.065848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.066173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.066460 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.066746 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.067033 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.067319 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.067602 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.067866 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.068155 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.068425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.068696 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.068966 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.069087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.069234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.069315 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.069514 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.069593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.069814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.070085 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.070372 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.070635 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.070916 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.071185 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.071453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.071723 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.072004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.072279 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.072513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.072752 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.072995 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.073245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.073498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.073735 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.074012 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.074266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.074503 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.074750 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.074987 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.075226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.075462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] role.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.075712 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] role.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.075952 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.076202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.076453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.076705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.076950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.077195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.077443 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.077688 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.077959 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.078149 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.078231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.078427 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.078674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.078920 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.079166 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.079573 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.079809 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.080058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.080306 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.080553 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.080944 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.081193 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.081454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.081709 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.081976 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.082213 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.082448 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.082680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.082932 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.083187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.083434 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.083671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.083908 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.084138 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.084376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.084612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.084862 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.085097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.085352 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.085598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.085855 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.086099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.086342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.086933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.087167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.087403 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.087636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.087880 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.088139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.088368 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.088612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.088903 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.089172 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.089416 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.089664 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.089933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.090179 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.090416 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.090654 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.090890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.091127 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.091372 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.091609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.091853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.092088 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.092336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.092570 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.092814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.093043 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.093283 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.093516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 20:53:25.093683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 20:53:25.106789 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.107026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.118540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.118767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.118997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.129148 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.147676 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.147882 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.159683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.184974 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.210815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.211026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.222590 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.222827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.277107 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.277253 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.277334 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.277426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.277502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.277667 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.277842 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.277918 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.277997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.278080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.278146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.278381 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.301436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.301683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.301829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.301926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.301998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.302069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.302131 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.302296 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.302428 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.302513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.302592 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.302722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.302848 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.302932 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.313988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.314348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.326530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.326665 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.326891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.326983 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.327107 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.327244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.327366 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.327498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.327622 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.327747 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.327867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.327991 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.328122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.328252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 20:53:25.345853 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.345990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.346160 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 20:53:25.346311 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 20:53:25.346505 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.346641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.346728 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 20:53:25.346791 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 20:53:25.346897 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.346986 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.347181 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.347307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.347421 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.347513 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.347668 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.347811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.358740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.359014 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.359284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.359567 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.360439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.360713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.360980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.361251 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.367969 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.369405 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.371251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.371530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.371807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.372086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.372363 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.372621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.372745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.372937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.373061 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.373216 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.373356 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.373466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.373555 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.373773 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.373924 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.374006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.374090 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.374413 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.374690 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.374938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.375206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.375470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.400434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.402170 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.402406 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.402533 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.404104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.404381 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.407704 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.407983 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.408274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.409706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.410006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.410280 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.415592 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.415871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.417543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.417847 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.420342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.420739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.421023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.421311 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.421571 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.421827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.422128 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.422253 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.422395 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.422683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.422963 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.423239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.423492 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.423760 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.424022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.424286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.441197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.441482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.443410 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.443686 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.446175 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.448341 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.449833 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.450130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.451982 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.452271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.455251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.457470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.458912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.461272 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.463036 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.463334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.463620 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.463905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.464185 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.464470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.465380 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.465675 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.465994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.466273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.466554 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.466817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.483490 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.483776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.484045 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.484301 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.485925 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.486200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.486467 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.486699 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.492412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.494141 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.494412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.495045 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.496735 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.497013 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.497475 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.497751 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.498050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.498330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.498606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.500046 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.500322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.500597 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.500893 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.501145 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.512208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.512481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.512763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.513047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.513326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.513607 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.513909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.514802 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.515075 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.515351 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.515625 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.515898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.516153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.516442 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.532005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.534583 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.535252 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.537828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.538568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.540196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.541109 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.541834 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.542123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.542413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.542739 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.544334 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.544615 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.544978 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.550166 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.551561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.552424 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.554031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.554823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.555118 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.555402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.555677 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.557237 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.557521 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.557815 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.558112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.564757 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.565046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.565746 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.567396 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.567674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.568040 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.573487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.573768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.574104 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.574380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.574657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.574934 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.575212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.575486 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.575752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.575933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 20:53:25.576059 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.576212 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.576299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.576488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.576573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.576758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.576852 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.576986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.577063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.577269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.577532 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.577817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.578139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.578344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.578606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.578860 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.579117 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.579378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 20:53:25.616384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f499ddf9c0 pid: 80324 (default app) May 26 20:53:25.618422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f499ddf9c0 pid: 80323 (default app) May 26 20:53:25.619680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c4c8-dbac-4f62-acbd-63e40743d873 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:25.619973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c4c8-dbac-4f62-acbd-63e40743d873 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:25.620254 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c4c8-dbac-4f62-acbd-63e40743d873 None None] PATH_INFO: `/v3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:25.624636 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 791 bytes} [Thu May 26 20:53:25 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:33.579907 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f0055-ec5f-4219-b619-85caba10fb79 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:33.580800 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f0055-ec5f-4219-b619-85caba10fb79 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:33.580896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f0055-ec5f-4219-b619-85caba10fb79 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:33.588744 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:33 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:33.594319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ab4d2-cd79-4cc2-bf33-e58c2abf780b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:33.594758 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ab4d2-cd79-4cc2-bf33-e58c2abf780b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:33.594850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ab4d2-cd79-4cc2-bf33-e58c2abf780b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:33.662222 dv-cinder-828806-3-smb devstack@keystone.service[80324]: INFO dbcounter [None req-077ab4d2-cd79-4cc2-bf33-e58c2abf780b None None] Registered counter for database keystone May 26 20:53:33.687120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG oslo_db.sqlalchemy.engines [None req-077ab4d2-cd79-4cc2-bf33-e58c2abf780b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:53:33.699307 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writer thread running {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:53:33.882730 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG passlib.handlers.bcrypt [None req-077ab4d2-cd79-4cc2-bf33-e58c2abf780b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80324) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 20:53:33.883066 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG passlib.handlers.bcrypt [None req-077ab4d2-cd79-4cc2-bf33-e58c2abf780b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80324) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 20:53:33.939042 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-077ab4d2-cd79-4cc2-bf33-e58c2abf780b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:33.940714 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-077ab4d2-cd79-4cc2-bf33-e58c2abf780b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:34.079728 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 20:53:34.294625 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f0055-ec5f-4219-b619-85caba10fb79 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:34.372077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: INFO dbcounter [None req-504f0055-ec5f-4219-b619-85caba10fb79 None None] Registered counter for database keystone May 26 20:53:34.394077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG oslo_db.sqlalchemy.engines [None req-504f0055-ec5f-4219-b619-85caba10fb79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 20:53:34.402604 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writer thread running {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 20:53:34.524029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f0055-ec5f-4219-b619-85caba10fb79 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:34.529616 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bea33-c422-4683-9c4d-93ed87466a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:34.530317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bea33-c422-4683-9c4d-93ed87466a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:34.530597 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bea33-c422-4683-9c4d-93ed87466a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:34.530883 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bea33-c422-4683-9c4d-93ed87466a4e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:34.540377 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bea33-c422-4683-9c4d-93ed87466a4e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:34.592493 dv-cinder-828806-3-smb devstack@keystone.service[80323]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e51bea33-c422-4683-9c4d-93ed87466a4e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 20:53:34.593067 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bea33-c422-4683-9c4d-93ed87466a4e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:34.603562 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1324 bytes} [Thu May 26 20:53:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 20:53:34.613854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ab4d2-cd79-4cc2-bf33-e58c2abf780b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:34.637644 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ab4d2-cd79-4cc2-bf33-e58c2abf780b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:34.644818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5371f-7f07-438e-b58a-75ee6fe3c919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:34.645977 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5371f-7f07-438e-b58a-75ee6fe3c919 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:34.646263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5371f-7f07-438e-b58a-75ee6fe3c919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:34.646540 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5371f-7f07-438e-b58a-75ee6fe3c919 admin admin] PATH_INFO: `/v3/projects/b75eb758e320488d94c4fcec41d7e80a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:34.648086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5371f-7f07-438e-b58a-75ee6fe3c919 admin admin] RBAC: Authorizing `identity:get_project(project_id=b75eb758e320488d94c4fcec41d7e80a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:34.812590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: WARNING keystone.common.rbac_enforcer.enforcer [None req-25f5371f-7f07-438e-b58a-75ee6fe3c919 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 20:53:34.812925 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5371f-7f07-438e-b58a-75ee6fe3c919 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:34.817923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 3/5] 10.222.0.61 () {56 vars in 1207 bytes} [Thu May 26 20:53:34 2022] GET /identity/v3/projects/b75eb758e320488d94c4fcec41d7e80a => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:36.969382 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56542b-1d8e-41b2-a27a-8bc21d57129f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:36.970320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56542b-1d8e-41b2-a27a-8bc21d57129f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:36.970320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56542b-1d8e-41b2-a27a-8bc21d57129f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:36.977553 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 3/6] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:36 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:36.983561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be24b6-2e76-492e-9a0b-c00acd4f2084 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:36.984001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be24b6-2e76-492e-9a0b-c00acd4f2084 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:36.984188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be24b6-2e76-492e-9a0b-c00acd4f2084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:37.004667 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a7be24b6-2e76-492e-9a0b-c00acd4f2084 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:37.006218 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a7be24b6-2e76-492e-9a0b-c00acd4f2084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:37.015706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 20:53:37.038755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56542b-1d8e-41b2-a27a-8bc21d57129f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:37.061195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56542b-1d8e-41b2-a27a-8bc21d57129f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:37.069060 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e88e75-71bf-49c5-8b39-03a1a4e147ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:37.069763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88e75-71bf-49c5-8b39-03a1a4e147ce admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:37.070083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88e75-71bf-49c5-8b39-03a1a4e147ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:37.070353 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88e75-71bf-49c5-8b39-03a1a4e147ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:37.079399 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e88e75-71bf-49c5-8b39-03a1a4e147ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:37.081229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e88e75-71bf-49c5-8b39-03a1a4e147ce admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:37.091302 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1324 bytes} [Thu May 26 20:53:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 20:53:37.099127 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be24b6-2e76-492e-9a0b-c00acd4f2084 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:37.109110 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be24b6-2e76-492e-9a0b-c00acd4f2084 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:37.114315 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692941a-6659-4129-8cd4-afb40edaf7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:37.115207 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692941a-6659-4129-8cd4-afb40edaf7bf admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:37.115493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692941a-6659-4129-8cd4-afb40edaf7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:37.115771 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692941a-6659-4129-8cd4-afb40edaf7bf admin admin] PATH_INFO: `/v3/users/83882af68d99499bbc81a5c6e9abb2e1` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:37.117186 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692941a-6659-4129-8cd4-afb40edaf7bf admin admin] RBAC: Authorizing `identity:get_user(user_id=83882af68d99499bbc81a5c6e9abb2e1)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:37.119090 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692941a-6659-4129-8cd4-afb40edaf7bf admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:37.120639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 5/9] 10.222.0.61 () {56 vars in 1198 bytes} [Thu May 26 20:53:37 2022] GET /identity/v3/users/83882af68d99499bbc81a5c6e9abb2e1 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:39.375336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92a6b1-47f4-4426-a6ed-17ef68ac98d5 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:39.375877 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92a6b1-47f4-4426-a6ed-17ef68ac98d5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:39.375877 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92a6b1-47f4-4426-a6ed-17ef68ac98d5 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:39.377294 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:39.380310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c123292-77a4-42a8-9366-52f9be460020 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:39.380763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c123292-77a4-42a8-9366-52f9be460020 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:39.380877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c123292-77a4-42a8-9366-52f9be460020 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:39.382312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 6/11] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:39.383290 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4465b3b-67d9-4b75-b950-2186ff31f4df None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:39.383732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4465b3b-67d9-4b75-b950-2186ff31f4df None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:39.384016 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4465b3b-67d9-4b75-b950-2186ff31f4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:39.387332 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb256b7-1bba-4b69-a969-d14b975465a8 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:39.387625 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb256b7-1bba-4b69-a969-d14b975465a8 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:39.387911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb256b7-1bba-4b69-a969-d14b975465a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:39.409367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-9fb256b7-1bba-4b69-a969-d14b975465a8 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:39.410586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9fb256b7-1bba-4b69-a969-d14b975465a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:39.424361 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG passlib.handlers.bcrypt [None req-b4465b3b-67d9-4b75-b950-2186ff31f4df None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80323) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 20:53:39.424800 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG passlib.handlers.bcrypt [None req-b4465b3b-67d9-4b75-b950-2186ff31f4df None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80323) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 20:53:39.471162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b4465b3b-67d9-4b75-b950-2186ff31f4df None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:39.472763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b4465b3b-67d9-4b75-b950-2186ff31f4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:39.493453 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 7/12] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:53:39.515677 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb256b7-1bba-4b69-a969-d14b975465a8 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:39.540714 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:39.572777 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 6/13] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:53:39.596195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4465b3b-67d9-4b75-b950-2186ff31f4df None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:39.625229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb256b7-1bba-4b69-a969-d14b975465a8 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:39.658836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ffcf6-1712-4942-b37e-491f317db245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:39.659420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ffcf6-1712-4942-b37e-491f317db245 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:39.659700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ffcf6-1712-4942-b37e-491f317db245 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:39.659977 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ffcf6-1712-4942-b37e-491f317db245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:39.700738 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4465b3b-67d9-4b75-b950-2186ff31f4df None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:39.703145 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:39.733169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ffcf6-1712-4942-b37e-491f317db245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:39.734690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ffcf6-1712-4942-b37e-491f317db245 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:39.739976 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f518b-1c5e-464a-9c45-8230f46d3e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:39.741126 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f518b-1c5e-464a-9c45-8230f46d3e03 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:39.741482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f518b-1c5e-464a-9c45-8230f46d3e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:39.741825 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f518b-1c5e-464a-9c45-8230f46d3e03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:39.754267 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f518b-1c5e-464a-9c45-8230f46d3e03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:53:39.758053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:39.765890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-6d5f518b-1c5e-464a-9c45-8230f46d3e03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:53:39.765890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:53:39.765890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:53:39.765890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:53:39.765890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:53:39.765890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:53:39.765890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:53:39.765890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:53:39.765890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:53:39.765890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:53:39.765890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:53:39.765890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:53:39.765890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:53:39.765890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:53:39.765890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:53:39.765890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:53:39.766804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:53:39.766804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:53:39.766804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:53:39.766804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:53:39.766804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:53:39.766804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:53:39.766804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:53:39.766804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:53:39.766804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:53:39.766804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:53:39.766804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:53:39.766804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:53:39.766804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:53:39.766804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:53:39.766804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:53:39.766804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:53:39.767611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:53:39.767611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:53:39.767611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:53:39.767611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:53:39.767611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:53:39.767611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:53:39.767611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:53:39.767611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:53:39.767611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:53:39.767611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:53:39.767611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:53:39.767611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:53:39.767611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 7/14] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:53:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:53:39.773213 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f518b-1c5e-464a-9c45-8230f46d3e03 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:39.837520 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 8/15] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:53:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 20:53:39.843386 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ffcf6-1712-4942-b37e-491f317db245 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:39.877407 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f518b-1c5e-464a-9c45-8230f46d3e03 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:39.910987 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021e976-3b16-42e7-baef-cffe2e900cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:39.911594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021e976-3b16-42e7-baef-cffe2e900cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:39.911875 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021e976-3b16-42e7-baef-cffe2e900cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:39.912143 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021e976-3b16-42e7-baef-cffe2e900cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:39.912910 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021e976-3b16-42e7-baef-cffe2e900cf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:53:39.913213 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021e976-3b16-42e7-baef-cffe2e900cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:39.914699 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021e976-3b16-42e7-baef-cffe2e900cf7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:39.927121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 8/16] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:53:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:53:39.932743 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021e976-3b16-42e7-baef-cffe2e900cf7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:39.938959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ffcf6-1712-4942-b37e-491f317db245 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:39.961934 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:39.963226 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:39.975002 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb534f3-0599-4254-9175-51428dac8c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:39.975816 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb534f3-0599-4254-9175-51428dac8c42 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:39.976096 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb534f3-0599-4254-9175-51428dac8c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:39.976370 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb534f3-0599-4254-9175-51428dac8c42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:39.987418 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb534f3-0599-4254-9175-51428dac8c42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:39.988934 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb534f3-0599-4254-9175-51428dac8c42 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:40.009989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-1fb534f3-0599-4254-9175-51428dac8c42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:53:40.009989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:53:40.009989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:53:40.009989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:53:40.009989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:53:40.009989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:53:40.009989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:53:40.009989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:53:40.009989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:53:40.009989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:53:40.009989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:53:40.009989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:53:40.009989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:53:40.009989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:53:40.009989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:53:40.010827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:53:40.010827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:53:40.010827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:53:40.010827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:53:40.010827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:53:40.010827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:53:40.010827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:53:40.010827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:53:40.010827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:53:40.010827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:53:40.010827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:53:40.010827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:53:40.010827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:53:40.010827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:53:40.010827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:53:40.010827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:53:40.010827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:53:40.011593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:53:40.011593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:53:40.011593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:53:40.011593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:53:40.011593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 9/17] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:53:40.017345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb534f3-0599-4254-9175-51428dac8c42 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:40.038427 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021e976-3b16-42e7-baef-cffe2e900cf7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:40.072457 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc36f2d-1832-49e3-a520-acb195492d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:40.073352 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc36f2d-1832-49e3-a520-acb195492d49 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:40.073634 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc36f2d-1832-49e3-a520-acb195492d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:40.073933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc36f2d-1832-49e3-a520-acb195492d49 None admin] PATH_INFO: `/v3/users/83882af68d99499bbc81a5c6e9abb2e1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:40.075532 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc36f2d-1832-49e3-a520-acb195492d49 None admin] RBAC: Authorizing `identity:get_user(user_id=83882af68d99499bbc81a5c6e9abb2e1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:40.077024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc36f2d-1832-49e3-a520-acb195492d49 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:40.078712 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 9/18] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:53:39 2022] GET /identity/v3/users/83882af68d99499bbc81a5c6e9abb2e1 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:40.084246 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc36f2d-1832-49e3-a520-acb195492d49 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:40.122762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb534f3-0599-4254-9175-51428dac8c42 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:40.157164 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863506bc-8a6b-4bc9-b419-eff89e763fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:40.157878 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863506bc-8a6b-4bc9-b419-eff89e763fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:40.158166 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863506bc-8a6b-4bc9-b419-eff89e763fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:40.158556 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863506bc-8a6b-4bc9-b419-eff89e763fa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:40.159346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863506bc-8a6b-4bc9-b419-eff89e763fa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:53:40.159658 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863506bc-8a6b-4bc9-b419-eff89e763fa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:40.161154 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863506bc-8a6b-4bc9-b419-eff89e763fa1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:40.178696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 10/19] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:53:40.190655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:40.198766 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc36f2d-1832-49e3-a520-acb195492d49 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:40.237047 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bac86-81cc-4c88-bee3-b6addfbcf3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:40.237947 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bac86-81cc-4c88-bee3-b6addfbcf3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:40.238232 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bac86-81cc-4c88-bee3-b6addfbcf3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:40.238513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bac86-81cc-4c88-bee3-b6addfbcf3c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:40.239858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bac86-81cc-4c88-bee3-b6addfbcf3c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:40.241377 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bac86-81cc-4c88-bee3-b6addfbcf3c1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:40.243386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 10/20] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:53:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:40.249591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863506bc-8a6b-4bc9-b419-eff89e763fa1 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:40.292700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:40.372306 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863506bc-8a6b-4bc9-b419-eff89e763fa1 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:40.409752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316342d-3f04-4e24-b908-ac46e188a179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:40.410462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316342d-3f04-4e24-b908-ac46e188a179 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:40.410743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316342d-3f04-4e24-b908-ac46e188a179 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:40.411018 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316342d-3f04-4e24-b908-ac46e188a179 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:40.411901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316342d-3f04-4e24-b908-ac46e188a179 None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.domain.id=default, user.id=83882af68d99499bbc81a5c6e9abb2e1) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:53:40.412171 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316342d-3f04-4e24-b908-ac46e188a179 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:40.413640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316342d-3f04-4e24-b908-ac46e188a179 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:40.421005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 11/21] 10.222.0.61 () {56 vars in 1322 bytes} [Thu May 26 20:53:40 2022] GET /identity/v3/role_assignments?user.id=83882af68d99499bbc81a5c6e9abb2e1&scope.domain.id=default&role.id=aefba81d87bf47258c17064af7d9a05f => generated 233 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:42.696270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ca8e4-fab2-4028-8427-c5d98220a7dc None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:42.697297 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ca8e4-fab2-4028-8427-c5d98220a7dc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:42.697831 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ca8e4-fab2-4028-8427-c5d98220a7dc None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:42.699426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 11/22] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:42.705211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a6592-2397-4372-86a7-bc43eadc5f5c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:42.706323 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a6592-2397-4372-86a7-bc43eadc5f5c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:42.706822 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a6592-2397-4372-86a7-bc43eadc5f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:42.729156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2c6a6592-2397-4372-86a7-bc43eadc5f5c None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:42.730706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2c6a6592-2397-4372-86a7-bc43eadc5f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:42.833098 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 12/23] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:53:42.859323 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ca8e4-fab2-4028-8427-c5d98220a7dc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:42.911184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b7601-a186-4edb-b95f-aeb589040033 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:42.911809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b7601-a186-4edb-b95f-aeb589040033 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:42.912277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b7601-a186-4edb-b95f-aeb589040033 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:42.913856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:42.919161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26f6c-5426-4229-a4a1-8ac6a35deb32 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:42.919726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26f6c-5426-4229-a4a1-8ac6a35deb32 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:42.920194 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26f6c-5426-4229-a4a1-8ac6a35deb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:42.951982 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-cfd26f6c-5426-4229-a4a1-8ac6a35deb32 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:42.953770 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cfd26f6c-5426-4229-a4a1-8ac6a35deb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:43.018945 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:43.079944 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ca8e4-fab2-4028-8427-c5d98220a7dc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:43.118293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a43455-ede7-4803-80ae-6c227a9363f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:43.119446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a43455-ede7-4803-80ae-6c227a9363f0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:43.119870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a43455-ede7-4803-80ae-6c227a9363f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:43.120282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a43455-ede7-4803-80ae-6c227a9363f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:43.124880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 14/25] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:53:43.141252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a43455-ede7-4803-80ae-6c227a9363f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:43.143319 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a43455-ede7-4803-80ae-6c227a9363f0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:43.159350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd26f6c-5426-4229-a4a1-8ac6a35deb32 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:43.293736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-37a43455-ede7-4803-80ae-6c227a9363f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:53:43.293736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:53:43.293736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:53:43.293736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:53:43.293736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:53:43.293736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:53:43.293736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:53:43.293736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:53:43.293736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:53:43.293736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:53:43.293736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:53:43.293736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:53:43.293736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:53:43.293736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:53:43.293736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:53:43.294580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:53:43.294580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:53:43.294580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:53:43.294580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:53:43.294580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:53:43.294580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:53:43.294580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:53:43.294580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:53:43.294580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:53:43.294580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:53:43.294580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:53:43.294580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:53:43.294580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:53:43.294580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:53:43.294580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:53:43.294580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:53:43.294580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:53:43.295344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:53:43.295344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:53:43.295344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:53:43.295344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:53:43.307605 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 12/26] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 449 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:53:43.313248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a43455-ede7-4803-80ae-6c227a9363f0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:43.350305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:43.361985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd26f6c-5426-4229-a4a1-8ac6a35deb32 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:43.405901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e03835-6ffc-4658-80b9-97139d9e2a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:43.406925 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03835-6ffc-4658-80b9-97139d9e2a7f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:43.407212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03835-6ffc-4658-80b9-97139d9e2a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:43.407491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03835-6ffc-4658-80b9-97139d9e2a7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:43.422003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e03835-6ffc-4658-80b9-97139d9e2a7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:53:43.432441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-45e03835-6ffc-4658-80b9-97139d9e2a7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:53:43.432441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:53:43.432441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:53:43.432441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:53:43.432441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:53:43.432441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:53:43.432441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:53:43.432441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:53:43.432441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:53:43.432441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:53:43.432441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:53:43.432441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:53:43.432441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:53:43.432441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:53:43.432441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:53:43.432441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:53:43.433534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:53:43.433534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:53:43.433534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:53:43.433534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:53:43.433534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:53:43.433534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:53:43.433534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:53:43.433534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:53:43.433534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:53:43.433534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:53:43.433534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:53:43.433534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:53:43.433534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:53:43.433534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:53:43.433534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:53:43.433534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:53:43.434503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:53:43.434503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:53:43.434503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:53:43.434503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:53:43.434503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:53:43.434503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:53:43.434503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:53:43.434503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:53:43.434503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:53:43.434503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:53:43.434503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:53:43.434503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:53:43.437267 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 15/27] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:53:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:53:43.446464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e03835-6ffc-4658-80b9-97139d9e2a7f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:43.481296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:43.524748 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a43455-ede7-4803-80ae-6c227a9363f0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:43.603510 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7de381-5152-471e-9af5-30cd5d626bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:43.604122 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7de381-5152-471e-9af5-30cd5d626bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:43.604409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7de381-5152-471e-9af5-30cd5d626bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:43.604685 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7de381-5152-471e-9af5-30cd5d626bc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:43.605434 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7de381-5152-471e-9af5-30cd5d626bc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:53:43.605738 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7de381-5152-471e-9af5-30cd5d626bc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:43.607349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7de381-5152-471e-9af5-30cd5d626bc6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:43.640592 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 13/28] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:53:43.649549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7de381-5152-471e-9af5-30cd5d626bc6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:43.661407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e03835-6ffc-4658-80b9-97139d9e2a7f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:43.701355 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505d19a-0bb8-4e64-9c40-44da0d576ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:43.702445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d19a-0bb8-4e64-9c40-44da0d576ebd None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:43.703100 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d19a-0bb8-4e64-9c40-44da0d576ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:43.703594 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d19a-0bb8-4e64-9c40-44da0d576ebd None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:43.704628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505d19a-0bb8-4e64-9c40-44da0d576ebd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:53:43.705126 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505d19a-0bb8-4e64-9c40-44da0d576ebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:43.707163 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505d19a-0bb8-4e64-9c40-44da0d576ebd None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:43.722306 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 16/29] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:53:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:43.724732 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817467fd-f064-4931-ad3a-12ebb4d55107 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:43.725223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817467fd-f064-4931-ad3a-12ebb4d55107 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:43.725689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817467fd-f064-4931-ad3a-12ebb4d55107 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:43.727274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 17/30] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:43.728319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817467fd-f064-4931-ad3a-12ebb4d55107 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:43.846255 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:43.872047 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7de381-5152-471e-9af5-30cd5d626bc6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:43.894814 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:43.909110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0a55d-ab17-4d91-96af-9f756a9b51e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:43.910214 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0a55d-ab17-4d91-96af-9f756a9b51e5 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:43.910731 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0a55d-ab17-4d91-96af-9f756a9b51e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:43.911160 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0a55d-ab17-4d91-96af-9f756a9b51e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:43.912111 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0a55d-ab17-4d91-96af-9f756a9b51e5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:43.914067 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0a55d-ab17-4d91-96af-9f756a9b51e5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:43.922317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817467fd-f064-4931-ad3a-12ebb4d55107 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:43.967436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9952e8-6057-4152-8121-8a99b199e854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:43.968722 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9952e8-6057-4152-8121-8a99b199e854 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:43.969252 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9952e8-6057-4152-8121-8a99b199e854 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:43.969719 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9952e8-6057-4152-8121-8a99b199e854 None admin] PATH_INFO: `/v3/users/83882af68d99499bbc81a5c6e9abb2e1` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:43.971439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9952e8-6057-4152-8121-8a99b199e854 None admin] RBAC: Authorizing `identity:get_user(user_id=83882af68d99499bbc81a5c6e9abb2e1)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:43.973440 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9952e8-6057-4152-8121-8a99b199e854 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:43.975388 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 18/31] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:53:43 2022] GET /identity/v3/users/83882af68d99499bbc81a5c6e9abb2e1 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:43.976938 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1b4ea-3aba-4c2a-a3b9-30e1c9861da8 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:43.977446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1b4ea-3aba-4c2a-a3b9-30e1c9861da8 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:43.977930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1b4ea-3aba-4c2a-a3b9-30e1c9861da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:43.996494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-7eb1b4ea-3aba-4c2a-a3b9-30e1c9861da8 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:43.998046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7eb1b4ea-3aba-4c2a-a3b9-30e1c9861da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:44.072329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 19/32] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:53:44.073386 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d764b-b8e2-470a-8f2e-ffea2e73270f None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:44.073673 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d764b-b8e2-470a-8f2e-ffea2e73270f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:44.073987 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d764b-b8e2-470a-8f2e-ffea2e73270f None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:44.075278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 20/33] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:44.079545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d764b-b8e2-470a-8f2e-ffea2e73270f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:44.085999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 14/34] 10.222.0.61 () {60 vars in 1141 bytes} [Thu May 26 20:53:43 2022] POST /identity/v3/projects => generated 301 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:53:44.088551 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61edd2-139f-480f-8425-248074dc1940 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:44.090152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61edd2-139f-480f-8425-248074dc1940 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:44.090676 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61edd2-139f-480f-8425-248074dc1940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:44.139280 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7e61edd2-139f-480f-8425-248074dc1940 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:44.140825 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7e61edd2-139f-480f-8425-248074dc1940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:44.190408 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:44.232963 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d764b-b8e2-470a-8f2e-ffea2e73270f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:44.238764 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 15/35] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:53:44.239439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61edd2-139f-480f-8425-248074dc1940 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:44.296691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a60073-24f6-4d0a-8aa6-6664050a2ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:44.298100 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a60073-24f6-4d0a-8aa6-6664050a2ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:44.298392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a60073-24f6-4d0a-8aa6-6664050a2ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:44.298665 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a60073-24f6-4d0a-8aa6-6664050a2ba3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:44.303284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a60073-24f6-4d0a-8aa6-6664050a2ba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:44.305542 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a60073-24f6-4d0a-8aa6-6664050a2ba3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:44.306551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 21/36] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:53:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:44.307588 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff12bd4-901c-4f19-b293-5134167e65e9 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:44.307872 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff12bd4-901c-4f19-b293-5134167e65e9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:44.308148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff12bd4-901c-4f19-b293-5134167e65e9 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:44.309378 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 22/37] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:44.310077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff12bd4-901c-4f19-b293-5134167e65e9 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:44.324450 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:44.376708 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61edd2-139f-480f-8425-248074dc1940 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:44.411021 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e332c3-13f0-4dcd-9fdf-fe24c1bc27c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:44.411637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e332c3-13f0-4dcd-9fdf-fe24c1bc27c8 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:44.411924 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e332c3-13f0-4dcd-9fdf-fe24c1bc27c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:44.412201 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e332c3-13f0-4dcd-9fdf-fe24c1bc27c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:44.412953 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e332c3-13f0-4dcd-9fdf-fe24c1bc27c8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:44.414544 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e332c3-13f0-4dcd-9fdf-fe24c1bc27c8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:44.425279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff12bd4-901c-4f19-b293-5134167e65e9 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:44.430730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 16/38] 10.222.0.61 () {60 vars in 1131 bytes} [Thu May 26 20:53:44 2022] POST /identity/v3/roles => generated 225 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:53:44.431978 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8767d-8e4d-4351-9eec-d337f71fd236 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:44.432271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8767d-8e4d-4351-9eec-d337f71fd236 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:44.432550 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8767d-8e4d-4351-9eec-d337f71fd236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:44.455802 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-20e8767d-8e4d-4351-9eec-d337f71fd236 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:44.457099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-20e8767d-8e4d-4351-9eec-d337f71fd236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:44.468726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca829927-cb52-4942-9db3-f02b060c3146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:44.469545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca829927-cb52-4942-9db3-f02b060c3146 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:44.469853 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca829927-cb52-4942-9db3-f02b060c3146 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:44.470372 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca829927-cb52-4942-9db3-f02b060c3146 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:44.470925 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca829927-cb52-4942-9db3-f02b060c3146 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:44.472399 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca829927-cb52-4942-9db3-f02b060c3146 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:44.536309 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 17/39] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:53:44.537379 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8767d-8e4d-4351-9eec-d337f71fd236 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:44.605209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 23/40] 10.222.0.61 () {60 vars in 1131 bytes} [Thu May 26 20:53:44 2022] POST /identity/v3/roles => generated 219 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:53:44.605209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee3038-fa9a-48be-9d0b-1674b92eaa37 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:44.605209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee3038-fa9a-48be-9d0b-1674b92eaa37 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:44.605209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee3038-fa9a-48be-9d0b-1674b92eaa37 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:44.605209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 24/41] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:44.605209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee3038-fa9a-48be-9d0b-1674b92eaa37 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:44.611257 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:44.617550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:44.697096 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8767d-8e4d-4351-9eec-d337f71fd236 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:44.742958 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d00448-23ae-418f-beaf-975374823dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:44.743866 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d00448-23ae-418f-beaf-975374823dd0 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:44.744155 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d00448-23ae-418f-beaf-975374823dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:44.744282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee3038-fa9a-48be-9d0b-1674b92eaa37 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:44.744710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d00448-23ae-418f-beaf-975374823dd0 None admin] PATH_INFO: `/v3/domains/default/users/83882af68d99499bbc81a5c6e9abb2e1/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:44.746544 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d00448-23ae-418f-beaf-975374823dd0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=83882af68d99499bbc81a5c6e9abb2e1, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:44.748069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d00448-23ae-418f-beaf-975374823dd0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:44.770001 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 18/42] 10.222.0.61 () {58 vars in 1361 bytes} [Thu May 26 20:53:44 2022] PUT /identity/v3/domains/default/users/83882af68d99499bbc81a5c6e9abb2e1/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:53:44.775344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ec0ca-500d-4c62-88d3-a12f4ff99b38 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:44.775655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ec0ca-500d-4c62-88d3-a12f4ff99b38 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:44.776441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ec0ca-500d-4c62-88d3-a12f4ff99b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:44.795660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a309c-7acf-4cec-aeaf-a1961223876c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:44.796603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a309c-7acf-4cec-aeaf-a1961223876c None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:44.797227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a309c-7acf-4cec-aeaf-a1961223876c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:44.797724 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a309c-7acf-4cec-aeaf-a1961223876c None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:44.798716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a309c-7acf-4cec-aeaf-a1961223876c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:44.800581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a309c-7acf-4cec-aeaf-a1961223876c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:44.803519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9e0ec0ca-500d-4c62-88d3-a12f4ff99b38 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:44.805925 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9e0ec0ca-500d-4c62-88d3-a12f4ff99b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:44.821167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 25/43] 10.222.0.61 () {60 vars in 1131 bytes} [Thu May 26 20:53:44 2022] POST /identity/v3/roles => generated 223 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:53:44.902282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 19/44] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:53:44.929876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a309c-7acf-4cec-aeaf-a1961223876c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:45.010494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:45.049187 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a309c-7acf-4cec-aeaf-a1961223876c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:45.085119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4304e-33f1-4a3f-ba03-30ca87085be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:45.085982 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4304e-33f1-4a3f-ba03-30ca87085be3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:45.086609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4304e-33f1-4a3f-ba03-30ca87085be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:45.086895 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4304e-33f1-4a3f-ba03-30ca87085be3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:45.088195 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4304e-33f1-4a3f-ba03-30ca87085be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:45.089690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4304e-33f1-4a3f-ba03-30ca87085be3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:45.091560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 26/45] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:53:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:45.097269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ec0ca-500d-4c62-88d3-a12f4ff99b38 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:45.134735 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:45.203009 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ec0ca-500d-4c62-88d3-a12f4ff99b38 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:45.239709 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bc243-6f89-4ef5-b90d-3721685dd4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:45.240382 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bc243-6f89-4ef5-b90d-3721685dd4d6 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:45.240669 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bc243-6f89-4ef5-b90d-3721685dd4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:45.240952 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bc243-6f89-4ef5-b90d-3721685dd4d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:45.241677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bc243-6f89-4ef5-b90d-3721685dd4d6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:45.243167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bc243-6f89-4ef5-b90d-3721685dd4d6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:45.270287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 20/46] 10.222.0.61 () {60 vars in 1141 bytes} [Thu May 26 20:53:45 2022] POST /identity/v3/projects => generated 312 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:53:46.992902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164b872-a560-49b0-8648-abfd4c0b38cc None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:46.993413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164b872-a560-49b0-8648-abfd4c0b38cc None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:46.993515 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164b872-a560-49b0-8648-abfd4c0b38cc None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:46.995123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 27/47] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:47.000861 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf8b18-1cbb-4dd0-840b-6085374ba7bc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:47.001296 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf8b18-1cbb-4dd0-840b-6085374ba7bc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:47.001374 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf8b18-1cbb-4dd0-840b-6085374ba7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:47.019284 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-07bf8b18-1cbb-4dd0-840b-6085374ba7bc None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:47.020400 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-07bf8b18-1cbb-4dd0-840b-6085374ba7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:47.090401 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 21/48] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:53:47.119576 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164b872-a560-49b0-8648-abfd4c0b38cc None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:47.229030 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164b872-a560-49b0-8648-abfd4c0b38cc None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:47.266420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef310a0-5f63-4b9c-98d5-bc7e4b74c148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:47.267258 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef310a0-5f63-4b9c-98d5-bc7e4b74c148 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:47.267547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef310a0-5f63-4b9c-98d5-bc7e4b74c148 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:47.267841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef310a0-5f63-4b9c-98d5-bc7e4b74c148 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:47.270432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:47.281513 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef310a0-5f63-4b9c-98d5-bc7e4b74c148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:53:47.289269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-9ef310a0-5f63-4b9c-98d5-bc7e4b74c148 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:53:47.289269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:53:47.289269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:53:47.289269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:53:47.289269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:53:47.289269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:53:47.289269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:53:47.289269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:53:47.289269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:53:47.289269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:53:47.289269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:53:47.289269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:53:47.289269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:53:47.289269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:53:47.289269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:53:47.289269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:53:47.290162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:53:47.290162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:53:47.290162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:53:47.290162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:53:47.290162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:53:47.290162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:53:47.290162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:53:47.290162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:53:47.290162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:53:47.290162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:53:47.290162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:53:47.290162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:53:47.290162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:53:47.290162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:53:47.290162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:53:47.290162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:53:47.290901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:53:47.290901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:53:47.290901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:53:47.290901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:53:47.290901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:53:47.290901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:53:47.290901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:53:47.290901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:53:47.290901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:53:47.290901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:53:47.290901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:53:47.290901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:53:47.290901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 28/49] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:53:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:53:47.296564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf8b18-1cbb-4dd0-840b-6085374ba7bc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:47.316602 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:47.399965 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf8b18-1cbb-4dd0-840b-6085374ba7bc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:47.433485 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6e496-b72c-4f8b-80bb-4123f11db229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:47.434194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6e496-b72c-4f8b-80bb-4123f11db229 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:47.434484 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6e496-b72c-4f8b-80bb-4123f11db229 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:47.434766 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6e496-b72c-4f8b-80bb-4123f11db229 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:47.435501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6e496-b72c-4f8b-80bb-4123f11db229 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:53:47.435807 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6e496-b72c-4f8b-80bb-4123f11db229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:47.437200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6e496-b72c-4f8b-80bb-4123f11db229 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:47.439988 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532d719-5d1d-4562-9960-46845801a9c1 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:47.440689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532d719-5d1d-4562-9960-46845801a9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:47.440977 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532d719-5d1d-4562-9960-46845801a9c1 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:47.443035 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 29/50] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:53:47.446014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 22/51] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:53:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:47.448178 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d8565-60ad-446c-90df-3e72637189bd None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:47.448497 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d8565-60ad-446c-90df-3e72637189bd None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:47.448750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d8565-60ad-446c-90df-3e72637189bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:47.451218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6e496-b72c-4f8b-80bb-4123f11db229 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:47.466535 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-af7d8565-60ad-446c-90df-3e72637189bd None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:47.468086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-af7d8565-60ad-446c-90df-3e72637189bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:47.535801 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:47.541757 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 30/52] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:53:47.556057 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6e496-b72c-4f8b-80bb-4123f11db229 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:47.565579 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d8565-60ad-446c-90df-3e72637189bd None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:47.590959 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258feeb-11d9-47d7-a78e-116ecefe30ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:47.592082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258feeb-11d9-47d7-a78e-116ecefe30ee None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:47.592362 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258feeb-11d9-47d7-a78e-116ecefe30ee None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:47.592626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258feeb-11d9-47d7-a78e-116ecefe30ee None admin] PATH_INFO: `/v3/users/83882af68d99499bbc81a5c6e9abb2e1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:47.593819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258feeb-11d9-47d7-a78e-116ecefe30ee None admin] RBAC: Authorizing `identity:get_user(user_id=83882af68d99499bbc81a5c6e9abb2e1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:47.595319 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258feeb-11d9-47d7-a78e-116ecefe30ee None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:47.597208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 23/53] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:53:47 2022] GET /identity/v3/users/83882af68d99499bbc81a5c6e9abb2e1 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:53:47.602547 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258feeb-11d9-47d7-a78e-116ecefe30ee None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:47.667032 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d8565-60ad-446c-90df-3e72637189bd None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:47.690287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:47.701805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec2cc3-fda4-4599-92a0-9b34c5ca76a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:47.702618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec2cc3-fda4-4599-92a0-9b34c5ca76a2 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:47.702903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec2cc3-fda4-4599-92a0-9b34c5ca76a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:47.703182 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec2cc3-fda4-4599-92a0-9b34c5ca76a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:47.703589 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258feeb-11d9-47d7-a78e-116ecefe30ee None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:47.704377 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec2cc3-fda4-4599-92a0-9b34c5ca76a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:47.706134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec2cc3-fda4-4599-92a0-9b34c5ca76a2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:47.707786 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 31/54] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:53:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:53:47.713634 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec2cc3-fda4-4599-92a0-9b34c5ca76a2 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:47.737524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f52b5-7e6f-4b83-9da6-ac4a06d71196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:47.738365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f52b5-7e6f-4b83-9da6-ac4a06d71196 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:47.738654 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f52b5-7e6f-4b83-9da6-ac4a06d71196 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:47.738934 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f52b5-7e6f-4b83-9da6-ac4a06d71196 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:47.740106 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f52b5-7e6f-4b83-9da6-ac4a06d71196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:47.741603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f52b5-7e6f-4b83-9da6-ac4a06d71196 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:47.743276 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 24/55] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:53:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:53:47.749032 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f52b5-7e6f-4b83-9da6-ac4a06d71196 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:47.771667 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:47.818039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec2cc3-fda4-4599-92a0-9b34c5ca76a2 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:47.852358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5f6cb-5890-4b66-9bfc-d2a72d6b274f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:47.853245 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5f6cb-5890-4b66-9bfc-d2a72d6b274f None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:47.853534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5f6cb-5890-4b66-9bfc-d2a72d6b274f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:47.853838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5f6cb-5890-4b66-9bfc-d2a72d6b274f None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:47.854335 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f52b5-7e6f-4b83-9da6-ac4a06d71196 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:47.854561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5f6cb-5890-4b66-9bfc-d2a72d6b274f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:47.856052 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5f6cb-5890-4b66-9bfc-d2a72d6b274f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:47.882903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 32/56] 10.222.0.61 () {60 vars in 1140 bytes} [Thu May 26 20:53:47 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:53:47.888698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d13bd-dfe3-4f8f-aae0-1df6eb89704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:47.889435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d13bd-dfe3-4f8f-aae0-1df6eb89704f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:47.889723 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d13bd-dfe3-4f8f-aae0-1df6eb89704f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:47.890040 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d13bd-dfe3-4f8f-aae0-1df6eb89704f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:47.890890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d13bd-dfe3-4f8f-aae0-1df6eb89704f None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.domain.id=default, user.id=83882af68d99499bbc81a5c6e9abb2e1) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:53:47.891208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d13bd-dfe3-4f8f-aae0-1df6eb89704f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:47.892883 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d13bd-dfe3-4f8f-aae0-1df6eb89704f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:47.903162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 25/57] 10.222.0.61 () {56 vars in 1322 bytes} [Thu May 26 20:53:47 2022] GET /identity/v3/role_assignments?user.id=83882af68d99499bbc81a5c6e9abb2e1&scope.domain.id=default&role.id=aefba81d87bf47258c17064af7d9a05f => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:53:50.065131 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f0098-7fba-40bc-bc46-e3b0a7203b93 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:50.065955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f0098-7fba-40bc-bc46-e3b0a7203b93 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:50.066124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f0098-7fba-40bc-bc46-e3b0a7203b93 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:50.068175 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 33/58] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:50.076965 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca82e1-5275-4d91-93a8-537131eafb24 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:50.077643 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca82e1-5275-4d91-93a8-537131eafb24 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:50.077961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca82e1-5275-4d91-93a8-537131eafb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:50.103379 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fbca82e1-5275-4d91-93a8-537131eafb24 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:50.104593 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fbca82e1-5275-4d91-93a8-537131eafb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:50.174709 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 26/59] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:53:50.199221 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f0098-7fba-40bc-bc46-e3b0a7203b93 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:50.267305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:50.325909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f0098-7fba-40bc-bc46-e3b0a7203b93 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:50.362894 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673122b-aa6e-469c-b63a-2ee5aacae1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:50.363699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673122b-aa6e-469c-b63a-2ee5aacae1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:50.363987 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673122b-aa6e-469c-b63a-2ee5aacae1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:50.364263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673122b-aa6e-469c-b63a-2ee5aacae1d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:50.365590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673122b-aa6e-469c-b63a-2ee5aacae1d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:50.367164 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673122b-aa6e-469c-b63a-2ee5aacae1d5 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:50.368793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 34/60] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:53:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:50.374720 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca82e1-5275-4d91-93a8-537131eafb24 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:50.388002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:50.481395 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca82e1-5275-4d91-93a8-537131eafb24 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:50.532770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523aebc0-116f-423b-b8db-bca8f6080bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:50.533836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aebc0-116f-423b-b8db-bca8f6080bb5 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:50.534300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aebc0-116f-423b-b8db-bca8f6080bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:50.534600 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aebc0-116f-423b-b8db-bca8f6080bb5 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:50.535344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523aebc0-116f-423b-b8db-bca8f6080bb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:50.536838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523aebc0-116f-423b-b8db-bca8f6080bb5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:50.567861 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 27/61] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:53:50 2022] POST /identity/v3/users => generated 275 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:53:53.831257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48017-e114-42d8-ab37-bcb6c4eab08c None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:53.831768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48017-e114-42d8-ab37-bcb6c4eab08c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:53.831839 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48017-e114-42d8-ab37-bcb6c4eab08c None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:53.833732 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 35/62] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:53.839259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d135050-ecb8-431b-bea8-cfe4889c502f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:53.839690 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d135050-ecb8-431b-bea8-cfe4889c502f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:53.839861 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d135050-ecb8-431b-bea8-cfe4889c502f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:53.863243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1d135050-ecb8-431b-bea8-cfe4889c502f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:53.864471 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1d135050-ecb8-431b-bea8-cfe4889c502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:53.960821 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:53.969526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 28/63] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:53:54.016308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a48017-e114-42d8-ab37-bcb6c4eab08c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:54.127781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ea9a6-1d71-4be8-9f8d-eb063954ecd6 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:54.128466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ea9a6-1d71-4be8-9f8d-eb063954ecd6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:54.128921 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ea9a6-1d71-4be8-9f8d-eb063954ecd6 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:54.130583 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 29/64] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:53:54.136249 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f21bb-4969-4524-ae01-c3a58bc5e05d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:54.136777 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f21bb-4969-4524-ae01-c3a58bc5e05d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:54.137263 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f21bb-4969-4524-ae01-c3a58bc5e05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:54.159379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a48017-e114-42d8-ab37-bcb6c4eab08c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:54.169825 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ee1f21bb-4969-4524-ae01-c3a58bc5e05d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:54.171166 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ee1f21bb-4969-4524-ae01-c3a58bc5e05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:54.191437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:54.238787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351757b-0941-4e55-b400-b2ea4d2ffb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:54.239614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351757b-0941-4e55-b400-b2ea4d2ffb9d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:54.239903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351757b-0941-4e55-b400-b2ea4d2ffb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:54.240181 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351757b-0941-4e55-b400-b2ea4d2ffb9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:54.270844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351757b-0941-4e55-b400-b2ea4d2ffb9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:53:54.279113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-e351757b-0941-4e55-b400-b2ea4d2ffb9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:53:54.279113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:53:54.279113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:53:54.279113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:53:54.279113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:53:54.279113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:53:54.279113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:53:54.279113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:53:54.279113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:53:54.279113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:53:54.279113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:53:54.279113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:53:54.279113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:53:54.279113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:53:54.279113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:53:54.279113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:53:54.279955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:53:54.279955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:53:54.279955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:53:54.279955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:53:54.279955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:53:54.279955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:53:54.279955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:53:54.279955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:53:54.279955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:53:54.279955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:53:54.279955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:53:54.279955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:53:54.279955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:53:54.279955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:53:54.279955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:53:54.279955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:53:54.280689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:53:54.280689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:53:54.280689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:53:54.280689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:53:54.280689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:53:54.280689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:53:54.280689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:53:54.280689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:53:54.280689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:53:54.280689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:53:54.280689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:53:54.280689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:53:54.283091 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 36/65] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:53:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:53:54.289026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351757b-0941-4e55-b400-b2ea4d2ffb9d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:54.296846 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 30/66] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:53:54.367619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f21bb-4969-4524-ae01-c3a58bc5e05d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:54.428487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351757b-0941-4e55-b400-b2ea4d2ffb9d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:54.463899 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d319cf7-8585-4927-89c6-23461c0f7224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:54.464667 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d319cf7-8585-4927-89c6-23461c0f7224 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:54.464954 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d319cf7-8585-4927-89c6-23461c0f7224 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:54.465234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d319cf7-8585-4927-89c6-23461c0f7224 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:54.466052 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d319cf7-8585-4927-89c6-23461c0f7224 None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:53:54.466357 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d319cf7-8585-4927-89c6-23461c0f7224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:54.467769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d319cf7-8585-4927-89c6-23461c0f7224 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:54.476928 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 37/67] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:53:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:53:54.478169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9bcc8-9af8-4b47-b8e0-2083bbbbe572 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:54.478527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9bcc8-9af8-4b47-b8e0-2083bbbbe572 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:54.478872 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9bcc8-9af8-4b47-b8e0-2083bbbbe572 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:54.479532 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f21bb-4969-4524-ae01-c3a58bc5e05d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:54.480249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 38/68] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:54.484502 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702a77b-504c-40b1-9faa-62863d8a9983 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:54.484502 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702a77b-504c-40b1-9faa-62863d8a9983 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:54.484502 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702a77b-504c-40b1-9faa-62863d8a9983 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:54.484502 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 39/69] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:54.484502 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702a77b-504c-40b1-9faa-62863d8a9983 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:54.514345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:54.522970 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:54.524664 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5a9ff-d49c-4c6f-a585-3234f4da34bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:54.525546 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5a9ff-d49c-4c6f-a585-3234f4da34bc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:54.525885 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5a9ff-d49c-4c6f-a585-3234f4da34bc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:54.526144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5a9ff-d49c-4c6f-a585-3234f4da34bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:54.538569 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5a9ff-d49c-4c6f-a585-3234f4da34bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:53:54.546524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-38a5a9ff-d49c-4c6f-a585-3234f4da34bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:53:54.546524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:53:54.546524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:53:54.546524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:53:54.546524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:53:54.546524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:53:54.546524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:53:54.546524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:53:54.546524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:53:54.546524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:53:54.546524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:53:54.546524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:53:54.546524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:53:54.546524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:53:54.546524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:53:54.546524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:53:54.547543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:53:54.547543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:53:54.547543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:53:54.547543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:53:54.547543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:53:54.547543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:53:54.547543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:53:54.547543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:53:54.547543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:53:54.547543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:53:54.547543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:53:54.547543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:53:54.547543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:53:54.547543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:53:54.547543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:53:54.547543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:53:54.548436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:53:54.548436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:53:54.548436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:53:54.548436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:53:54.548436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:53:54.548436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:53:54.548436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:53:54.548436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:53:54.548436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:53:54.548436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:53:54.548436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:53:54.548436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:53:54.548436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 31/70] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:53:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:53:54.549811 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62122b8-a506-490f-9b28-9d5bd3bf7aea None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:54.550103 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62122b8-a506-490f-9b28-9d5bd3bf7aea None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:54.550388 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62122b8-a506-490f-9b28-9d5bd3bf7aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:54.567470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a62122b8-a506-490f-9b28-9d5bd3bf7aea None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:54.568681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a62122b8-a506-490f-9b28-9d5bd3bf7aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:54.595073 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702a77b-504c-40b1-9faa-62863d8a9983 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:54.627396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aacc76-4837-4a2b-a44e-76052511c02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:54.628277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aacc76-4837-4a2b-a44e-76052511c02d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:54.628562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aacc76-4837-4a2b-a44e-76052511c02d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:54.628845 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aacc76-4837-4a2b-a44e-76052511c02d None admin] PATH_INFO: `/v3/users/fa17abe1a5354190bf763fadfd8bdc9f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:54.638677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 32/71] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:53:54.640171 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073be4b-3f6d-4f5e-8dc3-98e115bf4061 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:54.640463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073be4b-3f6d-4f5e-8dc3-98e115bf4061 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:54.640748 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073be4b-3f6d-4f5e-8dc3-98e115bf4061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:54.642212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aacc76-4837-4a2b-a44e-76052511c02d None admin] RBAC: Authorizing `identity:get_user(user_id=fa17abe1a5354190bf763fadfd8bdc9f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:54.643766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aacc76-4837-4a2b-a44e-76052511c02d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:54.645440 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 40/72] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:53:54 2022] GET /identity/v3/users/fa17abe1a5354190bf763fadfd8bdc9f => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:54.646779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953439e-c037-4f2f-adfa-6b3de255db8a None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:54.647067 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953439e-c037-4f2f-adfa-6b3de255db8a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:54.647344 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953439e-c037-4f2f-adfa-6b3de255db8a None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:54.648703 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 41/73] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:54.649251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953439e-c037-4f2f-adfa-6b3de255db8a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:54.664228 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1073be4b-3f6d-4f5e-8dc3-98e115bf4061 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:54.665555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1073be4b-3f6d-4f5e-8dc3-98e115bf4061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:54.733222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 33/74] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:53:54.734188 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073be4b-3f6d-4f5e-8dc3-98e115bf4061 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:54.743799 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:54.755441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953439e-c037-4f2f-adfa-6b3de255db8a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:54.786395 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:54.792322 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962ed9e-54e7-4d95-875b-76a9e16e2aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:54.793010 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962ed9e-54e7-4d95-875b-76a9e16e2aeb None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:54.793296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962ed9e-54e7-4d95-875b-76a9e16e2aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:54.793572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962ed9e-54e7-4d95-875b-76a9e16e2aeb None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:54.794399 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962ed9e-54e7-4d95-875b-76a9e16e2aeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:53:54.794670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962ed9e-54e7-4d95-875b-76a9e16e2aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:54.796086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962ed9e-54e7-4d95-875b-76a9e16e2aeb None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:54.804702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 42/75] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:53:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:54.805985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29662dd7-a528-49f3-be8e-f2341c80349d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:54.806282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29662dd7-a528-49f3-be8e-f2341c80349d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:54.806565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29662dd7-a528-49f3-be8e-f2341c80349d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:54.824305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-29662dd7-a528-49f3-be8e-f2341c80349d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:54.825512 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-29662dd7-a528-49f3-be8e-f2341c80349d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:54.842569 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073be4b-3f6d-4f5e-8dc3-98e115bf4061 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:54.878110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29a0aa-13cb-43dc-bf4f-8215f77ab842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:54.878888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a0aa-13cb-43dc-bf4f-8215f77ab842 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:54.879234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a0aa-13cb-43dc-bf4f-8215f77ab842 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:54.879517 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a0aa-13cb-43dc-bf4f-8215f77ab842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:54.893449 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 43/76] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:53:54.894330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29662dd7-a528-49f3-be8e-f2341c80349d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:54.953277 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29a0aa-13cb-43dc-bf4f-8215f77ab842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:54.954851 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29a0aa-13cb-43dc-bf4f-8215f77ab842 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:54.994304 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:55.008247 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:55.012212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29662dd7-a528-49f3-be8e-f2341c80349d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:55.046059 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a109a6-3125-4607-87e2-334da8743671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:55.046801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a109a6-3125-4607-87e2-334da8743671 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:55.047084 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a109a6-3125-4607-87e2-334da8743671 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:55.047354 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a109a6-3125-4607-87e2-334da8743671 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:55.058369 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a109a6-3125-4607-87e2-334da8743671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:53:55.063764 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 34/77] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:53:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:53:55.064831 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29a0aa-13cb-43dc-bf4f-8215f77ab842 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:55.066208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-a8a109a6-3125-4607-87e2-334da8743671 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:53:55.066208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:53:55.066208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:53:55.066208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:53:55.066208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:53:55.066208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:53:55.066208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:53:55.066208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:53:55.066208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:53:55.066208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:53:55.066208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:53:55.066208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:53:55.066208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:53:55.066208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:53:55.066208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:53:55.066208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:53:55.067077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:53:55.067077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:53:55.067077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:53:55.067077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:53:55.067077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:53:55.067077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:53:55.067077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:53:55.067077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:53:55.067077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:53:55.067077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:53:55.067077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:53:55.067077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:53:55.067077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:53:55.067077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:53:55.067077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:53:55.067077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:53:55.067821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:53:55.067821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:53:55.067821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:53:55.067821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:53:55.067821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:53:55.067821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:53:55.067821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:53:55.067821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:53:55.067821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:53:55.067821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:53:55.067821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:53:55.067821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:53:55.067821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 44/78] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:53:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:53:55.069238 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a109a6-3125-4607-87e2-334da8743671 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:55.167367 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29a0aa-13cb-43dc-bf4f-8215f77ab842 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:55.168827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a109a6-3125-4607-87e2-334da8743671 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:55.203511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293efa11-c66a-4aa1-9415-d3ae6c90a7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:55.203708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbe892-4c64-4c72-bd72-a40046618412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:55.204365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293efa11-c66a-4aa1-9415-d3ae6c90a7df None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:55.204479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbe892-4c64-4c72-bd72-a40046618412 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:55.204651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293efa11-c66a-4aa1-9415-d3ae6c90a7df None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:55.204745 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbe892-4c64-4c72-bd72-a40046618412 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:55.204961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293efa11-c66a-4aa1-9415-d3ae6c90a7df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:55.205115 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbe892-4c64-4c72-bd72-a40046618412 None admin] PATH_INFO: `/v3/users/83882af68d99499bbc81a5c6e9abb2e1` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:55.206312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbe892-4c64-4c72-bd72-a40046618412 None admin] RBAC: Authorizing `identity:get_user(user_id=83882af68d99499bbc81a5c6e9abb2e1)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:55.207792 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbe892-4c64-4c72-bd72-a40046618412 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:55.209423 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 45/79] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:53:55 2022] GET /identity/v3/users/83882af68d99499bbc81a5c6e9abb2e1 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:55.210211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbe892-4c64-4c72-bd72-a40046618412 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:55.216168 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293efa11-c66a-4aa1-9415-d3ae6c90a7df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:53:55.224440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-293efa11-c66a-4aa1-9415-d3ae6c90a7df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:53:55.224440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:53:55.224440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:53:55.224440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:53:55.224440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:53:55.224440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:53:55.224440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:53:55.224440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:53:55.224440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:53:55.224440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:53:55.224440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:53:55.224440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:53:55.224440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:53:55.224440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:53:55.224440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:53:55.224440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:53:55.225299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:53:55.225299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:53:55.225299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:53:55.225299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:53:55.225299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:53:55.225299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:53:55.225299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:53:55.225299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:53:55.225299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:53:55.225299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:53:55.225299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:53:55.225299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:53:55.225299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:53:55.225299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:53:55.225299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:53:55.225299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:53:55.226099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:53:55.226099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:53:55.226099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:53:55.226099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:53:55.226099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:53:55.226099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:53:55.226099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:53:55.226099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:53:55.226099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:53:55.226099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:53:55.226099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:53:55.226099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:53:55.226099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 35/80] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:53:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:53:55.226723 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293efa11-c66a-4aa1-9415-d3ae6c90a7df None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:55.230524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:55.238740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:55.320789 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbe892-4c64-4c72-bd72-a40046618412 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:55.337757 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293efa11-c66a-4aa1-9415-d3ae6c90a7df None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:55.355163 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76095229-0ecb-40a4-bf40-bfcba4b89f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:55.355977 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76095229-0ecb-40a4-bf40-bfcba4b89f4e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:55.356271 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76095229-0ecb-40a4-bf40-bfcba4b89f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:55.356549 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76095229-0ecb-40a4-bf40-bfcba4b89f4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:55.357743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76095229-0ecb-40a4-bf40-bfcba4b89f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:55.359269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76095229-0ecb-40a4-bf40-bfcba4b89f4e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:55.361164 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 46/81] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:53:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:55.361777 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76095229-0ecb-40a4-bf40-bfcba4b89f4e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:55.376984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b58b5b-da21-4966-8ed1-cc156e168936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:55.377963 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b58b5b-da21-4966-8ed1-cc156e168936 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:55.378267 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b58b5b-da21-4966-8ed1-cc156e168936 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:55.378544 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b58b5b-da21-4966-8ed1-cc156e168936 None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:55.379751 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b58b5b-da21-4966-8ed1-cc156e168936 None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:55.381226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b58b5b-da21-4966-8ed1-cc156e168936 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:55.382955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 36/82] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:53:55 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:55.383726 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b58b5b-da21-4966-8ed1-cc156e168936 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:55.448695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:55.462140 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:55.468868 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76095229-0ecb-40a4-bf40-bfcba4b89f4e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:55.488535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b58b5b-da21-4966-8ed1-cc156e168936 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:55.504120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd19cc-f8ef-460e-a486-a8b83aff50e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:55.504839 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd19cc-f8ef-460e-a486-a8b83aff50e9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:55.505122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd19cc-f8ef-460e-a486-a8b83aff50e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:55.505407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd19cc-f8ef-460e-a486-a8b83aff50e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:55.506299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd19cc-f8ef-460e-a486-a8b83aff50e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:53:55.506597 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd19cc-f8ef-460e-a486-a8b83aff50e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:55.508018 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd19cc-f8ef-460e-a486-a8b83aff50e9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:55.516441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 47/83] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:53:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:55.517232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd19cc-f8ef-460e-a486-a8b83aff50e9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:55.526821 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb492705-c874-4711-afc9-2ae5605ac6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:55.527493 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb492705-c874-4711-afc9-2ae5605ac6ad None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:55.527783 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb492705-c874-4711-afc9-2ae5605ac6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:55.528099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb492705-c874-4711-afc9-2ae5605ac6ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:55.595899 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb492705-c874-4711-afc9-2ae5605ac6ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:55.597365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb492705-c874-4711-afc9-2ae5605ac6ad None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:55.620507 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd19cc-f8ef-460e-a486-a8b83aff50e9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:55.658118 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f2738-52e9-4011-9584-2d6eabc6151c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:55.658799 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f2738-52e9-4011-9584-2d6eabc6151c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:55.659108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f2738-52e9-4011-9584-2d6eabc6151c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:55.659379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f2738-52e9-4011-9584-2d6eabc6151c None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:55.660143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f2738-52e9-4011-9584-2d6eabc6151c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:53:55.660439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f2738-52e9-4011-9584-2d6eabc6151c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:55.661886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f2738-52e9-4011-9584-2d6eabc6151c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:55.669717 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 48/84] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:53:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:55.670505 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f2738-52e9-4011-9584-2d6eabc6151c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:55.673932 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:55.683146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:55.710520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 37/85] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:53:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:53:55.711705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb492705-c874-4711-afc9-2ae5605ac6ad None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:55.774013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f2738-52e9-4011-9584-2d6eabc6151c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:55.807681 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf59739-fe6b-42fe-8038-78f29980a54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:55.808374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf59739-fe6b-42fe-8038-78f29980a54c None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:55.808664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf59739-fe6b-42fe-8038-78f29980a54c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:55.808947 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf59739-fe6b-42fe-8038-78f29980a54c None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:55.809675 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf59739-fe6b-42fe-8038-78f29980a54c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:55.811208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf59739-fe6b-42fe-8038-78f29980a54c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:55.812666 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb492705-c874-4711-afc9-2ae5605ac6ad None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:55.838401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 49/86] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:53:55 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:53:55.839044 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf59739-fe6b-42fe-8038-78f29980a54c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:55.855929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9321c1b-b950-43df-89b8-91f80f6f8620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:55.856605 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9321c1b-b950-43df-89b8-91f80f6f8620 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:55.856795 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9321c1b-b950-43df-89b8-91f80f6f8620 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:55.857091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9321c1b-b950-43df-89b8-91f80f6f8620 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:55.858002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9321c1b-b950-43df-89b8-91f80f6f8620 None admin] RBAC: Adding query filter params (role.id=7f252cd3de7047e396a0daf6e7d4d2ee, scope.project.id=839fd844cfbb442e8202597c69e6bbee, user.id=fa17abe1a5354190bf763fadfd8bdc9f) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:53:55.858323 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9321c1b-b950-43df-89b8-91f80f6f8620 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:55.859836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9321c1b-b950-43df-89b8-91f80f6f8620 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:55.866393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 38/87] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:53:55 2022] GET /identity/v3/role_assignments?user.id=fa17abe1a5354190bf763fadfd8bdc9f&scope.project.id=839fd844cfbb442e8202597c69e6bbee&role.id=7f252cd3de7047e396a0daf6e7d4d2ee => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:55.874957 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9321c1b-b950-43df-89b8-91f80f6f8620 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:55.934132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:55.942935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:56.003325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf59739-fe6b-42fe-8038-78f29980a54c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:56.030083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9321c1b-b950-43df-89b8-91f80f6f8620 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:56.053642 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29e339-1b12-4347-b7aa-718c2ed00b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:56.055006 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29e339-1b12-4347-b7aa-718c2ed00b6e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:56.055483 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29e339-1b12-4347-b7aa-718c2ed00b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:56.056131 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29e339-1b12-4347-b7aa-718c2ed00b6e None admin] PATH_INFO: `/v3/users/fa17abe1a5354190bf763fadfd8bdc9f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:56.058414 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29e339-1b12-4347-b7aa-718c2ed00b6e None admin] RBAC: Authorizing `identity:get_user(user_id=fa17abe1a5354190bf763fadfd8bdc9f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:56.060222 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29e339-1b12-4347-b7aa-718c2ed00b6e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:56.062239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 50/88] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:53:55 2022] GET /identity/v3/users/fa17abe1a5354190bf763fadfd8bdc9f => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:56.064200 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29e339-1b12-4347-b7aa-718c2ed00b6e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:56.080220 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b8729-d8cb-4cb6-bed3-55e31631c30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:56.081273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b8729-d8cb-4cb6-bed3-55e31631c30e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:56.081560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b8729-d8cb-4cb6-bed3-55e31631c30e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:56.081961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b8729-d8cb-4cb6-bed3-55e31631c30e None admin] PATH_INFO: `/v3/users/fa17abe1a5354190bf763fadfd8bdc9f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:56.083211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b8729-d8cb-4cb6-bed3-55e31631c30e None admin] RBAC: Authorizing `identity:get_user(user_id=fa17abe1a5354190bf763fadfd8bdc9f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:56.084680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b8729-d8cb-4cb6-bed3-55e31631c30e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:56.087346 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 39/89] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:53:55 2022] GET /identity/v3/users/fa17abe1a5354190bf763fadfd8bdc9f => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:56.088130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b8729-d8cb-4cb6-bed3-55e31631c30e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:56.185304 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29e339-1b12-4347-b7aa-718c2ed00b6e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:56.198385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b8729-d8cb-4cb6-bed3-55e31631c30e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:56.206418 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:56.216567 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:56.226710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae49c0-492c-4af3-b7ea-0eaf219a762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:56.228780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae49c0-492c-4af3-b7ea-0eaf219a762f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:56.228780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae49c0-492c-4af3-b7ea-0eaf219a762f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:56.228780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae49c0-492c-4af3-b7ea-0eaf219a762f None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:56.231052 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae49c0-492c-4af3-b7ea-0eaf219a762f None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:56.232635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae49c0-492c-4af3-b7ea-0eaf219a762f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:56.235774 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 51/90] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:53:56 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:56.241046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae49c0-492c-4af3-b7ea-0eaf219a762f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:56.247235 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c0095-8276-4f0a-95a8-5dc7d368eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:56.248157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c0095-8276-4f0a-95a8-5dc7d368eafa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:56.248622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c0095-8276-4f0a-95a8-5dc7d368eafa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:56.249101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c0095-8276-4f0a-95a8-5dc7d368eafa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:56.343638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c0095-8276-4f0a-95a8-5dc7d368eafa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:56.345367 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c0095-8276-4f0a-95a8-5dc7d368eafa None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:56.370748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae49c0-492c-4af3-b7ea-0eaf219a762f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:56.420723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6248ce-cb30-45db-b2f4-bd66de3d30d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:56.421680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6248ce-cb30-45db-b2f4-bd66de3d30d4 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:56.422008 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6248ce-cb30-45db-b2f4-bd66de3d30d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:56.422294 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6248ce-cb30-45db-b2f4-bd66de3d30d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:56.499389 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:56.505038 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 40/91] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:53:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:53:56.505961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c0095-8276-4f0a-95a8-5dc7d368eafa None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:56.508163 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6248ce-cb30-45db-b2f4-bd66de3d30d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:56.509993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6248ce-cb30-45db-b2f4-bd66de3d30d4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:56.529421 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:56.661153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c0095-8276-4f0a-95a8-5dc7d368eafa None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:56.700855 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e06c82-d8ed-4439-b7a3-abe899a3f2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:56.701942 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e06c82-d8ed-4439-b7a3-abe899a3f2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:56.702240 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e06c82-d8ed-4439-b7a3-abe899a3f2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:56.702530 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e06c82-d8ed-4439-b7a3-abe899a3f2a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:56.703384 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e06c82-d8ed-4439-b7a3-abe899a3f2a3 None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=839fd844cfbb442e8202597c69e6bbee, user.id=83882af68d99499bbc81a5c6e9abb2e1) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:53:56.703704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e06c82-d8ed-4439-b7a3-abe899a3f2a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:56.705212 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e06c82-d8ed-4439-b7a3-abe899a3f2a3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:56.712525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 41/92] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:53:56 2022] GET /identity/v3/role_assignments?user.id=83882af68d99499bbc81a5c6e9abb2e1&scope.project.id=839fd844cfbb442e8202597c69e6bbee&role.id=aefba81d87bf47258c17064af7d9a05f => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:56.713365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e06c82-d8ed-4439-b7a3-abe899a3f2a3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:56.804646 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 52/93] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:53:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:53:56.831686 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6248ce-cb30-45db-b2f4-bd66de3d30d4 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:56.850015 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:56.899403 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e06c82-d8ed-4439-b7a3-abe899a3f2a3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:56.959068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28406482-7460-43b9-823d-48088f41ffc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:56.960323 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28406482-7460-43b9-823d-48088f41ffc1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:56.960840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28406482-7460-43b9-823d-48088f41ffc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:56.961124 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28406482-7460-43b9-823d-48088f41ffc1 None admin] PATH_INFO: `/v3/projects/a2547a9cf2c4470a8cb242f3fd28c22e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:56.963323 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28406482-7460-43b9-823d-48088f41ffc1 None admin] RBAC: Authorizing `identity:get_project(project_id=a2547a9cf2c4470a8cb242f3fd28c22e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:56.964794 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28406482-7460-43b9-823d-48088f41ffc1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:56.966748 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 42/94] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:53:56 2022] GET /identity/v3/projects/a2547a9cf2c4470a8cb242f3fd28c22e => generated 312 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:56.974619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28406482-7460-43b9-823d-48088f41ffc1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:57.124134 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28406482-7460-43b9-823d-48088f41ffc1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:57.144588 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:57.168042 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6248ce-cb30-45db-b2f4-bd66de3d30d4 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:57.202885 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c254d-a9e2-485b-b83f-a53a67e23b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:57.203632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c254d-a9e2-485b-b83f-a53a67e23b66 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:57.203922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c254d-a9e2-485b-b83f-a53a67e23b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:57.204240 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c254d-a9e2-485b-b83f-a53a67e23b66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:57.205223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c254d-a9e2-485b-b83f-a53a67e23b66 None admin] RBAC: Adding query filter params (role.id=7f252cd3de7047e396a0daf6e7d4d2ee, scope.project.id=a2547a9cf2c4470a8cb242f3fd28c22e, user.id=fa17abe1a5354190bf763fadfd8bdc9f) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:53:57.205542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c254d-a9e2-485b-b83f-a53a67e23b66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:57.207052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c254d-a9e2-485b-b83f-a53a67e23b66 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:57.218189 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 43/95] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:53:56 2022] GET /identity/v3/role_assignments?user.id=fa17abe1a5354190bf763fadfd8bdc9f&scope.project.id=a2547a9cf2c4470a8cb242f3fd28c22e&role.id=7f252cd3de7047e396a0daf6e7d4d2ee => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:53:57.236951 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294978d-5433-455c-b979-311f080afd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:57.237870 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294978d-5433-455c-b979-311f080afd51 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:57.238161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294978d-5433-455c-b979-311f080afd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:57.238438 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294978d-5433-455c-b979-311f080afd51 None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:57.239698 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294978d-5433-455c-b979-311f080afd51 None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:57.241188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294978d-5433-455c-b979-311f080afd51 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:57.243090 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 53/96] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:53:56 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:57.249330 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c254d-a9e2-485b-b83f-a53a67e23b66 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:57.252856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:57.394077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c254d-a9e2-485b-b83f-a53a67e23b66 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:57.442923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab1de2-30de-4b64-aa70-b6bb219e1f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:57.443659 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab1de2-30de-4b64-aa70-b6bb219e1f29 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:57.443943 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab1de2-30de-4b64-aa70-b6bb219e1f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:57.444266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab1de2-30de-4b64-aa70-b6bb219e1f29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:57.445128 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab1de2-30de-4b64-aa70-b6bb219e1f29 None admin] RBAC: Adding query filter params (role.id=3695c157587346198902d1f6ec05153a, scope.project.id=839fd844cfbb442e8202597c69e6bbee, user.id=fa17abe1a5354190bf763fadfd8bdc9f) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:53:57.445439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab1de2-30de-4b64-aa70-b6bb219e1f29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:57.446957 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab1de2-30de-4b64-aa70-b6bb219e1f29 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:57.456490 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 44/97] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:53:57 2022] GET /identity/v3/role_assignments?user.id=fa17abe1a5354190bf763fadfd8bdc9f&scope.project.id=839fd844cfbb442e8202597c69e6bbee&role.id=3695c157587346198902d1f6ec05153a => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:58.676965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9f0c9-8ab5-4e95-835d-15269cc4c7fb None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:58.677489 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9f0c9-8ab5-4e95-835d-15269cc4c7fb None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:58.677561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9f0c9-8ab5-4e95-835d-15269cc4c7fb None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:58.679302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 54/98] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:58.684597 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3736dc-5a2e-4d74-b768-0f3b27525f11 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:58.684993 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3736dc-5a2e-4d74-b768-0f3b27525f11 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:58.685151 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3736dc-5a2e-4d74-b768-0f3b27525f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:58.710852 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5d3736dc-5a2e-4d74-b768-0f3b27525f11 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:58.712420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5d3736dc-5a2e-4d74-b768-0f3b27525f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:58.749108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13827-3d42-4e8e-8c73-e13dc982574c None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:58.749407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13827-3d42-4e8e-8c73-e13dc982574c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:58.749679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13827-3d42-4e8e-8c73-e13dc982574c None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:58.752069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 55/99] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:58.757023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf1434-c829-4b4b-9661-6179c7b5f648 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:58.757320 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf1434-c829-4b4b-9661-6179c7b5f648 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:58.757608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf1434-c829-4b4b-9661-6179c7b5f648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:58.779964 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-82bf1434-c829-4b4b-9661-6179c7b5f648 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:58.781153 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-82bf1434-c829-4b4b-9661-6179c7b5f648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:58.814304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:58.820507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 45/100] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:53:58.856730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3736dc-5a2e-4d74-b768-0f3b27525f11 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:58.858039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 56/101] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:53:58.884214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf1434-c829-4b4b-9661-6179c7b5f648 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:58.995456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:59.003385 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf1434-c829-4b4b-9661-6179c7b5f648 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:59.063842 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02d4fe-95be-475d-845f-c97aa5d095cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:59.064767 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02d4fe-95be-475d-845f-c97aa5d095cd None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:59.065065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02d4fe-95be-475d-845f-c97aa5d095cd None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:59.065344 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02d4fe-95be-475d-845f-c97aa5d095cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:59.076709 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02d4fe-95be-475d-845f-c97aa5d095cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:53:59.085729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-ac02d4fe-95be-475d-845f-c97aa5d095cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:53:59.085729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:53:59.085729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:53:59.085729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:53:59.085729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:53:59.085729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:53:59.085729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:53:59.085729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:53:59.085729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:53:59.085729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:53:59.085729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:53:59.085729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:53:59.085729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:53:59.085729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:53:59.085729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:53:59.085729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:53:59.087027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:53:59.087027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:53:59.087027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:53:59.087027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:53:59.087027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:53:59.087027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:53:59.087027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:53:59.087027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:53:59.087027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:53:59.087027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:53:59.087027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:53:59.087027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:53:59.087027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:53:59.087027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:53:59.087027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:53:59.087027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:53:59.088232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:53:59.088232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:53:59.088232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:53:59.088232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:53:59.088232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:53:59.088232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:53:59.088232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:53:59.088232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:53:59.088232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:53:59.088232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:53:59.088232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:53:59.088232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:53:59.088232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 57/102] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:53:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:53:59.094091 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02d4fe-95be-475d-845f-c97aa5d095cd None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:59.095138 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3736dc-5a2e-4d74-b768-0f3b27525f11 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:59.194219 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514e46c-e233-4d1a-8803-a68a0a4ea0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:59.195052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514e46c-e233-4d1a-8803-a68a0a4ea0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:59.195340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514e46c-e233-4d1a-8803-a68a0a4ea0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:59.195618 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514e46c-e233-4d1a-8803-a68a0a4ea0c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:59.224652 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514e46c-e233-4d1a-8803-a68a0a4ea0c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:53:59.232516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a514e46c-e233-4d1a-8803-a68a0a4ea0c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:53:59.232516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:53:59.232516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:53:59.232516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:53:59.232516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:53:59.232516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:53:59.232516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:53:59.232516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:53:59.232516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:53:59.232516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:53:59.232516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:53:59.232516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:53:59.232516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:53:59.232516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:53:59.232516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:53:59.232516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:53:59.233342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:53:59.233342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:53:59.233342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:53:59.233342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:53:59.233342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:53:59.233342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:53:59.233342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:53:59.233342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:53:59.233342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:53:59.233342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:53:59.233342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:53:59.233342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:53:59.233342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:53:59.233342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:53:59.233342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:53:59.233342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:53:59.234507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:53:59.234507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:53:59.234507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:53:59.234507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:53:59.234507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:53:59.234507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:53:59.234507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:53:59.234507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:53:59.234507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:53:59.234507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:53:59.234507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:53:59.234507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:53:59.234507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 46/103] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:53:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:53:59.242283 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514e46c-e233-4d1a-8803-a68a0a4ea0c3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:59.284949 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02d4fe-95be-475d-845f-c97aa5d095cd None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:59.352568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b3c36-d62b-4155-a928-713e22711955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:59.353272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b3c36-d62b-4155-a928-713e22711955 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:59.353565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b3c36-d62b-4155-a928-713e22711955 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:59.353875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b3c36-d62b-4155-a928-713e22711955 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:59.354129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:59.354657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b3c36-d62b-4155-a928-713e22711955 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:53:59.354975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b3c36-d62b-4155-a928-713e22711955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:59.356421 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b3c36-d62b-4155-a928-713e22711955 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:59.377947 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 58/104] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:53:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:53:59.379386 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b809f9e-2f66-4df6-b1e6-d5c7b2957242 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:59.379694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b809f9e-2f66-4df6-b1e6-d5c7b2957242 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:59.379979 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b809f9e-2f66-4df6-b1e6-d5c7b2957242 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:59.381329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 59/105] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:53:59.391535 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b809f9e-2f66-4df6-b1e6-d5c7b2957242 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:59.422976 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:59.452606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514e46c-e233-4d1a-8803-a68a0a4ea0c3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:59.521854 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770abd7-ff3a-46e6-aaad-3aac6fd36179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:59.522848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770abd7-ff3a-46e6-aaad-3aac6fd36179 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:59.524101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770abd7-ff3a-46e6-aaad-3aac6fd36179 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:59.524560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770abd7-ff3a-46e6-aaad-3aac6fd36179 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:59.526101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770abd7-ff3a-46e6-aaad-3aac6fd36179 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:53:59.526950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770abd7-ff3a-46e6-aaad-3aac6fd36179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:59.528726 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770abd7-ff3a-46e6-aaad-3aac6fd36179 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:59.546629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 47/106] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:53:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:53:59.549067 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb91373-5597-4186-b7a1-a231659c20e6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:59.549725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb91373-5597-4186-b7a1-a231659c20e6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:59.551305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb91373-5597-4186-b7a1-a231659c20e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:59.564865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b809f9e-2f66-4df6-b1e6-d5c7b2957242 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:59.587261 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1bb91373-5597-4186-b7a1-a231659c20e6 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:53:59.588497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1bb91373-5597-4186-b7a1-a231659c20e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:53:59.604633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fd1ce-c358-4fd1-a4aa-e874d70b4e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:59.605958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fd1ce-c358-4fd1-a4aa-e874d70b4e39 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:59.606441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fd1ce-c358-4fd1-a4aa-e874d70b4e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:59.606911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fd1ce-c358-4fd1-a4aa-e874d70b4e39 None admin] PATH_INFO: `/v3/users/ee701808355747a580e735ddbb19ef98` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:59.622819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fd1ce-c358-4fd1-a4aa-e874d70b4e39 None admin] RBAC: Authorizing `identity:get_user(user_id=ee701808355747a580e735ddbb19ef98)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:59.624887 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fd1ce-c358-4fd1-a4aa-e874d70b4e39 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:59.627727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 60/107] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:53:59 2022] GET /identity/v3/users/ee701808355747a580e735ddbb19ef98 => generated 289 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:59.628943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fd1ce-c358-4fd1-a4aa-e874d70b4e39 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:59.718198 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:59.745608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fd1ce-c358-4fd1-a4aa-e874d70b4e39 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:59.747269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 48/108] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:53:59.748210 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb91373-5597-4186-b7a1-a231659c20e6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:59.783035 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3c65b-1843-408b-8249-924839193748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:59.784654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3c65b-1843-408b-8249-924839193748 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:59.785223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3c65b-1843-408b-8249-924839193748 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:59.785696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3c65b-1843-408b-8249-924839193748 None admin] PATH_INFO: `/v3/users/fa17abe1a5354190bf763fadfd8bdc9f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:59.787508 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3c65b-1843-408b-8249-924839193748 None admin] RBAC: Authorizing `identity:get_user(user_id=fa17abe1a5354190bf763fadfd8bdc9f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:59.789263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3c65b-1843-408b-8249-924839193748 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:59.791244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 61/109] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:53:59 2022] GET /identity/v3/users/fa17abe1a5354190bf763fadfd8bdc9f => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:59.792296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3c65b-1843-408b-8249-924839193748 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:59.849078 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:59.903591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3c65b-1843-408b-8249-924839193748 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:53:59.943043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca5094-817d-487c-89f8-296f11c940d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:53:59.944271 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca5094-817d-487c-89f8-296f11c940d6 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:53:59.944809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca5094-817d-487c-89f8-296f11c940d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:53:59.945283 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca5094-817d-487c-89f8-296f11c940d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:53:59.946724 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca5094-817d-487c-89f8-296f11c940d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:53:59.948676 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca5094-817d-487c-89f8-296f11c940d6 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:53:59.950597 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 62/110] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:53:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:53:59.952100 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca5094-817d-487c-89f8-296f11c940d6 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:53:59.966210 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:53:59.992375 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb91373-5597-4186-b7a1-a231659c20e6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:00.064577 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca5094-817d-487c-89f8-296f11c940d6 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:00.068349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a44d5-8a90-4eaf-8234-a001e61e3c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:00.068578 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a44d5-8a90-4eaf-8234-a001e61e3c06 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:00.068829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a44d5-8a90-4eaf-8234-a001e61e3c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:00.069108 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a44d5-8a90-4eaf-8234-a001e61e3c06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:00.132886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40a9b9-e642-46fc-a76a-4c3f39cfed6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:00.134787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40a9b9-e642-46fc-a76a-4c3f39cfed6f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:00.135497 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40a9b9-e642-46fc-a76a-4c3f39cfed6f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:00.136593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40a9b9-e642-46fc-a76a-4c3f39cfed6f None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:00.140466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40a9b9-e642-46fc-a76a-4c3f39cfed6f None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:00.142907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40a9b9-e642-46fc-a76a-4c3f39cfed6f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:00.146266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 63/111] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:53:59 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:00.151317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40a9b9-e642-46fc-a76a-4c3f39cfed6f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:00.235018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a44d5-8a90-4eaf-8234-a001e61e3c06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:00.236671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a44d5-8a90-4eaf-8234-a001e61e3c06 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:00.253493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:00.276144 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40a9b9-e642-46fc-a76a-4c3f39cfed6f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:00.303909 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:00.319194 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4a2b5-3971-4260-8f30-2f3bbc566c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:00.320163 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4a2b5-3971-4260-8f30-2f3bbc566c89 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:00.320584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4a2b5-3971-4260-8f30-2f3bbc566c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:00.320995 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4a2b5-3971-4260-8f30-2f3bbc566c89 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:00.322000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4a2b5-3971-4260-8f30-2f3bbc566c89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:00.323747 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4a2b5-3971-4260-8f30-2f3bbc566c89 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:00.356431 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 64/112] 10.222.0.61 () {60 vars in 1141 bytes} [Thu May 26 20:54:00 2022] POST /identity/v3/projects => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:54:00.357584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4a2b5-3971-4260-8f30-2f3bbc566c89 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:00.372685 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 49/113] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:53:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:00.374312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b6f91-e218-4863-b08c-e9e4ac0f5742 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:00.374716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b6f91-e218-4863-b08c-e9e4ac0f5742 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:00.375097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b6f91-e218-4863-b08c-e9e4ac0f5742 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:00.380385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 50/114] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:00.380385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863764d-5005-435e-882a-0e8a62c28cfd None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:00.380385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863764d-5005-435e-882a-0e8a62c28cfd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:00.380385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863764d-5005-435e-882a-0e8a62c28cfd None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:00.380385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 51/115] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:00.381881 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863764d-5005-435e-882a-0e8a62c28cfd None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:00.497656 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4a2b5-3971-4260-8f30-2f3bbc566c89 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:00.518394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863764d-5005-435e-882a-0e8a62c28cfd None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:00.530311 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:00.537913 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f779781-9096-4946-b431-961b13b0eefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:00.539184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f779781-9096-4946-b431-961b13b0eefa None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:00.539607 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f779781-9096-4946-b431-961b13b0eefa None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:00.540017 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f779781-9096-4946-b431-961b13b0eefa None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee/users/fa17abe1a5354190bf763fadfd8bdc9f/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:00.542503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f779781-9096-4946-b431-961b13b0eefa None admin] RBAC: Authorizing `identity:create_grant(project_id=839fd844cfbb442e8202597c69e6bbee, user_id=fa17abe1a5354190bf763fadfd8bdc9f, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:00.544204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f779781-9096-4946-b431-961b13b0eefa None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:00.564459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 65/116] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:54:00 2022] PUT /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee/users/fa17abe1a5354190bf763fadfd8bdc9f/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:54:00.566131 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b122e49-646c-4819-8bcb-66ca2708f06d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:00.566603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b122e49-646c-4819-8bcb-66ca2708f06d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:00.566806 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b122e49-646c-4819-8bcb-66ca2708f06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:00.571356 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e5f10-35ad-40d5-a5b9-8ba402929e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:00.573694 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e5f10-35ad-40d5-a5b9-8ba402929e8e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:00.574521 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e5f10-35ad-40d5-a5b9-8ba402929e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:00.575329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e5f10-35ad-40d5-a5b9-8ba402929e8e None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:00.577852 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e5f10-35ad-40d5-a5b9-8ba402929e8e None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:00.580933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e5f10-35ad-40d5-a5b9-8ba402929e8e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:00.584599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 52/117] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:00 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:00.587255 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e173889-e1f0-47e4-863f-3fb19ea9ae9e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:00.587790 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e173889-e1f0-47e4-863f-3fb19ea9ae9e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:00.588057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2b122e49-646c-4819-8bcb-66ca2708f06d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:00.588328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e173889-e1f0-47e4-863f-3fb19ea9ae9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:00.589283 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2b122e49-646c-4819-8bcb-66ca2708f06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:00.615745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0e173889-e1f0-47e4-863f-3fb19ea9ae9e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:00.617480 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0e173889-e1f0-47e4-863f-3fb19ea9ae9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:00.634342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:00.676075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 66/118] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:00.676992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b122e49-646c-4819-8bcb-66ca2708f06d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:00.709184 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 53/119] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:00.714785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a13b0-f2e8-4abc-be12-bc61d7758a42 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:00.715099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a13b0-f2e8-4abc-be12-bc61d7758a42 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:00.715360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a13b0-f2e8-4abc-be12-bc61d7758a42 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:00.716962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 54/120] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:00.717571 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a13b0-f2e8-4abc-be12-bc61d7758a42 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:00.812644 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b122e49-646c-4819-8bcb-66ca2708f06d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:00.835117 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:00.860725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328e49-c7f0-41d0-a1b4-fd97dd5c8ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:00.861530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328e49-c7f0-41d0-a1b4-fd97dd5c8ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:00.861830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328e49-c7f0-41d0-a1b4-fd97dd5c8ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:00.862118 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328e49-c7f0-41d0-a1b4-fd97dd5c8ca1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:00.862982 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb328e49-c7f0-41d0-a1b4-fd97dd5c8ca1 None admin] RBAC: Adding query filter params (role.id=f6f2b0e067fd4b899c78b84b53d3922c, scope.project.id=839fd844cfbb442e8202597c69e6bbee, user.id=ee701808355747a580e735ddbb19ef98) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:00.863294 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb328e49-c7f0-41d0-a1b4-fd97dd5c8ca1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:00.863719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a13b0-f2e8-4abc-be12-bc61d7758a42 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:00.864798 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb328e49-c7f0-41d0-a1b4-fd97dd5c8ca1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:00.872029 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 67/121] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:00 2022] GET /identity/v3/role_assignments?user.id=ee701808355747a580e735ddbb19ef98&scope.project.id=839fd844cfbb442e8202597c69e6bbee&role.id=f6f2b0e067fd4b899c78b84b53d3922c => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:00.874049 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6ff67-5f4b-4a59-81d6-41c60d75800a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:00.874342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6ff67-5f4b-4a59-81d6-41c60d75800a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:00.874623 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6ff67-5f4b-4a59-81d6-41c60d75800a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:00.895505 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-cde6ff67-5f4b-4a59-81d6-41c60d75800a None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:00.897546 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cde6ff67-5f4b-4a59-81d6-41c60d75800a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:00.939318 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb86156-e2d5-4b82-acee-d470e3416d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:00.940658 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb86156-e2d5-4b82-acee-d470e3416d88 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:00.941039 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb86156-e2d5-4b82-acee-d470e3416d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:00.941434 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb86156-e2d5-4b82-acee-d470e3416d88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:00.971384 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb86156-e2d5-4b82-acee-d470e3416d88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:00.980402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0cb86156-e2d5-4b82-acee-d470e3416d88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:54:00.980402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:00.980402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:00.980402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:00.980402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:00.980402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:00.980402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:00.980402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:00.980402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:00.980402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:00.980402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:00.980402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:00.980402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:00.980402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:00.980402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:00.980402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:00.981470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:00.981470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:00.981470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:00.981470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:00.981470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:00.981470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:00.981470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:00.981470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:00.981470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:00.981470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:00.981470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:00.981470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:00.981470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:00.981470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:00.981470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:00.981470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:00.982389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:00.982389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:00.982389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:00.982389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:00.982389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:00.982389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:00.982389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:00.982389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:00.982389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:00.982389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:00.982389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:54:00.982389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:00.982389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 55/122] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:54:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:00.983079 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb86156-e2d5-4b82-acee-d470e3416d88 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:00.993532 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:01.005375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 68/123] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:01.007062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6ff67-5f4b-4a59-81d6-41c60d75800a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:01.160035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb86156-e2d5-4b82-acee-d470e3416d88 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:01.174840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6ff67-5f4b-4a59-81d6-41c60d75800a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:01.203747 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:01.227797 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00d1c7-f2a6-49b3-864a-aa233e24d8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:01.228656 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00d1c7-f2a6-49b3-864a-aa233e24d8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:01.228947 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00d1c7-f2a6-49b3-864a-aa233e24d8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:01.229231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00d1c7-f2a6-49b3-864a-aa233e24d8a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:01.236589 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639a584-5699-4261-b996-ebdee3c269f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:01.237333 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639a584-5699-4261-b996-ebdee3c269f9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:01.237772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639a584-5699-4261-b996-ebdee3c269f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:01.238080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639a584-5699-4261-b996-ebdee3c269f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:01.238863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639a584-5699-4261-b996-ebdee3c269f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:01.239177 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639a584-5699-4261-b996-ebdee3c269f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:01.240607 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639a584-5699-4261-b996-ebdee3c269f9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:01.256389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00d1c7-f2a6-49b3-864a-aa233e24d8a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:01.261370 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 69/124] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:01.262280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639a584-5699-4261-b996-ebdee3c269f9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:01.267980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-dd00d1c7-f2a6-49b3-864a-aa233e24d8a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:01.267980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:01.267980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:01.267980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:01.267980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:01.267980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:01.267980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:01.267980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:01.267980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:01.267980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:01.267980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:01.267980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:01.267980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:01.267980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:01.267980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:01.267980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:01.269191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:01.269191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:01.269191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:01.269191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:01.269191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:01.269191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:01.269191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:01.269191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:01.269191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:01.269191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:01.269191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:01.269191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:01.269191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:01.269191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:01.269191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:01.269191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:01.270498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:01.270498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:01.270498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:01.270498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:01.270498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:01.270498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:01.270498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:01.270498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:01.270498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:01.270498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:01.270498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:01.270498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:01.270498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 56/125] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:54:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:01.278568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00d1c7-f2a6-49b3-864a-aa233e24d8a4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:01.409642 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639a584-5699-4261-b996-ebdee3c269f9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:01.422958 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:01.480756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e7d32-ecc1-4644-bd7b-0bd265808c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:01.481642 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e7d32-ecc1-4644-bd7b-0bd265808c7f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:01.481959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e7d32-ecc1-4644-bd7b-0bd265808c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:01.482244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e7d32-ecc1-4644-bd7b-0bd265808c7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:01.484879 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00d1c7-f2a6-49b3-864a-aa233e24d8a4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:01.509466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e7d32-ecc1-4644-bd7b-0bd265808c7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:01.518768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-465e7d32-ecc1-4644-bd7b-0bd265808c7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:01.518768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:01.518768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:01.518768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:01.518768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:01.518768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:01.518768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:01.518768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:01.518768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:01.518768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:01.518768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:01.518768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:01.518768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:01.518768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:01.518768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:01.518768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:01.519808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:01.519808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:01.519808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:01.519808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:01.519808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:01.519808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:01.519808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:01.519808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:01.519808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:01.519808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:01.519808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:01.519808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:01.519808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:01.519808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:01.519808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:01.519808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:01.520750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:01.520750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:01.520750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:01.520750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:01.520750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:01.520750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:01.520750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:01.520750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:01.520750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:01.520750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:01.520750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:01.520750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:01.520750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 70/126] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:01.523670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e7d32-ecc1-4644-bd7b-0bd265808c7f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:01.538585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9c8ec-0998-4b65-9885-923513803fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:01.539550 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9c8ec-0998-4b65-9885-923513803fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:01.539838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9c8ec-0998-4b65-9885-923513803fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:01.540121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9c8ec-0998-4b65-9885-923513803fc4 None admin] PATH_INFO: `/v3/users/83882af68d99499bbc81a5c6e9abb2e1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:01.542096 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9c8ec-0998-4b65-9885-923513803fc4 None admin] RBAC: Authorizing `identity:get_user(user_id=83882af68d99499bbc81a5c6e9abb2e1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:01.545148 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9c8ec-0998-4b65-9885-923513803fc4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:01.549746 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 57/127] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:01 2022] GET /identity/v3/users/83882af68d99499bbc81a5c6e9abb2e1 => generated 247 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:01.550647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9c8ec-0998-4b65-9885-923513803fc4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:01.600886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:01.710126 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9c8ec-0998-4b65-9885-923513803fc4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:01.732562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e7d32-ecc1-4644-bd7b-0bd265808c7f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:01.753063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7c55-e4c6-484c-9365-a15307736033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:01.753762 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7c55-e4c6-484c-9365-a15307736033 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:01.754072 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7c55-e4c6-484c-9365-a15307736033 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:01.754349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7c55-e4c6-484c-9365-a15307736033 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:01.755121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c7c55-e4c6-484c-9365-a15307736033 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:01.755425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c7c55-e4c6-484c-9365-a15307736033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:01.756835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c7c55-e4c6-484c-9365-a15307736033 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:01.764908 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:01.780968 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 58/128] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:01.781863 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7c55-e4c6-484c-9365-a15307736033 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:01.816069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbbbe3-e1cc-4f39-a68e-646702bdf484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:01.816820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbbbe3-e1cc-4f39-a68e-646702bdf484 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:01.817118 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbbbe3-e1cc-4f39-a68e-646702bdf484 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:01.817403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbbbe3-e1cc-4f39-a68e-646702bdf484 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:01.818213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbbbe3-e1cc-4f39-a68e-646702bdf484 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:01.818532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbbbe3-e1cc-4f39-a68e-646702bdf484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:01.820030 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbbbe3-e1cc-4f39-a68e-646702bdf484 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:01.840929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 71/129] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:54:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:01.841774 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbbbe3-e1cc-4f39-a68e-646702bdf484 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:01.907745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7c55-e4c6-484c-9365-a15307736033 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:01.951267 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b62a4-e531-423c-af6f-c6236c2c2672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:01.952161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b62a4-e531-423c-af6f-c6236c2c2672 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:01.952444 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b62a4-e531-423c-af6f-c6236c2c2672 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:01.952722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b62a4-e531-423c-af6f-c6236c2c2672 None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:01.957548 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b62a4-e531-423c-af6f-c6236c2c2672 None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:01.960052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b62a4-e531-423c-af6f-c6236c2c2672 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:01.962263 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 59/130] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:01 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:01.962990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b62a4-e531-423c-af6f-c6236c2c2672 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:02.046158 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:02.064376 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:02.075136 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbbbe3-e1cc-4f39-a68e-646702bdf484 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:02.093961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b62a4-e531-423c-af6f-c6236c2c2672 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:02.139435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305104ad-eb92-4639-91df-cac5a710adcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:02.141547 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305104ad-eb92-4639-91df-cac5a710adcf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:02.141848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305104ad-eb92-4639-91df-cac5a710adcf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:02.142137 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305104ad-eb92-4639-91df-cac5a710adcf None admin] PATH_INFO: `/v3/users/fa17abe1a5354190bf763fadfd8bdc9f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:02.145524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305104ad-eb92-4639-91df-cac5a710adcf None admin] RBAC: Authorizing `identity:get_user(user_id=fa17abe1a5354190bf763fadfd8bdc9f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:02.147051 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305104ad-eb92-4639-91df-cac5a710adcf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:02.148732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 60/131] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:01 2022] GET /identity/v3/users/fa17abe1a5354190bf763fadfd8bdc9f => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:02.149485 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305104ad-eb92-4639-91df-cac5a710adcf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:02.155932 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a480ed-463b-4cff-8d8e-a76701663bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:02.156841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a480ed-463b-4cff-8d8e-a76701663bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:02.157130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a480ed-463b-4cff-8d8e-a76701663bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:02.157409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a480ed-463b-4cff-8d8e-a76701663bc3 None admin] PATH_INFO: `/v3/users/fa17abe1a5354190bf763fadfd8bdc9f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:02.158708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a480ed-463b-4cff-8d8e-a76701663bc3 None admin] RBAC: Authorizing `identity:get_user(user_id=fa17abe1a5354190bf763fadfd8bdc9f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:02.161323 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a480ed-463b-4cff-8d8e-a76701663bc3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:02.163037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 72/132] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:01 2022] GET /identity/v3/users/fa17abe1a5354190bf763fadfd8bdc9f => generated 275 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:02.163804 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a480ed-463b-4cff-8d8e-a76701663bc3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:02.283259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305104ad-eb92-4639-91df-cac5a710adcf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:02.316380 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:02.325478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58fb1e-9c9c-4498-8dc4-716a8b2f7c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:02.326421 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58fb1e-9c9c-4498-8dc4-716a8b2f7c98 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:02.326710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58fb1e-9c9c-4498-8dc4-716a8b2f7c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:02.327004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58fb1e-9c9c-4498-8dc4-716a8b2f7c98 None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee/users/83882af68d99499bbc81a5c6e9abb2e1/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:02.334110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58fb1e-9c9c-4498-8dc4-716a8b2f7c98 None admin] RBAC: Authorizing `identity:create_grant(project_id=839fd844cfbb442e8202597c69e6bbee, user_id=83882af68d99499bbc81a5c6e9abb2e1, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:02.335596 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58fb1e-9c9c-4498-8dc4-716a8b2f7c98 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:02.367761 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 61/133] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:54:02 2022] PUT /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee/users/83882af68d99499bbc81a5c6e9abb2e1/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:54:02.368692 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58fb1e-9c9c-4498-8dc4-716a8b2f7c98 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:02.413585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a480ed-463b-4cff-8d8e-a76701663bc3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:02.528139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fafdf-526b-4a5d-af0d-3a9a4eaaf19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:02.529414 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fafdf-526b-4a5d-af0d-3a9a4eaaf19f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:02.529939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fafdf-526b-4a5d-af0d-3a9a4eaaf19f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:02.530588 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fafdf-526b-4a5d-af0d-3a9a4eaaf19f None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:02.539241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fafdf-526b-4a5d-af0d-3a9a4eaaf19f None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:02.541176 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fafdf-526b-4a5d-af0d-3a9a4eaaf19f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:02.543741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 73/134] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:02 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:02.552719 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fafdf-526b-4a5d-af0d-3a9a4eaaf19f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:02.631110 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:02.644987 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58fb1e-9c9c-4498-8dc4-716a8b2f7c98 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:02.708497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf439cd-7cb6-4a6f-9618-f21207d75e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:02.709398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf439cd-7cb6-4a6f-9618-f21207d75e0a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:02.709683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf439cd-7cb6-4a6f-9618-f21207d75e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:02.709987 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf439cd-7cb6-4a6f-9618-f21207d75e0a None admin] PATH_INFO: `/v3/projects/a2547a9cf2c4470a8cb242f3fd28c22e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:02.712180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf439cd-7cb6-4a6f-9618-f21207d75e0a None admin] RBAC: Authorizing `identity:get_project(project_id=a2547a9cf2c4470a8cb242f3fd28c22e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:02.713658 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf439cd-7cb6-4a6f-9618-f21207d75e0a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:02.715421 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 62/135] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:02 2022] GET /identity/v3/projects/a2547a9cf2c4470a8cb242f3fd28c22e => generated 312 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:02.721804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf439cd-7cb6-4a6f-9618-f21207d75e0a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:02.774571 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fafdf-526b-4a5d-af0d-3a9a4eaaf19f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:02.851374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2f547-d73d-4813-ada8-2cb6205bd358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:02.852207 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2f547-d73d-4813-ada8-2cb6205bd358 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:02.852489 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2f547-d73d-4813-ada8-2cb6205bd358 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:02.852778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2f547-d73d-4813-ada8-2cb6205bd358 None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee/users/fa17abe1a5354190bf763fadfd8bdc9f/roles/3695c157587346198902d1f6ec05153a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:02.857411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2f547-d73d-4813-ada8-2cb6205bd358 None admin] RBAC: Authorizing `identity:create_grant(project_id=839fd844cfbb442e8202597c69e6bbee, user_id=fa17abe1a5354190bf763fadfd8bdc9f, role_id=3695c157587346198902d1f6ec05153a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:02.858924 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2f547-d73d-4813-ada8-2cb6205bd358 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:02.868666 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:02.882844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 74/136] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:54:02 2022] PUT /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee/users/fa17abe1a5354190bf763fadfd8bdc9f/roles/3695c157587346198902d1f6ec05153a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:54:02.934793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf439cd-7cb6-4a6f-9618-f21207d75e0a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:02.976664 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5b7fd-d0dd-4c1f-975e-ab43e695e4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:02.977588 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5b7fd-d0dd-4c1f-975e-ab43e695e4d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:02.977898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5b7fd-d0dd-4c1f-975e-ab43e695e4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:02.978181 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5b7fd-d0dd-4c1f-975e-ab43e695e4d4 None admin] PATH_INFO: `/v3/projects/a2547a9cf2c4470a8cb242f3fd28c22e/users/fa17abe1a5354190bf763fadfd8bdc9f/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:02.980253 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5b7fd-d0dd-4c1f-975e-ab43e695e4d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2547a9cf2c4470a8cb242f3fd28c22e, user_id=fa17abe1a5354190bf763fadfd8bdc9f, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:02.981737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5b7fd-d0dd-4c1f-975e-ab43e695e4d4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:02.999352 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 63/137] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:54:02 2022] PUT /identity/v3/projects/a2547a9cf2c4470a8cb242f3fd28c22e/users/fa17abe1a5354190bf763fadfd8bdc9f/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:54:03.148074 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b33a2-9d87-4a24-bd30-46013aebaf1e None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:03.148267 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b33a2-9d87-4a24-bd30-46013aebaf1e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:03.148537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b33a2-9d87-4a24-bd30-46013aebaf1e None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:03.150036 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 75/138] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:03.162073 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819b052-df5d-4ed7-8534-e43703980639 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:03.162434 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819b052-df5d-4ed7-8534-e43703980639 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:03.162648 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819b052-df5d-4ed7-8534-e43703980639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:03.181559 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9819b052-df5d-4ed7-8534-e43703980639 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:03.182824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9819b052-df5d-4ed7-8534-e43703980639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:03.261099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 64/139] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:03.286564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b33a2-9d87-4a24-bd30-46013aebaf1e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:03.367765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7804a-a8f7-4302-9045-d148d82b8aef None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:03.368403 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7804a-a8f7-4302-9045-d148d82b8aef None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:03.368898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7804a-a8f7-4302-9045-d148d82b8aef None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:03.370492 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 65/140] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:54:03.375958 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa9c6a-c46f-4cf5-a921-5d4a44fd9c35 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:03.376247 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa9c6a-c46f-4cf5-a921-5d4a44fd9c35 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:03.376637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa9c6a-c46f-4cf5-a921-5d4a44fd9c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:03.393064 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:03.401635 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d2fa9c6a-c46f-4cf5-a921-5d4a44fd9c35 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:03.401833 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b33a2-9d87-4a24-bd30-46013aebaf1e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:03.402928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d2fa9c6a-c46f-4cf5-a921-5d4a44fd9c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:03.446403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bd30a-86d9-4e4b-92a6-9e760df78313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:03.447247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bd30a-86d9-4e4b-92a6-9e760df78313 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:03.447532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bd30a-86d9-4e4b-92a6-9e760df78313 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:03.447809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bd30a-86d9-4e4b-92a6-9e760df78313 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:03.450083 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bd30a-86d9-4e4b-92a6-9e760df78313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:03.451716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bd30a-86d9-4e4b-92a6-9e760df78313 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:03.453663 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 76/141] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:03.460011 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bd30a-86d9-4e4b-92a6-9e760df78313 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:03.472994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:03.501709 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 66/142] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:03.525583 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa9c6a-c46f-4cf5-a921-5d4a44fd9c35 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:03.595443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bd30a-86d9-4e4b-92a6-9e760df78313 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:03.635082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa9c6a-c46f-4cf5-a921-5d4a44fd9c35 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:03.653902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27ebc6-7128-470b-b5eb-f48ffe33a5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:03.653902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27ebc6-7128-470b-b5eb-f48ffe33a5fd None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:03.653902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27ebc6-7128-470b-b5eb-f48ffe33a5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:03.653902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27ebc6-7128-470b-b5eb-f48ffe33a5fd None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:03.654309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27ebc6-7128-470b-b5eb-f48ffe33a5fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:03.654309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27ebc6-7128-470b-b5eb-f48ffe33a5fd None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:03.677630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c75a7-ae70-4c5c-835f-54fd0bcfe84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:03.678680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c75a7-ae70-4c5c-835f-54fd0bcfe84c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:03.679061 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c75a7-ae70-4c5c-835f-54fd0bcfe84c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:03.679519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c75a7-ae70-4c5c-835f-54fd0bcfe84c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:03.696927 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 77/143] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:54:03 2022] POST /identity/v3/users => generated 283 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:54:03.718098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c75a7-ae70-4c5c-835f-54fd0bcfe84c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:03.727282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ca6c75a7-ae70-4c5c-835f-54fd0bcfe84c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:03.727282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:03.727282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:03.727282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:03.727282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:03.727282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:03.727282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:03.727282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:03.727282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:03.727282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:03.727282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:03.727282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:03.727282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:03.727282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:03.727282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:03.727282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:03.728286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:03.728286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:03.728286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:03.728286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:03.728286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:03.728286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:03.728286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:03.728286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:03.728286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:03.728286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:03.728286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:03.728286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:03.728286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:03.728286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:03.728286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:03.728286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:03.729112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:03.729112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:03.729112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:03.729112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:03.729112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:03.729112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:03.729112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:03.729112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:03.729112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:03.729112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:03.729112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:03.729112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:03.729112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 67/144] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:03.736171 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27ebc6-7128-470b-b5eb-f48ffe33a5fd None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:03.787157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:03.867058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50564262-a1dc-4a9f-a55b-cc0c9c00cb66 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:03.867411 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50564262-a1dc-4a9f-a55b-cc0c9c00cb66 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:03.867627 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50564262-a1dc-4a9f-a55b-cc0c9c00cb66 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:03.869369 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 68/145] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:03.875818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d2313-533b-458f-a572-a85d1269bbd8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:03.876109 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d2313-533b-458f-a572-a85d1269bbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:03.876456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d2313-533b-458f-a572-a85d1269bbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:03.905955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27ebc6-7128-470b-b5eb-f48ffe33a5fd None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:03.907236 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3b2d2313-533b-458f-a572-a85d1269bbd8 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:03.908622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3b2d2313-533b-458f-a572-a85d1269bbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:03.950347 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c33b63-832a-4586-bba1-29215f90e441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:03.951025 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c33b63-832a-4586-bba1-29215f90e441 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:03.951313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c33b63-832a-4586-bba1-29215f90e441 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:03.951593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c33b63-832a-4586-bba1-29215f90e441 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:03.952376 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c33b63-832a-4586-bba1-29215f90e441 None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:03.954067 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c33b63-832a-4586-bba1-29215f90e441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:03.957144 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c33b63-832a-4586-bba1-29215f90e441 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:03.975122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 78/146] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:03.980721 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c33b63-832a-4586-bba1-29215f90e441 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:04.014182 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:04.050283 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 69/147] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:04.094892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d2313-533b-458f-a572-a85d1269bbd8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:04.155548 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:04.180606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c33b63-832a-4586-bba1-29215f90e441 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:04.225457 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c2279-1d0d-402b-bd9a-cc47d3b1fd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:04.227472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2279-1d0d-402b-bd9a-cc47d3b1fd0d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:04.227759 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2279-1d0d-402b-bd9a-cc47d3b1fd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:04.228038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2279-1d0d-402b-bd9a-cc47d3b1fd0d None admin] PATH_INFO: `/v3/users/fa17abe1a5354190bf763fadfd8bdc9f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:04.230717 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c2279-1d0d-402b-bd9a-cc47d3b1fd0d None admin] RBAC: Authorizing `identity:get_user(user_id=fa17abe1a5354190bf763fadfd8bdc9f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:04.232221 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c2279-1d0d-402b-bd9a-cc47d3b1fd0d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:04.234119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 79/148] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:03 2022] GET /identity/v3/users/fa17abe1a5354190bf763fadfd8bdc9f => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:04.240878 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d2313-533b-458f-a572-a85d1269bbd8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:04.242830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c2279-1d0d-402b-bd9a-cc47d3b1fd0d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:04.297967 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915756fc-3753-4899-84ac-f68c89768a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:04.298906 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915756fc-3753-4899-84ac-f68c89768a63 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:04.299199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915756fc-3753-4899-84ac-f68c89768a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:04.299484 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915756fc-3753-4899-84ac-f68c89768a63 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:04.326861 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915756fc-3753-4899-84ac-f68c89768a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:04.337845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-915756fc-3753-4899-84ac-f68c89768a63 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:54:04.337845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:04.337845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:04.337845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:04.337845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:04.337845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:04.337845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:04.337845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:04.337845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:04.337845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:04.337845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:04.337845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:04.337845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:04.337845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:04.337845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:04.337845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:04.338755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:04.338755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:04.338755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:04.338755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:04.338755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:04.338755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:04.338755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:04.338755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:04.338755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:04.338755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:04.338755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:04.338755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:04.338755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:04.338755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:04.338755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:04.338755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:04.339945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:04.339945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:04.339945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:04.339945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:04.339945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:04.339945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:04.339945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:04.339945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:04.339945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:04.339945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:04.339945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:54:04.339945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:04.339945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 70/149] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:04.350849 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915756fc-3753-4899-84ac-f68c89768a63 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:04.423315 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c2279-1d0d-402b-bd9a-cc47d3b1fd0d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:04.464715 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57186b92-d043-4442-a31b-0995774baf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:04.465324 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57186b92-d043-4442-a31b-0995774baf87 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:04.465611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57186b92-d043-4442-a31b-0995774baf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:04.465925 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57186b92-d043-4442-a31b-0995774baf87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:04.482175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:04.487113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:04.540427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57186b92-d043-4442-a31b-0995774baf87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:04.541961 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57186b92-d043-4442-a31b-0995774baf87 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:04.662627 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915756fc-3753-4899-84ac-f68c89768a63 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:04.700799 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 80/150] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:04.705846 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57186b92-d043-4442-a31b-0995774baf87 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:04.735492 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8316c-2962-401f-aadb-86ae47405221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:04.736217 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8316c-2962-401f-aadb-86ae47405221 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:04.736499 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8316c-2962-401f-aadb-86ae47405221 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:04.736777 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8316c-2962-401f-aadb-86ae47405221 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:04.737587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8316c-2962-401f-aadb-86ae47405221 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:04.737934 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8316c-2962-401f-aadb-86ae47405221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:04.739354 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8316c-2962-401f-aadb-86ae47405221 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:04.756175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 71/151] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:04.764630 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:04.782199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8316c-2962-401f-aadb-86ae47405221 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:04.827618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57186b92-d043-4442-a31b-0995774baf87 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:04.886059 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d3eb-2e04-4bbf-8831-8828003b4b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:04.887001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d3eb-2e04-4bbf-8831-8828003b4b12 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:04.887245 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d3eb-2e04-4bbf-8831-8828003b4b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:04.887523 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d3eb-2e04-4bbf-8831-8828003b4b12 None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:04.889539 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823d3eb-2e04-4bbf-8831-8828003b4b12 None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:04.891038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823d3eb-2e04-4bbf-8831-8828003b4b12 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:04.893048 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 81/152] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:04 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:04.901211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d3eb-2e04-4bbf-8831-8828003b4b12 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:05.005770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:05.028767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8316c-2962-401f-aadb-86ae47405221 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:05.072815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d3eb-2e04-4bbf-8831-8828003b4b12 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:05.097502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439b4d0-229d-42fd-9c1f-7116a4d9a088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:05.098446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439b4d0-229d-42fd-9c1f-7116a4d9a088 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:05.098733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439b4d0-229d-42fd-9c1f-7116a4d9a088 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:05.099019 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439b4d0-229d-42fd-9c1f-7116a4d9a088 None admin] PATH_INFO: `/v3/users/ee701808355747a580e735ddbb19ef98` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:05.101076 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:05.102521 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439b4d0-229d-42fd-9c1f-7116a4d9a088 None admin] RBAC: Authorizing `identity:get_user(user_id=ee701808355747a580e735ddbb19ef98)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:05.104011 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439b4d0-229d-42fd-9c1f-7116a4d9a088 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:05.106045 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 72/153] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:04 2022] GET /identity/v3/users/ee701808355747a580e735ddbb19ef98 => generated 289 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:05.111485 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439b4d0-229d-42fd-9c1f-7116a4d9a088 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:05.133665 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46baf90-66c4-46c5-a690-1ea04acede5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:05.134983 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46baf90-66c4-46c5-a690-1ea04acede5e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:05.135464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46baf90-66c4-46c5-a690-1ea04acede5e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:05.135932 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46baf90-66c4-46c5-a690-1ea04acede5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:05.136971 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46baf90-66c4-46c5-a690-1ea04acede5e None admin] RBAC: Adding query filter params (role.id=7f252cd3de7047e396a0daf6e7d4d2ee, scope.project.id=839fd844cfbb442e8202597c69e6bbee, user.id=fa17abe1a5354190bf763fadfd8bdc9f) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:05.137480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46baf90-66c4-46c5-a690-1ea04acede5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:05.139401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46baf90-66c4-46c5-a690-1ea04acede5e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:05.149959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 82/154] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:04 2022] GET /identity/v3/role_assignments?user.id=fa17abe1a5354190bf763fadfd8bdc9f&scope.project.id=839fd844cfbb442e8202597c69e6bbee&role.id=7f252cd3de7047e396a0daf6e7d4d2ee => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:05.277308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439b4d0-229d-42fd-9c1f-7116a4d9a088 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:05.322871 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7163e8-4171-4d8d-b6a1-b162b9459522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:05.323775 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7163e8-4171-4d8d-b6a1-b162b9459522 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:05.324061 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7163e8-4171-4d8d-b6a1-b162b9459522 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:05.324392 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7163e8-4171-4d8d-b6a1-b162b9459522 None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:05.325629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7163e8-4171-4d8d-b6a1-b162b9459522 None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:05.327147 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7163e8-4171-4d8d-b6a1-b162b9459522 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:05.329232 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 73/155] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:05 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:05.335627 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46baf90-66c4-46c5-a690-1ea04acede5e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:05.474162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46baf90-66c4-46c5-a690-1ea04acede5e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:05.521325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ef8e7-69da-41da-a877-990422395c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:05.522516 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ef8e7-69da-41da-a877-990422395c0b None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:05.522964 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ef8e7-69da-41da-a877-990422395c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:05.523372 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ef8e7-69da-41da-a877-990422395c0b None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee/users/ee701808355747a580e735ddbb19ef98/roles/f6f2b0e067fd4b899c78b84b53d3922c` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:05.525562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ef8e7-69da-41da-a877-990422395c0b None admin] RBAC: Authorizing `identity:create_grant(project_id=839fd844cfbb442e8202597c69e6bbee, user_id=ee701808355747a580e735ddbb19ef98, role_id=f6f2b0e067fd4b899c78b84b53d3922c)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:05.527256 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ef8e7-69da-41da-a877-990422395c0b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:05.555918 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 83/156] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:54:05 2022] PUT /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee/users/ee701808355747a580e735ddbb19ef98/roles/f6f2b0e067fd4b899c78b84b53d3922c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:54:05.723607 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb33e86-6fa6-46ae-908b-8681b7f84f0e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:05.724005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb33e86-6fa6-46ae-908b-8681b7f84f0e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:05.724308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb33e86-6fa6-46ae-908b-8681b7f84f0e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:05.725661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 74/157] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:05.731677 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549df31-dcd1-43a4-875e-e1d570f87c4b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:05.732251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549df31-dcd1-43a4-875e-e1d570f87c4b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:05.732733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549df31-dcd1-43a4-875e-e1d570f87c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:05.752323 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e549df31-dcd1-43a4-875e-e1d570f87c4b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:05.762669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e549df31-dcd1-43a4-875e-e1d570f87c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:05.830148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:05.875157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 84/158] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:05.928399 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb33e86-6fa6-46ae-908b-8681b7f84f0e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:05.964849 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:06.052584 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb33e86-6fa6-46ae-908b-8681b7f84f0e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:06.091027 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8af2fc-cc64-4d33-977f-9d7a02fd80cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:06.092165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8af2fc-cc64-4d33-977f-9d7a02fd80cc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:06.092706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8af2fc-cc64-4d33-977f-9d7a02fd80cc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:06.093181 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8af2fc-cc64-4d33-977f-9d7a02fd80cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:06.105287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8af2fc-cc64-4d33-977f-9d7a02fd80cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:06.114006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-5a8af2fc-cc64-4d33-977f-9d7a02fd80cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:54:06.114006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:06.114006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:06.114006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:06.114006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:06.114006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:06.114006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:06.114006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:06.114006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:06.114006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:06.114006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:06.114006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:06.114006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:06.114006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:06.114006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:06.114006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:06.114873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:06.114873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:06.114873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:06.114873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:06.114873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:06.114873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:06.114873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:06.114873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:06.114873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:06.114873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:06.114873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:06.114873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:06.114873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:06.114873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:06.114873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:06.114873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:06.115620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:06.115620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:06.115620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:06.115620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:06.115620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:06.115620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:06.115620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:06.115620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:06.115620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:06.115620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:06.115620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:54:06.115620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:06.118109 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 75/159] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:54:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:06.128105 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549df31-dcd1-43a4-875e-e1d570f87c4b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:06.302405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549df31-dcd1-43a4-875e-e1d570f87c4b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:06.355184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a2fe7-da02-4cce-8151-9cfcbdbc74d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:06.355800 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a2fe7-da02-4cce-8151-9cfcbdbc74d9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:06.356086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a2fe7-da02-4cce-8151-9cfcbdbc74d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:06.356362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a2fe7-da02-4cce-8151-9cfcbdbc74d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:06.357137 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a2fe7-da02-4cce-8151-9cfcbdbc74d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:06.357443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a2fe7-da02-4cce-8151-9cfcbdbc74d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:06.358909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a2fe7-da02-4cce-8151-9cfcbdbc74d9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:06.380790 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 85/160] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:06.388044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8af2fc-cc64-4d33-977f-9d7a02fd80cc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:06.529825 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:06.543247 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8af2fc-cc64-4d33-977f-9d7a02fd80cc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:06.589174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f1bb3-64c7-4b7d-b217-c34d8d3e4e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:06.590162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f1bb3-64c7-4b7d-b217-c34d8d3e4e7c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:06.590449 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f1bb3-64c7-4b7d-b217-c34d8d3e4e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:06.590776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f1bb3-64c7-4b7d-b217-c34d8d3e4e7c None admin] PATH_INFO: `/v3/users/83882af68d99499bbc81a5c6e9abb2e1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:06.594570 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f1bb3-64c7-4b7d-b217-c34d8d3e4e7c None admin] RBAC: Authorizing `identity:get_user(user_id=83882af68d99499bbc81a5c6e9abb2e1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:06.596313 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f1bb3-64c7-4b7d-b217-c34d8d3e4e7c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:06.598067 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 76/161] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:06 2022] GET /identity/v3/users/83882af68d99499bbc81a5c6e9abb2e1 => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:06.603771 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a2fe7-da02-4cce-8151-9cfcbdbc74d9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:06.642949 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:06.729524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a2fe7-da02-4cce-8151-9cfcbdbc74d9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:06.794533 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6ca89-2d80-42dd-b0dc-d4a8ed46f6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:06.795219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6ca89-2d80-42dd-b0dc-d4a8ed46f6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:06.795500 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6ca89-2d80-42dd-b0dc-d4a8ed46f6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:06.795772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6ca89-2d80-42dd-b0dc-d4a8ed46f6b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:06.861589 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ae1d9-2a98-47be-9c3b-45c452267875 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:06.861945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ae1d9-2a98-47be-9c3b-45c452267875 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:06.862188 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ae1d9-2a98-47be-9c3b-45c452267875 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:06.863861 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 77/162] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:06.869129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6bdce-ee6e-400d-934b-9c681b3c6794 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:06.869425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6bdce-ee6e-400d-934b-9c681b3c6794 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:06.869704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6bdce-ee6e-400d-934b-9c681b3c6794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:06.894884 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bff6bdce-ee6e-400d-934b-9c681b3c6794 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:06.895783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6ca89-2d80-42dd-b0dc-d4a8ed46f6b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:06.896003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bff6bdce-ee6e-400d-934b-9c681b3c6794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:06.897279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6ca89-2d80-42dd-b0dc-d4a8ed46f6b8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:06.954952 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:07.077170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 78/163] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:07.081101 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 86/164] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:07.090954 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6bdce-ee6e-400d-934b-9c681b3c6794 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:07.143005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6ca89-2d80-42dd-b0dc-d4a8ed46f6b8 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:07.276520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:07.291132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6ca89-2d80-42dd-b0dc-d4a8ed46f6b8 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:07.327863 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6bdce-ee6e-400d-934b-9c681b3c6794 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:07.341372 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:07.350054 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a74d00-414d-4962-b9f1-11999f60e9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:07.350903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a74d00-414d-4962-b9f1-11999f60e9fe None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:07.351186 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a74d00-414d-4962-b9f1-11999f60e9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:07.351463 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a74d00-414d-4962-b9f1-11999f60e9fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:07.368281 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a74d00-414d-4962-b9f1-11999f60e9fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:07.379250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-57a74d00-414d-4962-b9f1-11999f60e9fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:07.379250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:07.379250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:07.379250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:07.379250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:07.379250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:07.379250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:07.379250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:07.379250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:07.379250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:07.379250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:07.379250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:07.379250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:07.379250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:07.379250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:07.379250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:07.380788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:07.380788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:07.380788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:07.380788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:07.380788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:07.380788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:07.380788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:07.380788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:07.380788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:07.380788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:07.380788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:07.380788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:07.380788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:07.380788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:07.380788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:07.380788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:07.381557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:07.381557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:07.381557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:07.381557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:07.381557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:07.381557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:07.381557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:07.381557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:07.381557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:07.381557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:07.381557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:07.381557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:07.381557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 87/165] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:54:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:07.382494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76053c9-022f-4b20-8198-11c930ce2191 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:07.382494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76053c9-022f-4b20-8198-11c930ce2191 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:07.382494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76053c9-022f-4b20-8198-11c930ce2191 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:07.385826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 88/166] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:07.391820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76053c9-022f-4b20-8198-11c930ce2191 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:07.434407 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499c086-2550-4e02-9ca7-7030d9134b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:07.435298 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c086-2550-4e02-9ca7-7030d9134b39 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:07.435575 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c086-2550-4e02-9ca7-7030d9134b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:07.435846 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c086-2550-4e02-9ca7-7030d9134b39 None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:07.437239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499c086-2550-4e02-9ca7-7030d9134b39 None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:07.438736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499c086-2550-4e02-9ca7-7030d9134b39 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:07.440498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 79/167] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:07 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:07.441716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dd3a3-d984-4060-83df-70be9b400cb8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:07.441976 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dd3a3-d984-4060-83df-70be9b400cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:07.442252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dd3a3-d984-4060-83df-70be9b400cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:07.491824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c23dd3a3-d984-4060-83df-70be9b400cb8 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:07.493020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c23dd3a3-d984-4060-83df-70be9b400cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:07.610128 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76053c9-022f-4b20-8198-11c930ce2191 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:07.615731 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 80/168] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:07.616598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dd3a3-d984-4060-83df-70be9b400cb8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:07.681705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8242d-d6fb-405d-adf4-c4392855d1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:07.689814 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8242d-d6fb-405d-adf4-c4392855d1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:07.690372 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8242d-d6fb-405d-adf4-c4392855d1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:07.691115 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8242d-d6fb-405d-adf4-c4392855d1c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:07.693191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8242d-d6fb-405d-adf4-c4392855d1c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:07.693706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8242d-d6fb-405d-adf4-c4392855d1c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:07.695581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8242d-d6fb-405d-adf4-c4392855d1c3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:07.716718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 89/169] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:54:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:07.717917 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8242d-d6fb-405d-adf4-c4392855d1c3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:07.802038 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:07.844102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dd3a3-d984-4060-83df-70be9b400cb8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:07.872546 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:07.922802 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44f91c-3890-42f5-a6bd-0074ade3f10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:07.923684 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44f91c-3890-42f5-a6bd-0074ade3f10d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:07.924031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44f91c-3890-42f5-a6bd-0074ade3f10d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:07.924345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44f91c-3890-42f5-a6bd-0074ade3f10d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:07.926358 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44f91c-3890-42f5-a6bd-0074ade3f10d None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=839fd844cfbb442e8202597c69e6bbee, user.id=83882af68d99499bbc81a5c6e9abb2e1) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:07.926678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44f91c-3890-42f5-a6bd-0074ade3f10d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:07.930941 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44f91c-3890-42f5-a6bd-0074ade3f10d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:07.940901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 81/170] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:07 2022] GET /identity/v3/role_assignments?user.id=83882af68d99499bbc81a5c6e9abb2e1&scope.project.id=839fd844cfbb442e8202597c69e6bbee&role.id=aefba81d87bf47258c17064af7d9a05f => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:07.941756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44f91c-3890-42f5-a6bd-0074ade3f10d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:07.955249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8242d-d6fb-405d-adf4-c4392855d1c3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:08.023835 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61229c8c-cff2-47b1-b04b-782555b5349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:08.024731 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61229c8c-cff2-47b1-b04b-782555b5349a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:08.025023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61229c8c-cff2-47b1-b04b-782555b5349a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:08.025302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61229c8c-cff2-47b1-b04b-782555b5349a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:08.045660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61229c8c-cff2-47b1-b04b-782555b5349a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:08.055618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-61229c8c-cff2-47b1-b04b-782555b5349a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:08.055618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:08.055618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:08.055618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:08.055618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:08.055618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:08.055618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:08.055618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:08.055618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:08.055618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:08.055618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:08.055618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:08.055618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:08.055618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:08.055618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:08.055618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:08.056614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:08.056614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:08.056614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:08.056614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:08.056614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:08.056614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:08.056614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:08.056614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:08.056614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:08.056614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:08.056614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:08.056614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:08.056614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:08.056614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:08.056614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:08.056614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:08.057384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:08.057384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:08.057384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:08.057384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:08.057384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:08.057384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:08.057384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:08.057384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:08.057384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:08.057384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:08.057384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:08.057384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:08.060341 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 90/171] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:08.066607 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61229c8c-cff2-47b1-b04b-782555b5349a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:08.179908 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44f91c-3890-42f5-a6bd-0074ade3f10d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:08.233584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61229c8c-cff2-47b1-b04b-782555b5349a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:08.239620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31ca3d-94bb-4728-b8df-46b9669206e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:08.240722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31ca3d-94bb-4728-b8df-46b9669206e4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:08.241116 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31ca3d-94bb-4728-b8df-46b9669206e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:08.241514 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31ca3d-94bb-4728-b8df-46b9669206e4 None admin] PATH_INFO: `/v3/users/fa17abe1a5354190bf763fadfd8bdc9f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:08.246706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31ca3d-94bb-4728-b8df-46b9669206e4 None admin] RBAC: Authorizing `identity:get_user(user_id=fa17abe1a5354190bf763fadfd8bdc9f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:08.248470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31ca3d-94bb-4728-b8df-46b9669206e4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:08.250704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 82/172] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:07 2022] GET /identity/v3/users/fa17abe1a5354190bf763fadfd8bdc9f => generated 275 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:08.252183 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7d0e9-52a2-4a6c-8c54-abeeeba9cf5d None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:08.252473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7d0e9-52a2-4a6c-8c54-abeeeba9cf5d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:08.252759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7d0e9-52a2-4a6c-8c54-abeeeba9cf5d None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:08.254207 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 83/173] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:08.260321 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:08.260498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7d0e9-52a2-4a6c-8c54-abeeeba9cf5d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:08.281507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:08.291500 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212df43-3abf-4e67-bcf4-10d396bff6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:08.292528 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212df43-3abf-4e67-bcf4-10d396bff6ef None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:08.292954 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212df43-3abf-4e67-bcf4-10d396bff6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:08.293374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212df43-3abf-4e67-bcf4-10d396bff6ef None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:08.294414 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212df43-3abf-4e67-bcf4-10d396bff6ef None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:08.294863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212df43-3abf-4e67-bcf4-10d396bff6ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:08.296533 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212df43-3abf-4e67-bcf4-10d396bff6ef None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:08.317466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 91/174] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:08.319082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d6be9-1ebf-417c-bd86-f8c477b322b2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:08.319513 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d6be9-1ebf-417c-bd86-f8c477b322b2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:08.319926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d6be9-1ebf-417c-bd86-f8c477b322b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:08.353691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1d7d6be9-1ebf-417c-bd86-f8c477b322b2 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:08.355181 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1d7d6be9-1ebf-417c-bd86-f8c477b322b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:08.382995 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7d0e9-52a2-4a6c-8c54-abeeeba9cf5d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:08.422892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535888ca-d579-42c0-b6c0-c8f4ab823c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:08.423918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535888ca-d579-42c0-b6c0-c8f4ab823c71 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:08.424225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535888ca-d579-42c0-b6c0-c8f4ab823c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:08.424480 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535888ca-d579-42c0-b6c0-c8f4ab823c71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:08.509222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535888ca-d579-42c0-b6c0-c8f4ab823c71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:08.510986 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535888ca-d579-42c0-b6c0-c8f4ab823c71 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:08.533062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:08.576051 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 92/175] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:08.577298 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d6be9-1ebf-417c-bd86-f8c477b322b2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:08.637254 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 84/176] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 20:54:08.641345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535888ca-d579-42c0-b6c0-c8f4ab823c71 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:08.753906 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535888ca-d579-42c0-b6c0-c8f4ab823c71 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:08.772386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:08.773904 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d6be9-1ebf-417c-bd86-f8c477b322b2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:08.783130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:08.796608 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e58875-80e8-4fbd-9355-495c1c95abfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:08.797480 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e58875-80e8-4fbd-9355-495c1c95abfa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:08.797768 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e58875-80e8-4fbd-9355-495c1c95abfa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:08.798076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e58875-80e8-4fbd-9355-495c1c95abfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:08.810073 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e58875-80e8-4fbd-9355-495c1c95abfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:08.814513 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2d8b2-e34e-4db3-88c3-a8360d1ec83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:08.815411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2d8b2-e34e-4db3-88c3-a8360d1ec83c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:08.815698 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2d8b2-e34e-4db3-88c3-a8360d1ec83c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:08.815974 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2d8b2-e34e-4db3-88c3-a8360d1ec83c None admin] PATH_INFO: `/v3/users/fa17abe1a5354190bf763fadfd8bdc9f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:08.817191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2d8b2-e34e-4db3-88c3-a8360d1ec83c None admin] RBAC: Authorizing `identity:get_user(user_id=fa17abe1a5354190bf763fadfd8bdc9f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:08.817938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-28e58875-80e8-4fbd-9355-495c1c95abfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:54:08.817938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:08.817938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:08.817938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:08.817938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:08.817938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:08.817938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:08.817938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:08.817938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:08.817938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:08.817938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:08.817938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:08.817938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:08.817938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:08.817938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:08.817938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:08.818770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:08.818770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:08.818770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:08.818770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:08.818770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:08.818770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:08.818770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:08.818770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:08.818770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:08.818770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:08.818770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:08.818770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:08.818770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:08.818770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:08.818770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:08.818770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:08.819557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:08.819557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:08.819557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:08.819557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:08.819557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:08.819557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:08.819557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:08.819557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:08.819557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:08.819557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:08.819557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:54:08.819557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:08.820157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2d8b2-e34e-4db3-88c3-a8360d1ec83c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:08.820225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 85/177] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:54:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:08.826595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e58875-80e8-4fbd-9355-495c1c95abfa None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:08.826688 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 93/178] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:08 2022] GET /identity/v3/users/fa17abe1a5354190bf763fadfd8bdc9f => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:08.826688 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3f09a-5f57-4da2-aae4-50711baeffd9 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:08.826688 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3f09a-5f57-4da2-aae4-50711baeffd9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:08.826688 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3f09a-5f57-4da2-aae4-50711baeffd9 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:08.826688 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 94/179] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:08.826688 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a766-8f59-43d7-85ec-c5196a6f9922 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:08.827043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a766-8f59-43d7-85ec-c5196a6f9922 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:08.827043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a766-8f59-43d7-85ec-c5196a6f9922 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:08.827043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 95/180] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:08.832196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354a766-8f59-43d7-85ec-c5196a6f9922 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:08.938632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e58875-80e8-4fbd-9355-495c1c95abfa None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:08.942188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354a766-8f59-43d7-85ec-c5196a6f9922 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:08.974657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc821034-7173-40a4-858b-8b954ff032ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:08.975573 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc821034-7173-40a4-858b-8b954ff032ec None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:08.975877 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc821034-7173-40a4-858b-8b954ff032ec None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:08.976138 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc821034-7173-40a4-858b-8b954ff032ec None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:08.977355 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc821034-7173-40a4-858b-8b954ff032ec None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:08.978889 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc821034-7173-40a4-858b-8b954ff032ec None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:08.980810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 86/181] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:08 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:08.981808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb38920-9b20-4288-9f4c-cdf4809720be None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:08.982097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb38920-9b20-4288-9f4c-cdf4809720be None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:08.982377 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb38920-9b20-4288-9f4c-cdf4809720be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:08.990215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6b79d-eccd-4b41-a450-25f20f05dbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:08.991177 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6b79d-eccd-4b41-a450-25f20f05dbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:08.991642 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6b79d-eccd-4b41-a450-25f20f05dbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:08.992101 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6b79d-eccd-4b41-a450-25f20f05dbd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:08.993047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6b79d-eccd-4b41-a450-25f20f05dbd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:08.993540 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6b79d-eccd-4b41-a450-25f20f05dbd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:08.995164 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6b79d-eccd-4b41-a450-25f20f05dbd1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:09.003701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0cb38920-9b20-4288-9f4c-cdf4809720be None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:09.004983 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0cb38920-9b20-4288-9f4c-cdf4809720be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:09.005448 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 96/182] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:09.006564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6b79d-eccd-4b41-a450-25f20f05dbd1 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:09.046988 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:09.053729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:09.085575 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 87/183] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:09.087290 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fa9b9-7b6c-495a-aa07-8b3715646005 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:09.087576 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fa9b9-7b6c-495a-aa07-8b3715646005 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:09.087855 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fa9b9-7b6c-495a-aa07-8b3715646005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:09.109394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-811fa9b9-7b6c-495a-aa07-8b3715646005 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:09.110625 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-811fa9b9-7b6c-495a-aa07-8b3715646005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:09.131777 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6b79d-eccd-4b41-a450-25f20f05dbd1 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:09.167050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a44a5-0715-47e2-98f0-251a0a281ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:09.167757 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a44a5-0715-47e2-98f0-251a0a281ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:09.168034 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a44a5-0715-47e2-98f0-251a0a281ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:09.168307 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a44a5-0715-47e2-98f0-251a0a281ef3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:09.183599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 88/184] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:09.184302 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fa9b9-7b6c-495a-aa07-8b3715646005 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:09.262576 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a44a5-0715-47e2-98f0-251a0a281ef3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:09.264681 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a44a5-0715-47e2-98f0-251a0a281ef3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:09.296940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fa9b9-7b6c-495a-aa07-8b3715646005 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:09.300336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:09.302530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:09.343283 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c46ecb-d0e9-4d16-8633-8b88d8e25f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:09.343938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c46ecb-d0e9-4d16-8633-8b88d8e25f4f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:09.344217 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c46ecb-d0e9-4d16-8633-8b88d8e25f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:09.344500 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c46ecb-d0e9-4d16-8633-8b88d8e25f4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:09.345401 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c46ecb-d0e9-4d16-8633-8b88d8e25f4f None admin] RBAC: Adding query filter params (role.id=3695c157587346198902d1f6ec05153a, scope.project.id=839fd844cfbb442e8202597c69e6bbee, user.id=fa17abe1a5354190bf763fadfd8bdc9f) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:09.345738 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c46ecb-d0e9-4d16-8633-8b88d8e25f4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:09.347219 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c46ecb-d0e9-4d16-8633-8b88d8e25f4f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:09.353433 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 89/185] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:09 2022] GET /identity/v3/role_assignments?user.id=fa17abe1a5354190bf763fadfd8bdc9f&scope.project.id=839fd844cfbb442e8202597c69e6bbee&role.id=3695c157587346198902d1f6ec05153a => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:09.358010 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c46ecb-d0e9-4d16-8633-8b88d8e25f4f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:09.396086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 97/186] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:09.397121 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a44a5-0715-47e2-98f0-251a0a281ef3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:09.478694 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c46ecb-d0e9-4d16-8633-8b88d8e25f4f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:09.515685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a44a5-0715-47e2-98f0-251a0a281ef3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:09.529527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07c7f6-829b-4cbb-8cd7-2f0ea26d670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:09.530741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07c7f6-829b-4cbb-8cd7-2f0ea26d670a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:09.531029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07c7f6-829b-4cbb-8cd7-2f0ea26d670a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:09.531304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07c7f6-829b-4cbb-8cd7-2f0ea26d670a None admin] PATH_INFO: `/v3/users/b109d9c2ca8c48b2aa11019318d1f09d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:09.555256 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07c7f6-829b-4cbb-8cd7-2f0ea26d670a None admin] RBAC: Authorizing `identity:get_user(user_id=b109d9c2ca8c48b2aa11019318d1f09d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:09.556080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1e17b-09e5-4df6-8d16-a363360e45d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:09.556828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07c7f6-829b-4cbb-8cd7-2f0ea26d670a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:09.556922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1e17b-09e5-4df6-8d16-a363360e45d7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:09.557174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1e17b-09e5-4df6-8d16-a363360e45d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:09.557446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1e17b-09e5-4df6-8d16-a363360e45d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:09.558924 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1e17b-09e5-4df6-8d16-a363360e45d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:09.559019 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 90/187] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:09 2022] GET /identity/v3/users/b109d9c2ca8c48b2aa11019318d1f09d => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:09.559884 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07c7f6-829b-4cbb-8cd7-2f0ea26d670a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:09.560144 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1e17b-09e5-4df6-8d16-a363360e45d7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:09.561942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 98/188] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:09.563391 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa2032-be18-43d0-ab7b-d8ca9f8c77e3 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:09.564863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa2032-be18-43d0-ab7b-d8ca9f8c77e3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:09.565165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa2032-be18-43d0-ab7b-d8ca9f8c77e3 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:09.566642 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 99/189] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:09.567220 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa2032-be18-43d0-ab7b-d8ca9f8c77e3 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:09.572440 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:09.593874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:09.677033 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07c7f6-829b-4cbb-8cd7-2f0ea26d670a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:09.680182 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa2032-be18-43d0-ab7b-d8ca9f8c77e3 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:09.711582 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c5e9d-6e10-45bc-847c-e8a0af7dec9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:09.712407 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c5e9d-6e10-45bc-847c-e8a0af7dec9e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:09.712691 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c5e9d-6e10-45bc-847c-e8a0af7dec9e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:09.712962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c5e9d-6e10-45bc-847c-e8a0af7dec9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:09.713494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee9cee-8288-4bfc-b61d-e9b68c4e3f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:09.714411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee9cee-8288-4bfc-b61d-e9b68c4e3f34 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:09.714857 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee9cee-8288-4bfc-b61d-e9b68c4e3f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:09.715140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee9cee-8288-4bfc-b61d-e9b68c4e3f34 None admin] PATH_INFO: `/v3/projects/a2547a9cf2c4470a8cb242f3fd28c22e` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:09.716633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee9cee-8288-4bfc-b61d-e9b68c4e3f34 None admin] RBAC: Authorizing `identity:get_project(project_id=a2547a9cf2c4470a8cb242f3fd28c22e)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:09.718147 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee9cee-8288-4bfc-b61d-e9b68c4e3f34 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:09.719874 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 100/190] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:09 2022] GET /identity/v3/projects/a2547a9cf2c4470a8cb242f3fd28c22e => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:09.720922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee9cee-8288-4bfc-b61d-e9b68c4e3f34 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:09.728770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c5e9d-6e10-45bc-847c-e8a0af7dec9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:09.737541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3b2c5e9d-6e10-45bc-847c-e8a0af7dec9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:09.737541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:09.737541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:09.737541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:09.737541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:09.737541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:09.737541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:09.737541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:09.737541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:09.737541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:09.737541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:09.737541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:09.737541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:09.737541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:09.737541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:09.737541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:09.738683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:09.738683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:09.738683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:09.738683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:09.738683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:09.738683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:09.738683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:09.738683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:09.738683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:09.738683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:09.738683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:09.738683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:09.738683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:09.738683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:09.738683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:09.738683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:09.739478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:09.739478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:09.739478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:09.739478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:09.739478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:09.739478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:09.739478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:09.739478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:09.739478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:09.739478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:09.739478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:09.739478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:09.739478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 91/191] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:54:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:09.740105 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c5e9d-6e10-45bc-847c-e8a0af7dec9e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:09.799088 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:09.830449 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee9cee-8288-4bfc-b61d-e9b68c4e3f34 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:09.830619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:09.846147 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c5e9d-6e10-45bc-847c-e8a0af7dec9e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:09.864691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253bfa9-42ff-41aa-9faf-81e2f7e07b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:09.865353 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253bfa9-42ff-41aa-9faf-81e2f7e07b46 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:09.865633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253bfa9-42ff-41aa-9faf-81e2f7e07b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:09.865946 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253bfa9-42ff-41aa-9faf-81e2f7e07b46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:09.879935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351070db-9c8a-4f71-a871-5412c8b4f4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:09.880611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351070db-9c8a-4f71-a871-5412c8b4f4f2 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:09.880890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351070db-9c8a-4f71-a871-5412c8b4f4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:09.881161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351070db-9c8a-4f71-a871-5412c8b4f4f2 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:09.881906 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351070db-9c8a-4f71-a871-5412c8b4f4f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:09.883373 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351070db-9c8a-4f71-a871-5412c8b4f4f2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:09.903445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 92/192] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:54:09 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:54:09.904718 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486ecff-a2c2-44ed-a9c1-5087f7019b8d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:09.905010 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486ecff-a2c2-44ed-a9c1-5087f7019b8d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:09.905309 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486ecff-a2c2-44ed-a9c1-5087f7019b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:09.926670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d486ecff-a2c2-44ed-a9c1-5087f7019b8d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:09.927893 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d486ecff-a2c2-44ed-a9c1-5087f7019b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:09.947154 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253bfa9-42ff-41aa-9faf-81e2f7e07b46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:09.948684 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253bfa9-42ff-41aa-9faf-81e2f7e07b46 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:10.006848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 93/193] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:10.007612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486ecff-a2c2-44ed-a9c1-5087f7019b8d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:10.038069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:10.074753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 101/194] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:10.075639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253bfa9-42ff-41aa-9faf-81e2f7e07b46 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:10.097059 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:10.135536 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486ecff-a2c2-44ed-a9c1-5087f7019b8d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:10.176874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a310c2-8d01-4626-98ef-f316b31f8fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:10.177245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a310c2-8d01-4626-98ef-f316b31f8fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:10.177610 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a310c2-8d01-4626-98ef-f316b31f8fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:10.177823 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a310c2-8d01-4626-98ef-f316b31f8fe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:10.179370 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a310c2-8d01-4626-98ef-f316b31f8fe7 None admin] RBAC: Adding query filter params (role.id=7f252cd3de7047e396a0daf6e7d4d2ee, scope.project.id=a2547a9cf2c4470a8cb242f3fd28c22e, user.id=fa17abe1a5354190bf763fadfd8bdc9f) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:10.179370 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a310c2-8d01-4626-98ef-f316b31f8fe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:10.180873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a310c2-8d01-4626-98ef-f316b31f8fe7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:10.187270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 94/195] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:10 2022] GET /identity/v3/role_assignments?user.id=fa17abe1a5354190bf763fadfd8bdc9f&scope.project.id=a2547a9cf2c4470a8cb242f3fd28c22e&role.id=7f252cd3de7047e396a0daf6e7d4d2ee => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:10.188014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a310c2-8d01-4626-98ef-f316b31f8fe7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:10.208840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253bfa9-42ff-41aa-9faf-81e2f7e07b46 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:10.258744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743d600-865d-4911-8528-110cf03f7dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:10.259447 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743d600-865d-4911-8528-110cf03f7dab None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:10.259732 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743d600-865d-4911-8528-110cf03f7dab None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:10.260047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743d600-865d-4911-8528-110cf03f7dab None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:10.260779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743d600-865d-4911-8528-110cf03f7dab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:10.261092 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743d600-865d-4911-8528-110cf03f7dab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:10.262767 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743d600-865d-4911-8528-110cf03f7dab None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:10.273887 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 102/196] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:54:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:10.274797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743d600-865d-4911-8528-110cf03f7dab None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:10.316859 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a310c2-8d01-4626-98ef-f316b31f8fe7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:10.317589 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:10.367773 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30241d14-ad6c-479b-ad10-e81300121cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:10.368611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30241d14-ad6c-479b-ad10-e81300121cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:10.368929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30241d14-ad6c-479b-ad10-e81300121cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:10.369270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30241d14-ad6c-479b-ad10-e81300121cc7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:10.372425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:10.383414 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30241d14-ad6c-479b-ad10-e81300121cc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:10.391776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-30241d14-ad6c-479b-ad10-e81300121cc7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:54:10.391776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:10.391776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:10.391776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:10.391776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:10.391776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:10.391776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:10.391776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:10.391776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:10.391776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:10.391776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:10.391776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:10.391776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:10.391776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:10.391776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:10.391776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:10.393671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:10.393671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:10.393671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:10.393671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:10.393671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:10.393671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:10.393671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:10.393671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:10.393671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:10.393671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:10.393671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:10.393671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:10.393671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:10.393671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:10.393671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:10.393671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:10.394470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:10.394470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:10.394470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:10.394470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:10.394470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:10.394470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:10.394470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:10.394470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:10.394470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:10.394470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:10.394470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:54:10.394470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:10.394470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 95/197] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:10.394470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30241d14-ad6c-479b-ad10-e81300121cc7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:10.431712 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743d600-865d-4911-8528-110cf03f7dab None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:10.486640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46250984-f6fe-44d6-8497-a3a17550be7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:10.488016 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46250984-f6fe-44d6-8497-a3a17550be7e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:10.488510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46250984-f6fe-44d6-8497-a3a17550be7e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:10.488983 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46250984-f6fe-44d6-8497-a3a17550be7e None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:10.490462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46250984-f6fe-44d6-8497-a3a17550be7e None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:10.492328 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46250984-f6fe-44d6-8497-a3a17550be7e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:10.494414 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 103/198] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:10 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:10.495450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46250984-f6fe-44d6-8497-a3a17550be7e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:10.545122 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30241d14-ad6c-479b-ad10-e81300121cc7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:10.590710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae2de1-7ad4-41e6-961a-773434b4e102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:10.591968 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae2de1-7ad4-41e6-961a-773434b4e102 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:10.592444 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae2de1-7ad4-41e6-961a-773434b4e102 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:10.592938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae2de1-7ad4-41e6-961a-773434b4e102 None admin] PATH_INFO: `/v3/users/b109d9c2ca8c48b2aa11019318d1f09d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:10.595543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae2de1-7ad4-41e6-961a-773434b4e102 None admin] RBAC: Authorizing `identity:get_user(user_id=b109d9c2ca8c48b2aa11019318d1f09d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:10.598510 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae2de1-7ad4-41e6-961a-773434b4e102 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:10.600472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 96/199] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:10 2022] GET /identity/v3/users/b109d9c2ca8c48b2aa11019318d1f09d => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:10.601440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae2de1-7ad4-41e6-961a-773434b4e102 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:10.634103 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46250984-f6fe-44d6-8497-a3a17550be7e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:10.635655 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:10.678489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:10.684584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfb46d-baba-476e-b342-9538cb518cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:10.685279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfb46d-baba-476e-b342-9538cb518cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:10.685568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfb46d-baba-476e-b342-9538cb518cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:10.685871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfb46d-baba-476e-b342-9538cb518cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:10.686640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfb46d-baba-476e-b342-9538cb518cb0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:10.686960 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfb46d-baba-476e-b342-9538cb518cb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:10.689086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfb46d-baba-476e-b342-9538cb518cb0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:10.698820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 104/200] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:10.699883 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfb46d-baba-476e-b342-9538cb518cb0 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:10.723364 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae2de1-7ad4-41e6-961a-773434b4e102 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:10.760774 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfe902-82b4-4174-ac61-2cf37a88250f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:10.761761 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfe902-82b4-4174-ac61-2cf37a88250f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:10.762234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfe902-82b4-4174-ac61-2cf37a88250f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:10.763287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfe902-82b4-4174-ac61-2cf37a88250f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:10.764297 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfe902-82b4-4174-ac61-2cf37a88250f None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef, user.id=b109d9c2ca8c48b2aa11019318d1f09d) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:10.764743 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfe902-82b4-4174-ac61-2cf37a88250f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:10.766507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfe902-82b4-4174-ac61-2cf37a88250f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:10.775092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 97/201] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:10 2022] GET /identity/v3/role_assignments?user.id=b109d9c2ca8c48b2aa11019318d1f09d&scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef&role.id=aefba81d87bf47258c17064af7d9a05f => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:10.776713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfe902-82b4-4174-ac61-2cf37a88250f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:10.872065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfb46d-baba-476e-b342-9538cb518cb0 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:10.902543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfe902-82b4-4174-ac61-2cf37a88250f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:10.940978 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325267d-e76d-4caf-84c2-40b81dc66025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:10.942264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325267d-e76d-4caf-84c2-40b81dc66025 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:10.942784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325267d-e76d-4caf-84c2-40b81dc66025 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:10.943276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325267d-e76d-4caf-84c2-40b81dc66025 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:10.979197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:10.984397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:10.997622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf304817-5487-4b84-bb68-19059c08cd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:10.998600 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf304817-5487-4b84-bb68-19059c08cd3f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:10.998883 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf304817-5487-4b84-bb68-19059c08cd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:10.999154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf304817-5487-4b84-bb68-19059c08cd3f None admin] PATH_INFO: `/v3/users/ee701808355747a580e735ddbb19ef98` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:11.000580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf304817-5487-4b84-bb68-19059c08cd3f None admin] RBAC: Authorizing `identity:get_user(user_id=ee701808355747a580e735ddbb19ef98)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:11.002981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf304817-5487-4b84-bb68-19059c08cd3f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:11.011198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 98/202] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:10 2022] GET /identity/v3/users/ee701808355747a580e735ddbb19ef98 => generated 289 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:11.016683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf304817-5487-4b84-bb68-19059c08cd3f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:11.032931 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325267d-e76d-4caf-84c2-40b81dc66025 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:11.034912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325267d-e76d-4caf-84c2-40b81dc66025 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:11.182771 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf304817-5487-4b84-bb68-19059c08cd3f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:11.196016 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 105/203] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:11.202808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325267d-e76d-4caf-84c2-40b81dc66025 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:11.242101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072712e-d167-4600-9c73-728dcf28f7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:11.242779 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072712e-d167-4600-9c73-728dcf28f7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:11.243050 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072712e-d167-4600-9c73-728dcf28f7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:11.243317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072712e-d167-4600-9c73-728dcf28f7e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:11.333257 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:11.346447 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072712e-d167-4600-9c73-728dcf28f7e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:11.347958 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072712e-d167-4600-9c73-728dcf28f7e8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:11.350244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:11.446962 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325267d-e76d-4caf-84c2-40b81dc66025 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:11.498476 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86043119-847c-4cf3-bb00-6af89fd8fa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:11.499370 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86043119-847c-4cf3-bb00-6af89fd8fa4f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:11.499650 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86043119-847c-4cf3-bb00-6af89fd8fa4f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:11.499924 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86043119-847c-4cf3-bb00-6af89fd8fa4f None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:11.505679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86043119-847c-4cf3-bb00-6af89fd8fa4f None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:11.507687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86043119-847c-4cf3-bb00-6af89fd8fa4f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:11.509495 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 106/204] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:11 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:11.519981 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86043119-847c-4cf3-bb00-6af89fd8fa4f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:11.523264 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 99/205] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 20:54:11.533060 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072712e-d167-4600-9c73-728dcf28f7e8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:11.682110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072712e-d167-4600-9c73-728dcf28f7e8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:11.706287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:11.723135 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b79278-7696-4233-a01d-23311734688a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:11.724055 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b79278-7696-4233-a01d-23311734688a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:11.724314 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b79278-7696-4233-a01d-23311734688a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:11.724652 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b79278-7696-4233-a01d-23311734688a None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:11.728115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b79278-7696-4233-a01d-23311734688a None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:11.731315 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b79278-7696-4233-a01d-23311734688a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:11.733253 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 100/206] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:11 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:11.733549 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86043119-847c-4cf3-bb00-6af89fd8fa4f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:11.742394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b79278-7696-4233-a01d-23311734688a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:11.831469 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:11.851867 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b79278-7696-4233-a01d-23311734688a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:11.858492 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9db745-3d71-45d3-8422-42c7809baf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:11.859189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9db745-3d71-45d3-8422-42c7809baf17 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:11.859478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9db745-3d71-45d3-8422-42c7809baf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:11.859759 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9db745-3d71-45d3-8422-42c7809baf17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:11.860671 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9db745-3d71-45d3-8422-42c7809baf17 None admin] RBAC: Adding query filter params (role.id=3695c157587346198902d1f6ec05153a, scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef, user.id=b109d9c2ca8c48b2aa11019318d1f09d) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:11.861037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9db745-3d71-45d3-8422-42c7809baf17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:11.862537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9db745-3d71-45d3-8422-42c7809baf17 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:11.876550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 107/207] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:11 2022] GET /identity/v3/role_assignments?user.id=b109d9c2ca8c48b2aa11019318d1f09d&scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef&role.id=3695c157587346198902d1f6ec05153a => generated 259 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:11.897609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e67ec0-cc2b-402d-b279-fa093ab95e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:11.898322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e67ec0-cc2b-402d-b279-fa093ab95e5a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:11.898603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e67ec0-cc2b-402d-b279-fa093ab95e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:11.898877 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e67ec0-cc2b-402d-b279-fa093ab95e5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:11.899787 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e67ec0-cc2b-402d-b279-fa093ab95e5a None admin] RBAC: Adding query filter params (role.id=f6f2b0e067fd4b899c78b84b53d3922c, scope.project.id=839fd844cfbb442e8202597c69e6bbee, user.id=ee701808355747a580e735ddbb19ef98) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:11.900101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e67ec0-cc2b-402d-b279-fa093ab95e5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:11.901642 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e67ec0-cc2b-402d-b279-fa093ab95e5a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:11.908491 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 101/208] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:11 2022] GET /identity/v3/role_assignments?user.id=ee701808355747a580e735ddbb19ef98&scope.project.id=839fd844cfbb442e8202597c69e6bbee&role.id=f6f2b0e067fd4b899c78b84b53d3922c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:12.597937 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477edf7-cff2-4b92-8acc-a7103df29e6f None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:12.598965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477edf7-cff2-4b92-8acc-a7103df29e6f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:12.599455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477edf7-cff2-4b92-8acc-a7103df29e6f None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:12.601061 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 108/209] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:12.602335 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92447fc6-334e-43fb-a7d4-fa68a4caaba7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:12.602738 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92447fc6-334e-43fb-a7d4-fa68a4caaba7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:12.602914 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92447fc6-334e-43fb-a7d4-fa68a4caaba7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:12.604386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 102/210] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:12.606216 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412ee13-1ea0-4105-b08e-083885078dae None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:12.606794 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412ee13-1ea0-4105-b08e-083885078dae None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:12.607278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412ee13-1ea0-4105-b08e-083885078dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:12.615063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82aa48-821e-466d-996f-3e219235771f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:12.615344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82aa48-821e-466d-996f-3e219235771f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:12.615939 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82aa48-821e-466d-996f-3e219235771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:12.629390 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b412ee13-1ea0-4105-b08e-083885078dae None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:12.630624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b412ee13-1ea0-4105-b08e-083885078dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:12.639457 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ec82aa48-821e-466d-996f-3e219235771f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:12.639457 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ec82aa48-821e-466d-996f-3e219235771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:12.669043 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:12.717352 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 109/211] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:12.733760 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 103/212] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:12.748750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412ee13-1ea0-4105-b08e-083885078dae None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:12.757483 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82aa48-821e-466d-996f-3e219235771f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:12.855538 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412ee13-1ea0-4105-b08e-083885078dae None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:12.864280 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82aa48-821e-466d-996f-3e219235771f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:12.883147 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:12.893017 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab66f44-eb48-4e8a-84c5-6b4a68380290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:12.894290 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab66f44-eb48-4e8a-84c5-6b4a68380290 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:12.894641 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab66f44-eb48-4e8a-84c5-6b4a68380290 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:12.895075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab66f44-eb48-4e8a-84c5-6b4a68380290 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:12.904283 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c56e0e-fcb8-46a5-b4d2-abb1b71e1d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:12.905104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c56e0e-fcb8-46a5-b4d2-abb1b71e1d25 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:12.905390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c56e0e-fcb8-46a5-b4d2-abb1b71e1d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:12.905669 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c56e0e-fcb8-46a5-b4d2-abb1b71e1d25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:12.906876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab66f44-eb48-4e8a-84c5-6b4a68380290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:12.907006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c56e0e-fcb8-46a5-b4d2-abb1b71e1d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:12.908556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c56e0e-fcb8-46a5-b4d2-abb1b71e1d25 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:12.910240 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 104/213] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:12.915415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-8ab66f44-eb48-4e8a-84c5-6b4a68380290 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:12.915415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:12.915415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:12.915415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:12.915415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:12.915415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:12.915415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:12.915415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:12.915415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:12.915415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:12.915415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:12.915415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:12.915415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:12.915415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:12.915415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:12.915415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:12.916456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:12.916456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:12.916456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:12.916456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:12.916456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:12.916456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:12.916456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:12.916456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:12.916456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:12.916456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:12.916456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:12.916456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:12.916456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:12.916456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:12.916456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:12.916456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:12.917419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:12.917419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:12.917419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:12.917419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:12.917419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:12.917419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:12.917419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:12.917419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:12.917419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:12.917419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:12.917419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:12.917419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:12.918184 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c56e0e-fcb8-46a5-b4d2-abb1b71e1d25 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:12.918424 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 110/214] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:12.930816 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab66f44-eb48-4e8a-84c5-6b4a68380290 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:12.945894 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:13.025443 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c56e0e-fcb8-46a5-b4d2-abb1b71e1d25 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:13.040206 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab66f44-eb48-4e8a-84c5-6b4a68380290 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:13.062367 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32356ad5-d780-4e3e-bd04-94200a3ffb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:13.063112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32356ad5-d780-4e3e-bd04-94200a3ffb91 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:13.063401 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32356ad5-d780-4e3e-bd04-94200a3ffb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:13.063679 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32356ad5-d780-4e3e-bd04-94200a3ffb91 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:13.064494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32356ad5-d780-4e3e-bd04-94200a3ffb91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:13.066078 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32356ad5-d780-4e3e-bd04-94200a3ffb91 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:13.078833 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89322c-4d01-4e1e-bdfa-da8e04f4b3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:13.079830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89322c-4d01-4e1e-bdfa-da8e04f4b3bf None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:13.080156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89322c-4d01-4e1e-bdfa-da8e04f4b3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:13.080573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89322c-4d01-4e1e-bdfa-da8e04f4b3bf None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:13.082590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89322c-4d01-4e1e-bdfa-da8e04f4b3bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:13.082590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89322c-4d01-4e1e-bdfa-da8e04f4b3bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:13.083148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89322c-4d01-4e1e-bdfa-da8e04f4b3bf None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:13.095816 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 105/215] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:54:12 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:54:13.101059 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 111/216] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:13.102587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32356ad5-d780-4e3e-bd04-94200a3ffb91 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:13.201820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:13.228767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32356ad5-d780-4e3e-bd04-94200a3ffb91 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:13.268193 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99ff24-c56e-48a0-b6bc-9abc012eb541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:13.269476 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99ff24-c56e-48a0-b6bc-9abc012eb541 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:13.270010 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99ff24-c56e-48a0-b6bc-9abc012eb541 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:13.270470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99ff24-c56e-48a0-b6bc-9abc012eb541 None admin] PATH_INFO: `/v3/users/45f3cd76c02243699ca4aeb7a9aab17e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:13.287111 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99ff24-c56e-48a0-b6bc-9abc012eb541 None admin] RBAC: Authorizing `identity:get_user(user_id=45f3cd76c02243699ca4aeb7a9aab17e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:13.288053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798f045-6299-428f-8624-d6cda69f0288 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:13.288343 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798f045-6299-428f-8624-d6cda69f0288 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:13.288621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798f045-6299-428f-8624-d6cda69f0288 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:13.289586 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99ff24-c56e-48a0-b6bc-9abc012eb541 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:13.290348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 112/217] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:54:13.291799 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 106/218] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:13 2022] GET /identity/v3/users/45f3cd76c02243699ca4aeb7a9aab17e => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:13.295716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926b224-f18a-411c-86ad-1505ed38e641 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:13.295996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926b224-f18a-411c-86ad-1505ed38e641 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:13.296274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926b224-f18a-411c-86ad-1505ed38e641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:13.302845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99ff24-c56e-48a0-b6bc-9abc012eb541 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:13.317897 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b926b224-f18a-411c-86ad-1505ed38e641 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:13.318474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b926b224-f18a-411c-86ad-1505ed38e641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:13.384049 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:13.414468 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 113/219] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:13.434369 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99ff24-c56e-48a0-b6bc-9abc012eb541 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:13.437592 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926b224-f18a-411c-86ad-1505ed38e641 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:13.478566 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffd640-b165-4919-9a22-cbc8e9fbb06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:13.479148 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffd640-b165-4919-9a22-cbc8e9fbb06c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:13.479438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffd640-b165-4919-9a22-cbc8e9fbb06c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:13.479717 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffd640-b165-4919-9a22-cbc8e9fbb06c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:13.493207 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:13.563739 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffd640-b165-4919-9a22-cbc8e9fbb06c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:13.565175 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926b224-f18a-411c-86ad-1505ed38e641 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:13.565385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffd640-b165-4919-9a22-cbc8e9fbb06c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:13.609325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bbd7d-d788-4eab-a49d-15de32688882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:13.611684 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bbd7d-d788-4eab-a49d-15de32688882 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:13.612225 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bbd7d-d788-4eab-a49d-15de32688882 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:13.613190 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bbd7d-d788-4eab-a49d-15de32688882 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:13.627789 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bbd7d-d788-4eab-a49d-15de32688882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:13.638871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-791bbd7d-d788-4eab-a49d-15de32688882 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:54:13.638871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:13.638871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:13.638871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:13.638871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:13.638871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:13.638871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:13.638871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:13.638871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:13.638871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:13.638871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:13.638871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:13.638871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:13.638871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:13.638871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:13.638871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:13.639753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:13.639753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:13.639753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:13.639753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:13.639753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:13.639753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:13.639753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:13.639753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:13.639753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:13.639753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:13.639753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:13.639753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:13.639753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:13.639753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:13.639753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:13.639753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:13.640527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:13.640527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:13.640527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:13.640527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:13.640527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:13.640527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:13.640527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:13.640527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:13.640527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:13.640527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:13.640527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:54:13.640527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:13.644178 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 114/220] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:54:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:13.649991 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bbd7d-d788-4eab-a49d-15de32688882 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:13.694722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 107/221] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:13.701379 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffd640-b165-4919-9a22-cbc8e9fbb06c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:13.723268 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:13.787834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:13.856638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffd640-b165-4919-9a22-cbc8e9fbb06c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:13.856831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bbd7d-d788-4eab-a49d-15de32688882 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:13.897738 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c641f-ef73-43f7-8a7d-cc301463c0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:13.898656 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c641f-ef73-43f7-8a7d-cc301463c0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:13.898939 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c641f-ef73-43f7-8a7d-cc301463c0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:13.899214 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c641f-ef73-43f7-8a7d-cc301463c0f4 None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:13.900414 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c641f-ef73-43f7-8a7d-cc301463c0f4 None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:13.901934 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c641f-ef73-43f7-8a7d-cc301463c0f4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:13.910356 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 108/222] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:13 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:13.911696 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c641f-ef73-43f7-8a7d-cc301463c0f4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:13.975191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b4b12-21d8-4da4-a297-62235b79092b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:13.975896 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b4b12-21d8-4da4-a297-62235b79092b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:13.976177 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b4b12-21d8-4da4-a297-62235b79092b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:13.976453 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b4b12-21d8-4da4-a297-62235b79092b None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:13.977215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b4b12-21d8-4da4-a297-62235b79092b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:13.977518 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b4b12-21d8-4da4-a297-62235b79092b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:13.978966 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b4b12-21d8-4da4-a297-62235b79092b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:14.004625 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 115/223] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:14.012860 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b4b12-21d8-4da4-a297-62235b79092b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:14.112647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c641f-ef73-43f7-8a7d-cc301463c0f4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:14.134356 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:14.136485 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:14.139156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b4b12-21d8-4da4-a297-62235b79092b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:14.186847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4e063-c3bb-4540-a1a6-44eb130331d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:14.187917 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4e063-c3bb-4540-a1a6-44eb130331d0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:14.188208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4e063-c3bb-4540-a1a6-44eb130331d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:14.188478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4e063-c3bb-4540-a1a6-44eb130331d0 None admin] PATH_INFO: `/v3/users/b109d9c2ca8c48b2aa11019318d1f09d` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:14.190172 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4e063-c3bb-4540-a1a6-44eb130331d0 None admin] RBAC: Authorizing `identity:get_user(user_id=b109d9c2ca8c48b2aa11019318d1f09d)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:14.192002 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4e063-c3bb-4540-a1a6-44eb130331d0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:14.193784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 116/224] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:14 2022] GET /identity/v3/users/b109d9c2ca8c48b2aa11019318d1f09d => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:14.199621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4e063-c3bb-4540-a1a6-44eb130331d0 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:14.217433 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff546b-f127-4227-94dd-a1bc6fef3387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:14.218198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff546b-f127-4227-94dd-a1bc6fef3387 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:14.218481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff546b-f127-4227-94dd-a1bc6fef3387 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:14.218757 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff546b-f127-4227-94dd-a1bc6fef3387 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:14.219664 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff546b-f127-4227-94dd-a1bc6fef3387 None admin] RBAC: Adding query filter params (role.id=7f252cd3de7047e396a0daf6e7d4d2ee, scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef, user.id=45f3cd76c02243699ca4aeb7a9aab17e) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:14.220049 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff546b-f127-4227-94dd-a1bc6fef3387 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:14.221518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff546b-f127-4227-94dd-a1bc6fef3387 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:14.237371 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 109/225] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:13 2022] GET /identity/v3/role_assignments?user.id=45f3cd76c02243699ca4aeb7a9aab17e&scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef&role.id=7f252cd3de7047e396a0daf6e7d4d2ee => generated 259 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:14.363361 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4e063-c3bb-4540-a1a6-44eb130331d0 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:14.418077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa05d8-2d2c-4a06-9555-5b433806170b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:14.418976 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa05d8-2d2c-4a06-9555-5b433806170b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:14.419262 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa05d8-2d2c-4a06-9555-5b433806170b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:14.419536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa05d8-2d2c-4a06-9555-5b433806170b None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:14.423561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa05d8-2d2c-4a06-9555-5b433806170b None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:14.425668 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa05d8-2d2c-4a06-9555-5b433806170b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:14.427624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 117/226] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:14 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:14.442132 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff546b-f127-4227-94dd-a1bc6fef3387 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:14.505512 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b8b0a-036f-4c51-91b1-b21a75d8fbc0 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:14.506013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b8b0a-036f-4c51-91b1-b21a75d8fbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:14.506864 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b8b0a-036f-4c51-91b1-b21a75d8fbc0 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:14.508779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 118/227] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:14.515329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2501cd-6718-47a3-a3ef-8ac6379b7785 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:14.515733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2501cd-6718-47a3-a3ef-8ac6379b7785 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:14.516016 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2501cd-6718-47a3-a3ef-8ac6379b7785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:14.538841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0e2501cd-6718-47a3-a3ef-8ac6379b7785 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:14.540905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0e2501cd-6718-47a3-a3ef-8ac6379b7785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:14.620093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:14.639683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff546b-f127-4227-94dd-a1bc6fef3387 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:14.681918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531fec4-f265-4c77-97f2-512fe3ef6cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:14.682842 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531fec4-f265-4c77-97f2-512fe3ef6cca None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:14.683123 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531fec4-f265-4c77-97f2-512fe3ef6cca None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:14.683398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531fec4-f265-4c77-97f2-512fe3ef6cca None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef/users/b109d9c2ca8c48b2aa11019318d1f09d/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:14.685484 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531fec4-f265-4c77-97f2-512fe3ef6cca None admin] RBAC: Authorizing `identity:create_grant(project_id=bae39b4f40ce46c7af4ffe6265f259ef, user_id=b109d9c2ca8c48b2aa11019318d1f09d, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:14.687187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531fec4-f265-4c77-97f2-512fe3ef6cca None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:14.718833 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 119/228] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:14.719291 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 110/229] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:54:14 2022] PUT /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef/users/b109d9c2ca8c48b2aa11019318d1f09d/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:54:14.743853 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2501cd-6718-47a3-a3ef-8ac6379b7785 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:14.877725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2501cd-6718-47a3-a3ef-8ac6379b7785 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:14.918983 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594596b-6351-4317-8a5e-481717a7cfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:14.919845 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594596b-6351-4317-8a5e-481717a7cfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:14.920129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594596b-6351-4317-8a5e-481717a7cfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:14.920406 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594596b-6351-4317-8a5e-481717a7cfd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:14.933146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594596b-6351-4317-8a5e-481717a7cfd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:14.942348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-5594596b-6351-4317-8a5e-481717a7cfd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:14.942348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:14.942348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:14.942348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:14.942348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:14.942348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:14.942348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:14.942348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:14.942348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:14.942348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:14.942348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:14.942348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:14.942348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:14.942348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:14.942348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:14.942348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:14.943260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:14.943260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:14.943260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:14.943260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:14.943260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:14.943260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:14.943260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:14.943260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:14.943260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:14.943260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:14.943260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:14.943260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:14.943260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:14.943260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:14.943260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:14.943260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:14.945401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:14.945401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:14.945401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:14.945401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:14.945401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:14.945401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:14.945401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:14.945401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:14.945401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:14.945401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:14.945401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:14.945401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:14.945401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 120/230] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:54:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:14.951070 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531fec4-f265-4c77-97f2-512fe3ef6cca None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:14.993587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:15.117289 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531fec4-f265-4c77-97f2-512fe3ef6cca None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:15.164874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad4771-ae09-418e-b930-3319b2d95789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:15.165558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad4771-ae09-418e-b930-3319b2d95789 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:15.165877 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad4771-ae09-418e-b930-3319b2d95789 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:15.166156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad4771-ae09-418e-b930-3319b2d95789 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:15.166976 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad4771-ae09-418e-b930-3319b2d95789 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:15.167287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad4771-ae09-418e-b930-3319b2d95789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:15.168697 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad4771-ae09-418e-b930-3319b2d95789 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:15.178167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 111/231] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:54:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:15.184060 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594596b-6351-4317-8a5e-481717a7cfd1 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:15.225346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:15.310436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594596b-6351-4317-8a5e-481717a7cfd1 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:15.360011 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec40cb9-3aad-43bc-b946-52ab342a4261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:15.361162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec40cb9-3aad-43bc-b946-52ab342a4261 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:15.361449 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec40cb9-3aad-43bc-b946-52ab342a4261 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:15.361777 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec40cb9-3aad-43bc-b946-52ab342a4261 None admin] PATH_INFO: `/v3/users/b109d9c2ca8c48b2aa11019318d1f09d` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:15.363102 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec40cb9-3aad-43bc-b946-52ab342a4261 None admin] RBAC: Authorizing `identity:get_user(user_id=b109d9c2ca8c48b2aa11019318d1f09d)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:15.364587 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec40cb9-3aad-43bc-b946-52ab342a4261 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:15.366525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 121/232] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:15 2022] GET /identity/v3/users/b109d9c2ca8c48b2aa11019318d1f09d => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:15.372127 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad4771-ae09-418e-b930-3319b2d95789 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:15.481667 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:15.491374 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad4771-ae09-418e-b930-3319b2d95789 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:15.542142 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b53622-9924-470c-9996-1572ba19599e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:15.543034 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b53622-9924-470c-9996-1572ba19599e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:15.543318 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b53622-9924-470c-9996-1572ba19599e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:15.543595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b53622-9924-470c-9996-1572ba19599e None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:15.547085 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b53622-9924-470c-9996-1572ba19599e None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:15.548822 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b53622-9924-470c-9996-1572ba19599e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:15.550890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 112/233] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:15 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:15.556413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec40cb9-3aad-43bc-b946-52ab342a4261 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:15.679939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:15.688562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec40cb9-3aad-43bc-b946-52ab342a4261 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:15.729660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3acb53-24cf-4ed2-9be0-6411aa763e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:15.730617 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3acb53-24cf-4ed2-9be0-6411aa763e6a None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:15.730904 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3acb53-24cf-4ed2-9be0-6411aa763e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:15.731182 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3acb53-24cf-4ed2-9be0-6411aa763e6a None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef/users/b109d9c2ca8c48b2aa11019318d1f09d/roles/3695c157587346198902d1f6ec05153a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:15.737738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3acb53-24cf-4ed2-9be0-6411aa763e6a None admin] RBAC: Authorizing `identity:create_grant(project_id=bae39b4f40ce46c7af4ffe6265f259ef, user_id=b109d9c2ca8c48b2aa11019318d1f09d, role_id=3695c157587346198902d1f6ec05153a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:15.739199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3acb53-24cf-4ed2-9be0-6411aa763e6a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:15.770485 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 122/234] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:54:15 2022] PUT /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef/users/b109d9c2ca8c48b2aa11019318d1f09d/roles/3695c157587346198902d1f6ec05153a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:54:16.004282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffba09-bd39-4765-b015-afab4198c72a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:16.004793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffba09-bd39-4765-b015-afab4198c72a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:16.004793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffba09-bd39-4765-b015-afab4198c72a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:16.006701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 113/235] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:16.012740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a5f5a-e9e8-48e0-8c0f-6ab9440e2f19 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:16.013052 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a5f5a-e9e8-48e0-8c0f-6ab9440e2f19 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:16.013310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a5f5a-e9e8-48e0-8c0f-6ab9440e2f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:16.038995 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1d1a5f5a-e9e8-48e0-8c0f-6ab9440e2f19 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:16.040246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1d1a5f5a-e9e8-48e0-8c0f-6ab9440e2f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:16.123463 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 123/236] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:16.148034 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffba09-bd39-4765-b015-afab4198c72a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:16.206283 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4b51f-b30f-4d90-847c-d1103f81bf04 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:16.206677 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4b51f-b30f-4d90-847c-d1103f81bf04 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:16.206848 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4b51f-b30f-4d90-847c-d1103f81bf04 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:16.208480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 124/237] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:54:16.213757 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2c890-78cf-46ec-bcac-fcb3457d83b0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:16.214078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2c890-78cf-46ec-bcac-fcb3457d83b0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:16.214358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2c890-78cf-46ec-bcac-fcb3457d83b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:16.250200 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-69d2c890-78cf-46ec-bcac-fcb3457d83b0 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:16.251752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-69d2c890-78cf-46ec-bcac-fcb3457d83b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:16.291813 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffba09-bd39-4765-b015-afab4198c72a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:16.355459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea569c-ca28-463f-969c-3f857cf80daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:16.356281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea569c-ca28-463f-969c-3f857cf80daa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:16.356608 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea569c-ca28-463f-969c-3f857cf80daa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:16.356890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea569c-ca28-463f-969c-3f857cf80daa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:16.358564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea569c-ca28-463f-969c-3f857cf80daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:16.360304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea569c-ca28-463f-969c-3f857cf80daa None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:16.363611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 114/238] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:16.370244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea569c-ca28-463f-969c-3f857cf80daa None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:16.395218 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 125/239] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:16.416697 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:16.440791 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2c890-78cf-46ec-bcac-fcb3457d83b0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:16.478195 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:16.534855 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea569c-ca28-463f-969c-3f857cf80daa None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:16.602985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c97a9-c5eb-4c5a-a389-d0ebc72f88a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:16.605815 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c97a9-c5eb-4c5a-a389-d0ebc72f88a6 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:16.605928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c97a9-c5eb-4c5a-a389-d0ebc72f88a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:16.606217 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c97a9-c5eb-4c5a-a389-d0ebc72f88a6 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:16.606963 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c97a9-c5eb-4c5a-a389-d0ebc72f88a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:16.608450 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c97a9-c5eb-4c5a-a389-d0ebc72f88a6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:16.642343 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2c890-78cf-46ec-bcac-fcb3457d83b0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:16.653548 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 115/240] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:54:16 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:54:16.689754 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17024b-fc69-48b6-b406-d9c506502bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:16.690762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17024b-fc69-48b6-b406-d9c506502bed None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:16.691050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17024b-fc69-48b6-b406-d9c506502bed None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:16.691324 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17024b-fc69-48b6-b406-d9c506502bed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:16.702610 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17024b-fc69-48b6-b406-d9c506502bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:16.710831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-ed17024b-fc69-48b6-b406-d9c506502bed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:54:16.710831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:16.710831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:16.710831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:16.710831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:16.710831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:16.710831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:16.710831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:16.710831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:16.710831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:16.710831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:16.710831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:16.710831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:16.710831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:16.710831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:16.710831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:16.712124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:16.712124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:16.712124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:16.712124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:16.712124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:16.712124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:16.712124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:16.712124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:16.712124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:16.712124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:16.712124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:16.712124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:16.712124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:16.712124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:16.712124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:16.712124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:16.712909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:16.712909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:16.712909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:16.712909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:16.712909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:16.712909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:16.712909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:16.712909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:16.712909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:16.712909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:16.712909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:54:16.712909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:16.712909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 126/241] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:16.720021 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c97a9-c5eb-4c5a-a389-d0ebc72f88a6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:16.872377 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:16.891494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c97a9-c5eb-4c5a-a389-d0ebc72f88a6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:16.943874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b5314-6523-405e-aa20-c2d83cfd9862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:16.944588 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b5314-6523-405e-aa20-c2d83cfd9862 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:16.944880 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b5314-6523-405e-aa20-c2d83cfd9862 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:16.945158 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b5314-6523-405e-aa20-c2d83cfd9862 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:16.950076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b5314-6523-405e-aa20-c2d83cfd9862 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:16.950432 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b5314-6523-405e-aa20-c2d83cfd9862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:16.951901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b5314-6523-405e-aa20-c2d83cfd9862 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:16.963343 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 116/242] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:16.969058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17024b-fc69-48b6-b406-d9c506502bed None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:17.056755 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:17.085809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17024b-fc69-48b6-b406-d9c506502bed None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:17.122195 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc22fa2-82a2-4e27-90ec-bb4fb506d204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:17.123152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc22fa2-82a2-4e27-90ec-bb4fb506d204 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:17.123384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc22fa2-82a2-4e27-90ec-bb4fb506d204 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:17.123662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc22fa2-82a2-4e27-90ec-bb4fb506d204 None admin] PATH_INFO: `/v3/users/9b9a3aaa519e46b6a69b351f806d590f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:17.142558 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc22fa2-82a2-4e27-90ec-bb4fb506d204 None admin] RBAC: Authorizing `identity:get_user(user_id=9b9a3aaa519e46b6a69b351f806d590f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:17.144091 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc22fa2-82a2-4e27-90ec-bb4fb506d204 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:17.146008 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 127/243] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:16 2022] GET /identity/v3/users/9b9a3aaa519e46b6a69b351f806d590f => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:17.151543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b5314-6523-405e-aa20-c2d83cfd9862 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:17.168869 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b26045-e73d-4808-b133-d54340864294 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:17.169173 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b26045-e73d-4808-b133-d54340864294 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:17.169557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b26045-e73d-4808-b133-d54340864294 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:17.171257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 128/244] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:17.177213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826a780-0963-4dfe-9238-1e36e09c00c0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:17.177487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826a780-0963-4dfe-9238-1e36e09c00c0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:17.177762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826a780-0963-4dfe-9238-1e36e09c00c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:17.196353 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-c826a780-0963-4dfe-9238-1e36e09c00c0 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:17.197614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c826a780-0963-4dfe-9238-1e36e09c00c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:17.273183 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 129/245] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:17.296898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826a780-0963-4dfe-9238-1e36e09c00c0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:17.309789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b5314-6523-405e-aa20-c2d83cfd9862 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:17.365396 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e444c09-8a69-41fb-a5ab-ff988ad4ce01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:17.366726 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e444c09-8a69-41fb-a5ab-ff988ad4ce01 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:17.367019 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e444c09-8a69-41fb-a5ab-ff988ad4ce01 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:17.367439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e444c09-8a69-41fb-a5ab-ff988ad4ce01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:17.371093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:17.392383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:17.421862 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826a780-0963-4dfe-9238-1e36e09c00c0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:17.448986 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e444c09-8a69-41fb-a5ab-ff988ad4ce01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:17.450524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e444c09-8a69-41fb-a5ab-ff988ad4ce01 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:17.464588 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6fa17-3c17-42fd-a179-098a41fd48f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:17.465500 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6fa17-3c17-42fd-a179-098a41fd48f0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:17.465784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6fa17-3c17-42fd-a179-098a41fd48f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:17.466093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6fa17-3c17-42fd-a179-098a41fd48f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:17.478541 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6fa17-3c17-42fd-a179-098a41fd48f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:17.487043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-a9f6fa17-3c17-42fd-a179-098a41fd48f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:17.487043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:17.487043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:17.487043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:17.487043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:17.487043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:17.487043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:17.487043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:17.487043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:17.487043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:17.487043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:17.487043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:17.487043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:17.487043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:17.487043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:17.487043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:17.489021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:17.489021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:17.489021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:17.489021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:17.489021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:17.489021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:17.489021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:17.489021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:17.489021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:17.489021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:17.489021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:17.489021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:17.489021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:17.489021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:17.489021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:17.489021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:17.490317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:17.490317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:17.490317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:17.490317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:17.490317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:17.490317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:17.490317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:17.490317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:17.490317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:17.490317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:17.490317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:17.490317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:17.490317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 130/246] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:17.495736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6fa17-3c17-42fd-a179-098a41fd48f0 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:17.573569 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 117/247] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:17.580094 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e444c09-8a69-41fb-a5ab-ff988ad4ce01 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:17.618860 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6fa17-3c17-42fd-a179-098a41fd48f0 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:17.644511 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:17.661223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:17.667032 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15774c3-15ed-48f5-9ac4-2cd2b7298f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:17.667779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15774c3-15ed-48f5-9ac4-2cd2b7298f3c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:17.668074 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15774c3-15ed-48f5-9ac4-2cd2b7298f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:17.668359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15774c3-15ed-48f5-9ac4-2cd2b7298f3c None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:17.669139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15774c3-15ed-48f5-9ac4-2cd2b7298f3c None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:17.669441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15774c3-15ed-48f5-9ac4-2cd2b7298f3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:17.670910 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15774c3-15ed-48f5-9ac4-2cd2b7298f3c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:17.694250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 131/248] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:17.696969 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15774c3-15ed-48f5-9ac4-2cd2b7298f3c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:17.762523 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e444c09-8a69-41fb-a5ab-ff988ad4ce01 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:17.832108 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50223e53-094d-4556-b202-8732d359a584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:17.832999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50223e53-094d-4556-b202-8732d359a584 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:17.833285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50223e53-094d-4556-b202-8732d359a584 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:17.833570 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50223e53-094d-4556-b202-8732d359a584 None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:17.835825 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50223e53-094d-4556-b202-8732d359a584 None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:17.837647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50223e53-094d-4556-b202-8732d359a584 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:17.839422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 118/249] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:17 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:17.849580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50223e53-094d-4556-b202-8732d359a584 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:17.903712 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15774c3-15ed-48f5-9ac4-2cd2b7298f3c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:17.968331 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e66fb-3faf-4c1b-b1d1-413811f3b50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:17.969233 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e66fb-3faf-4c1b-b1d1-413811f3b50c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:17.969515 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e66fb-3faf-4c1b-b1d1-413811f3b50c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:17.969861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e66fb-3faf-4c1b-b1d1-413811f3b50c None admin] PATH_INFO: `/v3/users/45f3cd76c02243699ca4aeb7a9aab17e` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:17.971743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e66fb-3faf-4c1b-b1d1-413811f3b50c None admin] RBAC: Authorizing `identity:get_user(user_id=45f3cd76c02243699ca4aeb7a9aab17e)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:17.973241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e66fb-3faf-4c1b-b1d1-413811f3b50c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:17.974947 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 132/250] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:17 2022] GET /identity/v3/users/45f3cd76c02243699ca4aeb7a9aab17e => generated 297 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:17.982016 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecd00f-2606-4be6-9abf-b58bb7769b55 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:17.982303 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecd00f-2606-4be6-9abf-b58bb7769b55 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:17.982585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecd00f-2606-4be6-9abf-b58bb7769b55 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:17.983982 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 133/251] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:17.988552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecd00f-2606-4be6-9abf-b58bb7769b55 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:18.040629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50223e53-094d-4556-b202-8732d359a584 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:18.073412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:18.079844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:18.115452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c55924-20f7-477b-8492-5d9d192122b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:18.116173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c55924-20f7-477b-8492-5d9d192122b8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:18.116452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c55924-20f7-477b-8492-5d9d192122b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:18.116749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c55924-20f7-477b-8492-5d9d192122b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:18.117818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c55924-20f7-477b-8492-5d9d192122b8 None admin] RBAC: Adding query filter params (role.id=f6f2b0e067fd4b899c78b84b53d3922c, scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef, user.id=9b9a3aaa519e46b6a69b351f806d590f) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:18.118134 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c55924-20f7-477b-8492-5d9d192122b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:18.119640 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c55924-20f7-477b-8492-5d9d192122b8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:18.133396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecd00f-2606-4be6-9abf-b58bb7769b55 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:18.147579 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 119/252] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:17 2022] GET /identity/v3/role_assignments?user.id=9b9a3aaa519e46b6a69b351f806d590f&scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef&role.id=f6f2b0e067fd4b899c78b84b53d3922c => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:18.148896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1304c05-a62c-46e5-864d-6083ba5703d6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:18.149189 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1304c05-a62c-46e5-864d-6083ba5703d6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:18.149466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1304c05-a62c-46e5-864d-6083ba5703d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:18.169663 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e2f1b-f533-4496-acf7-60acd0ac43e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:18.170535 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e2f1b-f533-4496-acf7-60acd0ac43e1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:18.170822 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e2f1b-f533-4496-acf7-60acd0ac43e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:18.171111 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e2f1b-f533-4496-acf7-60acd0ac43e1 None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:18.172634 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e2f1b-f533-4496-acf7-60acd0ac43e1 None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:18.174256 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e2f1b-f533-4496-acf7-60acd0ac43e1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:18.177092 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 134/253] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:17 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:18.184315 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e2f1b-f533-4496-acf7-60acd0ac43e1 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:18.210906 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a1304c05-a62c-46e5-864d-6083ba5703d6 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:18.212478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a1304c05-a62c-46e5-864d-6083ba5703d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:18.396330 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 120/254] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:18.424084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1304c05-a62c-46e5-864d-6083ba5703d6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:18.436762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e2f1b-f533-4496-acf7-60acd0ac43e1 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:18.481466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:18.518532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088cfa1-2359-4f2a-a00c-b2a0a90b10c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:18.519826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088cfa1-2359-4f2a-a00c-b2a0a90b10c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:18.520323 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088cfa1-2359-4f2a-a00c-b2a0a90b10c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:18.520787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088cfa1-2359-4f2a-a00c-b2a0a90b10c3 None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef/users/45f3cd76c02243699ca4aeb7a9aab17e/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:18.523047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088cfa1-2359-4f2a-a00c-b2a0a90b10c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=bae39b4f40ce46c7af4ffe6265f259ef, user_id=45f3cd76c02243699ca4aeb7a9aab17e, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:18.524743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088cfa1-2359-4f2a-a00c-b2a0a90b10c3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:18.576090 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 135/255] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:54:18 2022] PUT /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef/users/45f3cd76c02243699ca4aeb7a9aab17e/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:54:18.615415 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1304c05-a62c-46e5-864d-6083ba5703d6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:18.636232 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:18.664511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea699a-6b2d-408a-bd86-b2f7d615256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:18.665342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea699a-6b2d-408a-bd86-b2f7d615256b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:18.665622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea699a-6b2d-408a-bd86-b2f7d615256b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:18.665932 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea699a-6b2d-408a-bd86-b2f7d615256b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:18.677281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea699a-6b2d-408a-bd86-b2f7d615256b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:18.684887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d2ea699a-6b2d-408a-bd86-b2f7d615256b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:54:18.684887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:18.684887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:18.684887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:18.684887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:18.684887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:18.684887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:18.684887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:18.684887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:18.684887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:18.684887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:18.684887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:18.684887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:18.684887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:18.684887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:18.684887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:18.685756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:18.685756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:18.685756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:18.685756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:18.685756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:18.685756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:18.685756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:18.685756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:18.685756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:18.685756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:18.685756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:18.685756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:18.685756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:18.685756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:18.685756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:18.685756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:18.686565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:18.686565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:18.686565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:18.686565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:18.686565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:18.686565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:18.686565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:18.686565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:18.686565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:18.686565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:18.686565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:54:18.686565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:18.686565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 121/256] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:54:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:18.695240 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088cfa1-2359-4f2a-a00c-b2a0a90b10c3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:18.783054 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61cf7b-99bd-4e4c-991d-e8ff30372bb3 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:18.783705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61cf7b-99bd-4e4c-991d-e8ff30372bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:18.784285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61cf7b-99bd-4e4c-991d-e8ff30372bb3 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:18.786329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 122/257] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:18.792233 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed110da1-17fc-4cab-adbd-600acb140800 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:18.792949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed110da1-17fc-4cab-adbd-600acb140800 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:18.793438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed110da1-17fc-4cab-adbd-600acb140800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:18.811822 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ed110da1-17fc-4cab-adbd-600acb140800 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:18.814028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ed110da1-17fc-4cab-adbd-600acb140800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:18.887136 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088cfa1-2359-4f2a-a00c-b2a0a90b10c3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:18.938545 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 123/258] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:18.951280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aec9d4-81ab-4ac7-81a7-97829a662082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:18.951997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aec9d4-81ab-4ac7-81a7-97829a662082 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:18.952283 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aec9d4-81ab-4ac7-81a7-97829a662082 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:18.952563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aec9d4-81ab-4ac7-81a7-97829a662082 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:18.953723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aec9d4-81ab-4ac7-81a7-97829a662082 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:18.954082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aec9d4-81ab-4ac7-81a7-97829a662082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:18.955985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aec9d4-81ab-4ac7-81a7-97829a662082 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:18.975493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 136/259] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:18.978676 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed110da1-17fc-4cab-adbd-600acb140800 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:18.981077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aec9d4-81ab-4ac7-81a7-97829a662082 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:19.065678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:19.131808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:19.135688 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed110da1-17fc-4cab-adbd-600acb140800 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:19.183091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e81a68-f6e9-4718-b711-9a460cb8c15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:19.183935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e81a68-f6e9-4718-b711-9a460cb8c15e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:19.184215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e81a68-f6e9-4718-b711-9a460cb8c15e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:19.184487 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e81a68-f6e9-4718-b711-9a460cb8c15e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:19.207631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e81a68-f6e9-4718-b711-9a460cb8c15e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:19.212431 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aec9d4-81ab-4ac7-81a7-97829a662082 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:19.216997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-13e81a68-f6e9-4718-b711-9a460cb8c15e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:19.216997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:19.216997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:19.216997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:19.216997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:19.216997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:19.216997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:19.216997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:19.216997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:19.216997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:19.216997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:19.216997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:19.216997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:19.216997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:19.216997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:19.216997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:19.218225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:19.218225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:19.218225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:19.218225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:19.218225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:19.218225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:19.218225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:19.218225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:19.218225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:19.218225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:19.218225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:19.218225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:19.218225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:19.218225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:19.218225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:19.218225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:19.218994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:19.218994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:19.218994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:19.218994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:19.218994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:19.218994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:19.218994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:19.218994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:19.218994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:19.218994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:19.218994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:19.218994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:19.218994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 124/260] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:54:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:19.224310 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e81a68-f6e9-4718-b711-9a460cb8c15e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:19.255801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d3e30-ed8d-478e-b4fb-522b74261b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:19.257047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d3e30-ed8d-478e-b4fb-522b74261b00 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:19.257521 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d3e30-ed8d-478e-b4fb-522b74261b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:19.258041 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d3e30-ed8d-478e-b4fb-522b74261b00 None admin] PATH_INFO: `/v3/users/b109d9c2ca8c48b2aa11019318d1f09d` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:19.259436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d3e30-ed8d-478e-b4fb-522b74261b00 None admin] RBAC: Authorizing `identity:get_user(user_id=b109d9c2ca8c48b2aa11019318d1f09d)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:19.261100 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d3e30-ed8d-478e-b4fb-522b74261b00 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:19.262991 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 137/261] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:18 2022] GET /identity/v3/users/b109d9c2ca8c48b2aa11019318d1f09d => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:19.287440 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d3e30-ed8d-478e-b4fb-522b74261b00 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:19.382101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e81a68-f6e9-4718-b711-9a460cb8c15e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:19.398887 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d3e30-ed8d-478e-b4fb-522b74261b00 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:19.410611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:19.438357 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef66fe-f9fc-47a6-a82a-948955baeaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:19.439637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef66fe-f9fc-47a6-a82a-948955baeaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:19.440221 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef66fe-f9fc-47a6-a82a-948955baeaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:19.440686 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef66fe-f9fc-47a6-a82a-948955baeaf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:19.442553 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09a3e9-41cd-4691-897f-bc43157476e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:19.443262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09a3e9-41cd-4691-897f-bc43157476e9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:19.443549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09a3e9-41cd-4691-897f-bc43157476e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:19.443824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09a3e9-41cd-4691-897f-bc43157476e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:19.444593 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09a3e9-41cd-4691-897f-bc43157476e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:19.444901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09a3e9-41cd-4691-897f-bc43157476e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:19.446337 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09a3e9-41cd-4691-897f-bc43157476e9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:19.455843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 125/262] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:54:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:19.461463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09a3e9-41cd-4691-897f-bc43157476e9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:19.497241 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:19.524808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef66fe-f9fc-47a6-a82a-948955baeaf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:19.527014 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef66fe-f9fc-47a6-a82a-948955baeaf1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:19.621733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09a3e9-41cd-4691-897f-bc43157476e9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:19.636183 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 138/263] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 20:54:19.643850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef66fe-f9fc-47a6-a82a-948955baeaf1 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:19.656859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:19.671934 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba714ba6-0906-4cca-805b-011e476e775a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:19.672936 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba714ba6-0906-4cca-805b-011e476e775a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:19.673221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba714ba6-0906-4cca-805b-011e476e775a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:19.673496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba714ba6-0906-4cca-805b-011e476e775a None admin] PATH_INFO: `/v3/users/b109d9c2ca8c48b2aa11019318d1f09d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:19.678526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba714ba6-0906-4cca-805b-011e476e775a None admin] RBAC: Authorizing `identity:get_user(user_id=b109d9c2ca8c48b2aa11019318d1f09d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:19.680004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba714ba6-0906-4cca-805b-011e476e775a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:19.681678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 126/264] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:19 2022] GET /identity/v3/users/b109d9c2ca8c48b2aa11019318d1f09d => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:19.687289 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba714ba6-0906-4cca-805b-011e476e775a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:19.755209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef66fe-f9fc-47a6-a82a-948955baeaf1 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:19.799183 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3eefa-159b-4d46-8af9-de785522ef2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:19.800058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3eefa-159b-4d46-8af9-de785522ef2b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:19.800378 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3eefa-159b-4d46-8af9-de785522ef2b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:19.800651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3eefa-159b-4d46-8af9-de785522ef2b None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:19.801873 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3eefa-159b-4d46-8af9-de785522ef2b None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:19.803533 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3eefa-159b-4d46-8af9-de785522ef2b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:19.806413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 139/265] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:19 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:19.812700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3eefa-159b-4d46-8af9-de785522ef2b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:19.870164 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:19.899786 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba714ba6-0906-4cca-805b-011e476e775a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:19.904026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:19.948502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b0190-b4c2-468f-b8f7-6c2f47885fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:19.949230 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b0190-b4c2-468f-b8f7-6c2f47885fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:19.949510 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b0190-b4c2-468f-b8f7-6c2f47885fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:19.949788 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b0190-b4c2-468f-b8f7-6c2f47885fb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:19.952914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3eefa-159b-4d46-8af9-de785522ef2b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:20.023058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7fbda-e805-4d8a-b36f-6eb1003d159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:20.023658 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7fbda-e805-4d8a-b36f-6eb1003d159b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:20.023944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7fbda-e805-4d8a-b36f-6eb1003d159b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:20.024226 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7fbda-e805-4d8a-b36f-6eb1003d159b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:20.025223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7fbda-e805-4d8a-b36f-6eb1003d159b None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef, user.id=b109d9c2ca8c48b2aa11019318d1f09d) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:20.025597 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7fbda-e805-4d8a-b36f-6eb1003d159b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:20.027110 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7fbda-e805-4d8a-b36f-6eb1003d159b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:20.031997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b0190-b4c2-468f-b8f7-6c2f47885fb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:20.033669 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b0190-b4c2-468f-b8f7-6c2f47885fb0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:20.045567 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 140/266] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:19 2022] GET /identity/v3/role_assignments?user.id=b109d9c2ca8c48b2aa11019318d1f09d&scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef&role.id=aefba81d87bf47258c17064af7d9a05f => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:20.118825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3037393-f7fe-46b2-b24f-2b675bb8fce8 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:20.119154 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3037393-f7fe-46b2-b24f-2b675bb8fce8 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:20.119397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3037393-f7fe-46b2-b24f-2b675bb8fce8 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:20.120823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 141/267] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:20.126721 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac65086-9109-4e5e-8f1b-fd89267d3088 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:20.127002 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac65086-9109-4e5e-8f1b-fd89267d3088 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:20.127288 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac65086-9109-4e5e-8f1b-fd89267d3088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:20.150288 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:20.157224 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-8ac65086-9109-4e5e-8f1b-fd89267d3088 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:20.160655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 127/268] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 20:54:20.163281 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8ac65086-9109-4e5e-8f1b-fd89267d3088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:20.166654 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b0190-b4c2-468f-b8f7-6c2f47885fb0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:20.243573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 142/269] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:20.278877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac65086-9109-4e5e-8f1b-fd89267d3088 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:20.289083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b0190-b4c2-468f-b8f7-6c2f47885fb0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:20.343249 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684bcff-8386-4e0f-9497-bda48d01518b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:20.343249 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684bcff-8386-4e0f-9497-bda48d01518b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:20.343249 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684bcff-8386-4e0f-9497-bda48d01518b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:20.343911 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684bcff-8386-4e0f-9497-bda48d01518b None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:20.349816 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684bcff-8386-4e0f-9497-bda48d01518b None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:20.349816 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684bcff-8386-4e0f-9497-bda48d01518b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:20.358347 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 128/270] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:20 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:20.359364 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684bcff-8386-4e0f-9497-bda48d01518b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:20.456749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:20.495594 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:20.510580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684bcff-8386-4e0f-9497-bda48d01518b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:20.550774 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156416b3-47c0-4d94-9a58-a2e1ee262c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:20.551359 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156416b3-47c0-4d94-9a58-a2e1ee262c61 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:20.551638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156416b3-47c0-4d94-9a58-a2e1ee262c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:20.551909 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156416b3-47c0-4d94-9a58-a2e1ee262c61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:20.553019 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156416b3-47c0-4d94-9a58-a2e1ee262c61 None admin] RBAC: Adding query filter params (role.id=3695c157587346198902d1f6ec05153a, scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef, user.id=b109d9c2ca8c48b2aa11019318d1f09d) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:20.553325 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156416b3-47c0-4d94-9a58-a2e1ee262c61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:20.554329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac65086-9109-4e5e-8f1b-fd89267d3088 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:20.554798 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156416b3-47c0-4d94-9a58-a2e1ee262c61 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:20.561500 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 129/271] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:20 2022] GET /identity/v3/role_assignments?user.id=b109d9c2ca8c48b2aa11019318d1f09d&scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef&role.id=3695c157587346198902d1f6ec05153a => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:20.610563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78680d6-3f95-425b-bd1b-ffcf52bab5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:20.611405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78680d6-3f95-425b-bd1b-ffcf52bab5dc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:20.611689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78680d6-3f95-425b-bd1b-ffcf52bab5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:20.611961 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78680d6-3f95-425b-bd1b-ffcf52bab5dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:20.623564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78680d6-3f95-425b-bd1b-ffcf52bab5dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:20.631725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-d78680d6-3f95-425b-bd1b-ffcf52bab5dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:20.631725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:20.631725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:20.631725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:20.631725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:20.631725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:20.631725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:20.631725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:20.631725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:20.631725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:20.631725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:20.631725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:20.631725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:20.631725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:20.631725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:20.631725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:20.633783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:20.633783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:20.633783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:20.633783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:20.633783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:20.633783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:20.633783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:20.633783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:20.633783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:20.633783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:20.633783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:20.633783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:20.633783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:20.633783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:20.633783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:20.633783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:20.635639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:20.635639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:20.635639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:20.635639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:20.635639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:20.635639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:20.635639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:20.635639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:20.635639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:20.635639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:20.635639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:20.635639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:20.635639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 143/272] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:20.639024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156416b3-47c0-4d94-9a58-a2e1ee262c61 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:20.665072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572e13c-5a2b-43d4-afc6-ebbecce308d4 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:20.665692 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572e13c-5a2b-43d4-afc6-ebbecce308d4 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:20.666267 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572e13c-5a2b-43d4-afc6-ebbecce308d4 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:20.667929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 144/273] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:54:20.673843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2c7b1-4648-4620-8c45-f8489e963e53 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:20.673843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2c7b1-4648-4620-8c45-f8489e963e53 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:20.674100 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2c7b1-4648-4620-8c45-f8489e963e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:20.705992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-52a2c7b1-4648-4620-8c45-f8489e963e53 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:20.707200 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-52a2c7b1-4648-4620-8c45-f8489e963e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:20.830694 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156416b3-47c0-4d94-9a58-a2e1ee262c61 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:20.861032 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:20.865285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 145/274] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:20.874767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c12bab-25f3-46af-8034-0eb3c09248a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:20.875519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c12bab-25f3-46af-8034-0eb3c09248a3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:20.875801 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c12bab-25f3-46af-8034-0eb3c09248a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:20.876123 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c12bab-25f3-46af-8034-0eb3c09248a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:20.877107 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c12bab-25f3-46af-8034-0eb3c09248a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:20.877469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c12bab-25f3-46af-8034-0eb3c09248a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:20.878950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c12bab-25f3-46af-8034-0eb3c09248a3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:20.889157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 130/275] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:20.894509 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2c7b1-4648-4620-8c45-f8489e963e53 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:20.895778 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c12bab-25f3-46af-8034-0eb3c09248a3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:20.966562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:21.020627 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c12bab-25f3-46af-8034-0eb3c09248a3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:21.026664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2c7b1-4648-4620-8c45-f8489e963e53 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:21.071306 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b070a-268a-4126-b3a6-8c7f8c35a05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:21.072210 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b070a-268a-4126-b3a6-8c7f8c35a05e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:21.072494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b070a-268a-4126-b3a6-8c7f8c35a05e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:21.072773 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b070a-268a-4126-b3a6-8c7f8c35a05e None admin] PATH_INFO: `/v3/users/0e07123213af4d438a5423706c93f0b6` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:21.080649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac93eaa-c783-4cee-bffe-35ee410e7b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:21.082032 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac93eaa-c783-4cee-bffe-35ee410e7b33 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:21.082032 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac93eaa-c783-4cee-bffe-35ee410e7b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:21.082032 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac93eaa-c783-4cee-bffe-35ee410e7b33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:21.083973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac93eaa-c783-4cee-bffe-35ee410e7b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:21.086492 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac93eaa-c783-4cee-bffe-35ee410e7b33 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:21.088744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 146/276] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:21.094543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b070a-268a-4126-b3a6-8c7f8c35a05e None admin] RBAC: Authorizing `identity:get_user(user_id=0e07123213af4d438a5423706c93f0b6)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:21.097048 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b070a-268a-4126-b3a6-8c7f8c35a05e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:21.098801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac93eaa-c783-4cee-bffe-35ee410e7b33 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:21.099177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 131/277] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:20 2022] GET /identity/v3/users/0e07123213af4d438a5423706c93f0b6 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:21.105107 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b070a-268a-4126-b3a6-8c7f8c35a05e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:21.185499 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:21.208560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac93eaa-c783-4cee-bffe-35ee410e7b33 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:21.221490 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b070a-268a-4126-b3a6-8c7f8c35a05e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:21.238388 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:21.244894 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd655919-3367-4eb2-8d36-a727e460bc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:21.245993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd655919-3367-4eb2-8d36-a727e460bc6b None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:21.246480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd655919-3367-4eb2-8d36-a727e460bc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:21.247071 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd655919-3367-4eb2-8d36-a727e460bc6b None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:21.248206 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd655919-3367-4eb2-8d36-a727e460bc6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:21.250261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd655919-3367-4eb2-8d36-a727e460bc6b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:21.262888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d51054-d08b-4eb0-8d57-a00e74dbc9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:21.264995 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d51054-d08b-4eb0-8d57-a00e74dbc9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:21.265456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d51054-d08b-4eb0-8d57-a00e74dbc9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:21.265893 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d51054-d08b-4eb0-8d57-a00e74dbc9a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:21.267383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d51054-d08b-4eb0-8d57-a00e74dbc9a4 None admin] RBAC: Adding query filter params (role.id=7f252cd3de7047e396a0daf6e7d4d2ee, user.id=0e07123213af4d438a5423706c93f0b6, scope.system=all) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:21.267730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d51054-d08b-4eb0-8d57-a00e74dbc9a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:21.269423 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d51054-d08b-4eb0-8d57-a00e74dbc9a4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:21.275521 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 147/278] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:54:21 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:54:21.281899 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 132/279] 10.222.0.61 () {56 vars in 1308 bytes} [Thu May 26 20:54:21 2022] GET /identity/v3/role_assignments?user.id=0e07123213af4d438a5423706c93f0b6&scope.system=all&role.id=7f252cd3de7047e396a0daf6e7d4d2ee => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:21.343619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e0143-a0c5-42b5-97f8-959bd104395b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:21.344260 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e0143-a0c5-42b5-97f8-959bd104395b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:21.344260 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e0143-a0c5-42b5-97f8-959bd104395b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:21.346093 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 133/280] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:21.352351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9dc58-38c9-4ec3-a0c0-b1aedaced2ce None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:21.352671 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9dc58-38c9-4ec3-a0c0-b1aedaced2ce None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:21.352930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9dc58-38c9-4ec3-a0c0-b1aedaced2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:21.373182 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-5bb9dc58-38c9-4ec3-a0c0-b1aedaced2ce None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:21.374525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5bb9dc58-38c9-4ec3-a0c0-b1aedaced2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:21.457524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 148/281] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:21.482373 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e0143-a0c5-42b5-97f8-959bd104395b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:21.616779 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e0143-a0c5-42b5-97f8-959bd104395b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:21.624801 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:21.656397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f7d39-fe22-45c7-80e1-f3de5bd476cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:21.657399 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f7d39-fe22-45c7-80e1-f3de5bd476cb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:21.657683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f7d39-fe22-45c7-80e1-f3de5bd476cb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:21.657991 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f7d39-fe22-45c7-80e1-f3de5bd476cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:21.672318 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f7d39-fe22-45c7-80e1-f3de5bd476cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:21.680572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-982f7d39-fe22-45c7-80e1-f3de5bd476cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:54:21.680572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:21.680572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:21.680572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:21.680572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:21.680572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:21.680572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:21.680572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:21.680572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:21.680572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:21.680572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:21.680572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:21.680572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:21.680572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:21.680572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:21.680572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:21.681441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:21.681441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:21.681441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:21.681441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:21.681441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:21.681441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:21.681441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:21.681441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:21.681441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:21.681441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:21.681441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:21.681441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:21.681441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:21.681441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:21.681441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:21.681441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:21.682270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:21.682270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:21.682270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:21.682270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:21.682270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:21.682270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:21.682270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:21.682270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:21.682270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:21.682270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:21.682270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:54:21.682270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:21.688250 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 134/282] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:21.689547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9dc58-38c9-4ec3-a0c0-b1aedaced2ce None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:21.812026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9dc58-38c9-4ec3-a0c0-b1aedaced2ce None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:21.830434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:21.856909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f7a32-bb0a-4858-a550-2bbaa1efc849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:21.857670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f7a32-bb0a-4858-a550-2bbaa1efc849 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:21.858001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f7a32-bb0a-4858-a550-2bbaa1efc849 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:21.858298 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f7a32-bb0a-4858-a550-2bbaa1efc849 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:21.859080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f7a32-bb0a-4858-a550-2bbaa1efc849 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:21.859387 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f7a32-bb0a-4858-a550-2bbaa1efc849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:21.861100 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f7a32-bb0a-4858-a550-2bbaa1efc849 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:21.870746 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 149/283] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:21.883523 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f7d39-fe22-45c7-80e1-f3de5bd476cb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:21.995647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f7d39-fe22-45c7-80e1-f3de5bd476cb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:22.031734 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f1e9f-75df-4493-80ee-1f1f4b2fca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:22.032763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f1e9f-75df-4493-80ee-1f1f4b2fca19 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:22.033050 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f1e9f-75df-4493-80ee-1f1f4b2fca19 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:22.033425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f1e9f-75df-4493-80ee-1f1f4b2fca19 None admin] PATH_INFO: `/v3/users/9b9a3aaa519e46b6a69b351f806d590f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:22.034698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f1e9f-75df-4493-80ee-1f1f4b2fca19 None admin] RBAC: Authorizing `identity:get_user(user_id=9b9a3aaa519e46b6a69b351f806d590f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:22.036158 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f1e9f-75df-4493-80ee-1f1f4b2fca19 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:22.038252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 135/284] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:21 2022] GET /identity/v3/users/9b9a3aaa519e46b6a69b351f806d590f => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:22.046925 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f7a32-bb0a-4858-a550-2bbaa1efc849 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:22.154578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f7a32-bb0a-4858-a550-2bbaa1efc849 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:22.169660 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc8ef0-19a0-4f73-8e29-115c16cff373 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:22.169987 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc8ef0-19a0-4f73-8e29-115c16cff373 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:22.170256 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc8ef0-19a0-4f73-8e29-115c16cff373 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:22.171652 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 136/285] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:54:22.176933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a39cd-8d51-48a9-9439-fb598e0a768b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:22.177224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a39cd-8d51-48a9-9439-fb598e0a768b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:22.177507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a39cd-8d51-48a9-9439-fb598e0a768b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:22.203734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e925b0a-a016-464b-9238-5a9a708fd1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:22.204771 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e925b0a-a016-464b-9238-5a9a708fd1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:22.205214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e925b0a-a016-464b-9238-5a9a708fd1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:22.205624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e925b0a-a016-464b-9238-5a9a708fd1c3 None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:22.210566 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e925b0a-a016-464b-9238-5a9a708fd1c3 None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:22.211412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-221a39cd-8d51-48a9-9439-fb598e0a768b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:22.212401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e925b0a-a016-464b-9238-5a9a708fd1c3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:22.212576 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-221a39cd-8d51-48a9-9439-fb598e0a768b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:22.214473 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 150/286] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:22 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:22.220231 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e925b0a-a016-464b-9238-5a9a708fd1c3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:22.242508 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:22.280412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:22.299725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 137/287] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:22.323722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a39cd-8d51-48a9-9439-fb598e0a768b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:22.337289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e925b0a-a016-464b-9238-5a9a708fd1c3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:22.375136 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e98ec-1e64-4cea-93c5-0fe76c897d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:22.376075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e98ec-1e64-4cea-93c5-0fe76c897d04 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:22.376364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e98ec-1e64-4cea-93c5-0fe76c897d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:22.376643 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e98ec-1e64-4cea-93c5-0fe76c897d04 None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef/users/9b9a3aaa519e46b6a69b351f806d590f/roles/f6f2b0e067fd4b899c78b84b53d3922c` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:22.378799 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e98ec-1e64-4cea-93c5-0fe76c897d04 None admin] RBAC: Authorizing `identity:create_grant(project_id=bae39b4f40ce46c7af4ffe6265f259ef, user_id=9b9a3aaa519e46b6a69b351f806d590f, role_id=f6f2b0e067fd4b899c78b84b53d3922c)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:22.380491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e98ec-1e64-4cea-93c5-0fe76c897d04 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:22.400757 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 151/288] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:54:22 2022] PUT /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef/users/9b9a3aaa519e46b6a69b351f806d590f/roles/f6f2b0e067fd4b899c78b84b53d3922c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:54:22.446183 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a39cd-8d51-48a9-9439-fb598e0a768b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:22.487289 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13863160-fd78-4d78-8f14-f6f37c8a47d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:22.488397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13863160-fd78-4d78-8f14-f6f37c8a47d9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:22.488892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13863160-fd78-4d78-8f14-f6f37c8a47d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:22.489299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13863160-fd78-4d78-8f14-f6f37c8a47d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:22.501711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13863160-fd78-4d78-8f14-f6f37c8a47d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:22.510628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-13863160-fd78-4d78-8f14-f6f37c8a47d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:22.510628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:22.510628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:22.510628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:22.510628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:22.510628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:22.510628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:22.510628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:22.510628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:22.510628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:22.510628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:22.510628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:22.510628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:22.510628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:22.510628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:22.510628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:22.511865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:22.511865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:22.511865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:22.511865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:22.511865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:22.511865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:22.511865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:22.511865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:22.511865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:22.511865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:22.511865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:22.511865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:22.511865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:22.511865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:22.511865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:22.511865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:22.512853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:22.512853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:22.512853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:22.512853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:22.512853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:22.512853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:22.512853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:22.512853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:22.512853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:22.512853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:22.512853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:22.512853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:22.515483 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 138/289] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:22.521912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e98ec-1e64-4cea-93c5-0fe76c897d04 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:22.636201 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e98ec-1e64-4cea-93c5-0fe76c897d04 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:22.644597 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:22.673666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaafeb7-1c77-4eed-ab63-ce2a64ac3763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:22.674403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaafeb7-1c77-4eed-ab63-ce2a64ac3763 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:22.675051 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaafeb7-1c77-4eed-ab63-ce2a64ac3763 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:22.675331 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaafeb7-1c77-4eed-ab63-ce2a64ac3763 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:22.676106 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaafeb7-1c77-4eed-ab63-ce2a64ac3763 None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:22.676774 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaafeb7-1c77-4eed-ab63-ce2a64ac3763 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:22.678607 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaafeb7-1c77-4eed-ab63-ce2a64ac3763 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:22.689003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 152/290] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:22.694500 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13863160-fd78-4d78-8f14-f6f37c8a47d9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:22.724366 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:22.802345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13863160-fd78-4d78-8f14-f6f37c8a47d9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:22.836914 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7f2f2-fcc7-465b-af0f-2d9e902f5ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:22.837828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f2f2-fcc7-465b-af0f-2d9e902f5ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:22.838105 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f2f2-fcc7-465b-af0f-2d9e902f5ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:22.838375 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f2f2-fcc7-465b-af0f-2d9e902f5ca1 None admin] PATH_INFO: `/v3/users/45f3cd76c02243699ca4aeb7a9aab17e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:22.839568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7f2f2-fcc7-465b-af0f-2d9e902f5ca1 None admin] RBAC: Authorizing `identity:get_user(user_id=45f3cd76c02243699ca4aeb7a9aab17e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:22.841036 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7f2f2-fcc7-465b-af0f-2d9e902f5ca1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:22.842869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 139/291] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:22 2022] GET /identity/v3/users/45f3cd76c02243699ca4aeb7a9aab17e => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:22.848447 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaafeb7-1c77-4eed-ab63-ce2a64ac3763 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:22.949689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaafeb7-1c77-4eed-ab63-ce2a64ac3763 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:22.987268 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275e7bf-ff8c-4396-8383-3b9d2d1c4354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:22.987861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275e7bf-ff8c-4396-8383-3b9d2d1c4354 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:22.988417 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275e7bf-ff8c-4396-8383-3b9d2d1c4354 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:22.988693 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275e7bf-ff8c-4396-8383-3b9d2d1c4354 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:23.024230 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:23.060825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275e7bf-ff8c-4396-8383-3b9d2d1c4354 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:23.062356 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275e7bf-ff8c-4396-8383-3b9d2d1c4354 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:23.163768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 153/292] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:23.169220 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7f2f2-fcc7-465b-af0f-2d9e902f5ca1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:23.281332 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:23.290051 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7f2f2-fcc7-465b-af0f-2d9e902f5ca1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:23.328620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b80bc6-b270-47f4-9ca6-a64912acc93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:23.329666 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b80bc6-b270-47f4-9ca6-a64912acc93c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:23.329979 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b80bc6-b270-47f4-9ca6-a64912acc93c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:23.330256 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b80bc6-b270-47f4-9ca6-a64912acc93c None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:23.331453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b80bc6-b270-47f4-9ca6-a64912acc93c None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:23.332907 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b80bc6-b270-47f4-9ca6-a64912acc93c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:23.334653 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 140/293] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:23 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:23.340918 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275e7bf-ff8c-4396-8383-3b9d2d1c4354 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:23.407608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:23.441725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275e7bf-ff8c-4396-8383-3b9d2d1c4354 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:23.476594 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca70a5d-feed-44e0-b411-6b7aa5bcd187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:23.477267 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca70a5d-feed-44e0-b411-6b7aa5bcd187 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:23.477548 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca70a5d-feed-44e0-b411-6b7aa5bcd187 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:23.477835 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca70a5d-feed-44e0-b411-6b7aa5bcd187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:23.478685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca70a5d-feed-44e0-b411-6b7aa5bcd187 None admin] RBAC: Adding query filter params (role.id=7f252cd3de7047e396a0daf6e7d4d2ee, scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef, user.id=45f3cd76c02243699ca4aeb7a9aab17e) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:23.478994 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca70a5d-feed-44e0-b411-6b7aa5bcd187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:23.480453 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca70a5d-feed-44e0-b411-6b7aa5bcd187 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:23.486972 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 154/294] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:23 2022] GET /identity/v3/role_assignments?user.id=45f3cd76c02243699ca4aeb7a9aab17e&scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef&role.id=7f252cd3de7047e396a0daf6e7d4d2ee => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:23.906495 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429c1e-e64b-4f52-bd10-3a2eaad96663 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:23.907008 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429c1e-e64b-4f52-bd10-3a2eaad96663 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:23.907465 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429c1e-e64b-4f52-bd10-3a2eaad96663 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:23.908814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 141/295] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:23.914365 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d48f65-9464-4236-b6e7-ff9dbee13cb0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:23.914652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d48f65-9464-4236-b6e7-ff9dbee13cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:23.914927 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d48f65-9464-4236-b6e7-ff9dbee13cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:23.933656 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-92d48f65-9464-4236-b6e7-ff9dbee13cb0 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:23.934884 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-92d48f65-9464-4236-b6e7-ff9dbee13cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:24.015303 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 155/296] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:24.041272 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa429c1e-e64b-4f52-bd10-3a2eaad96663 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:24.172518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa429c1e-e64b-4f52-bd10-3a2eaad96663 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:24.212932 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37f4d2-358a-4adc-b4e0-7773f523ae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:24.214203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37f4d2-358a-4adc-b4e0-7773f523ae01 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:24.214706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37f4d2-358a-4adc-b4e0-7773f523ae01 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:24.215208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37f4d2-358a-4adc-b4e0-7773f523ae01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:24.232072 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37f4d2-358a-4adc-b4e0-7773f523ae01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:24.240730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-fc37f4d2-358a-4adc-b4e0-7773f523ae01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:24.240730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:24.240730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:24.240730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:24.240730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:24.240730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:24.240730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:24.240730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:24.240730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:24.240730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:24.240730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:24.240730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:24.240730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:24.240730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:24.240730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:24.240730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:24.241645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:24.241645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:24.241645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:24.241645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:24.241645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:24.241645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:24.241645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:24.241645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:24.241645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:24.241645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:24.241645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:24.241645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:24.241645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:24.241645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:24.241645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:24.241645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:24.242445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:24.242445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:24.242445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:24.242445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:24.242445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:24.242445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:24.242445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:24.242445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:24.242445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:24.242445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:24.242445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:24.242445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:24.245308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 142/297] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:24.251459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d48f65-9464-4236-b6e7-ff9dbee13cb0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:24.269000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80896f22-f467-4289-9ba5-9602db13ab3b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:24.269562 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80896f22-f467-4289-9ba5-9602db13ab3b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:24.270169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80896f22-f467-4289-9ba5-9602db13ab3b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:24.272119 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 143/298] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:54:24.280393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbd10f-0f8c-4afe-a5a5-e6fb22bf572b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:24.280515 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbd10f-0f8c-4afe-a5a5-e6fb22bf572b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:24.280764 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbd10f-0f8c-4afe-a5a5-e6fb22bf572b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:24.297979 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2ebbd10f-0f8c-4afe-a5a5-e6fb22bf572b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:24.299128 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2ebbd10f-0f8c-4afe-a5a5-e6fb22bf572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:24.314481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:24.325501 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:24.373086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d48f65-9464-4236-b6e7-ff9dbee13cb0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:24.376488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 144/299] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:24.399680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbd10f-0f8c-4afe-a5a5-e6fb22bf572b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:24.410403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde41652-b4cf-49aa-a58b-807470b7cc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:24.411506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde41652-b4cf-49aa-a58b-807470b7cc06 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:24.411926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde41652-b4cf-49aa-a58b-807470b7cc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:24.412365 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde41652-b4cf-49aa-a58b-807470b7cc06 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:24.413338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde41652-b4cf-49aa-a58b-807470b7cc06 None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:24.413825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde41652-b4cf-49aa-a58b-807470b7cc06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:24.415513 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde41652-b4cf-49aa-a58b-807470b7cc06 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:24.425541 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 156/300] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:24.431443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde41652-b4cf-49aa-a58b-807470b7cc06 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:24.506463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbd10f-0f8c-4afe-a5a5-e6fb22bf572b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:24.541835 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde41652-b4cf-49aa-a58b-807470b7cc06 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:24.544888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7697b-b886-4d7c-9a03-4b205147fed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:24.545698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7697b-b886-4d7c-9a03-4b205147fed1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:24.546015 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7697b-b886-4d7c-9a03-4b205147fed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:24.546285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7697b-b886-4d7c-9a03-4b205147fed1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:24.559056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7697b-b886-4d7c-9a03-4b205147fed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:24.566318 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:24.567195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-9bb7697b-b886-4d7c-9a03-4b205147fed1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:54:24.567195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:24.567195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:24.567195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:24.567195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:24.567195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:24.567195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:24.567195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:24.567195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:24.567195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:24.567195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:24.567195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:24.567195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:24.567195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:24.567195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:24.567195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:24.568063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:24.568063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:24.568063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:24.568063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:24.568063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:24.568063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:24.568063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:24.568063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:24.568063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:24.568063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:24.568063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:24.568063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:24.568063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:24.568063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:24.568063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:24.568063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:24.568870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:24.568870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:24.568870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:24.568870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:24.568870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:24.568870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:24.568870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:24.568870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:24.568870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:24.568870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:24.568870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:54:24.568870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:24.568870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 145/301] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:24.570158 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7b835-6bcb-4cb5-a7b0-7854d3e1f453 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:24.570158 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7b835-6bcb-4cb5-a7b0-7854d3e1f453 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:24.570325 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7b835-6bcb-4cb5-a7b0-7854d3e1f453 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:24.571504 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 146/302] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:24.576603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7b835-6bcb-4cb5-a7b0-7854d3e1f453 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:24.586817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86ee98-fb3f-4559-98bf-5d080468c8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:24.587734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86ee98-fb3f-4559-98bf-5d080468c8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:24.588014 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86ee98-fb3f-4559-98bf-5d080468c8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:24.588285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86ee98-fb3f-4559-98bf-5d080468c8c7 None admin] PATH_INFO: `/v3/users/0e07123213af4d438a5423706c93f0b6` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:24.590123 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:24.590229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86ee98-fb3f-4559-98bf-5d080468c8c7 None admin] RBAC: Authorizing `identity:get_user(user_id=0e07123213af4d438a5423706c93f0b6)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:24.591935 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86ee98-fb3f-4559-98bf-5d080468c8c7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:24.598635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 157/303] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:24 2022] GET /identity/v3/users/0e07123213af4d438a5423706c93f0b6 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:24.598635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa0d11-b5e8-4408-9da1-4172e7a64df3 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:24.598635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa0d11-b5e8-4408-9da1-4172e7a64df3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:24.598635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa0d11-b5e8-4408-9da1-4172e7a64df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:24.612657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-acfa0d11-b5e8-4408-9da1-4172e7a64df3 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:24.613865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-acfa0d11-b5e8-4408-9da1-4172e7a64df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:24.683573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 158/304] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:24.686011 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa0d11-b5e8-4408-9da1-4172e7a64df3 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:24.708637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7b835-6bcb-4cb5-a7b0-7854d3e1f453 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:24.747104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fedf2d-0796-4bd9-b053-0d36d2b66f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:24.747783 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fedf2d-0796-4bd9-b053-0d36d2b66f0a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:24.748061 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fedf2d-0796-4bd9-b053-0d36d2b66f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:24.748331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fedf2d-0796-4bd9-b053-0d36d2b66f0a None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:24.749074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fedf2d-0796-4bd9-b053-0d36d2b66f0a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:24.749372 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fedf2d-0796-4bd9-b053-0d36d2b66f0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:24.750848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fedf2d-0796-4bd9-b053-0d36d2b66f0a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:24.760930 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 147/305] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:24.761586 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fedf2d-0796-4bd9-b053-0d36d2b66f0a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:24.799365 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa0d11-b5e8-4408-9da1-4172e7a64df3 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:24.824136 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:24.837129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfd532-c7a4-49eb-a819-54eabdadcbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:24.838277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfd532-c7a4-49eb-a819-54eabdadcbd9 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:24.838394 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfd532-c7a4-49eb-a819-54eabdadcbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:24.838670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfd532-c7a4-49eb-a819-54eabdadcbd9 None admin] PATH_INFO: `/v3/system/users/0e07123213af4d438a5423706c93f0b6/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:24.838937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:24.840426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfd532-c7a4-49eb-a819-54eabdadcbd9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0e07123213af4d438a5423706c93f0b6, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:24.842116 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfd532-c7a4-49eb-a819-54eabdadcbd9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:24.854067 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 159/306] 10.222.0.61 () {58 vars in 1334 bytes} [Thu May 26 20:54:24 2022] PUT /identity/v3/system/users/0e07123213af4d438a5423706c93f0b6/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:54:24.854692 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfd532-c7a4-49eb-a819-54eabdadcbd9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:24.892491 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fedf2d-0796-4bd9-b053-0d36d2b66f0a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:24.949949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecaf5c-b84b-4226-a8ae-c28cf216eb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:24.951537 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecaf5c-b84b-4226-a8ae-c28cf216eb99 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:24.951954 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecaf5c-b84b-4226-a8ae-c28cf216eb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:24.952365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecaf5c-b84b-4226-a8ae-c28cf216eb99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:24.954807 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecaf5c-b84b-4226-a8ae-c28cf216eb99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:24.957073 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecaf5c-b84b-4226-a8ae-c28cf216eb99 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:24.959691 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 148/307] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:24.966059 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecaf5c-b84b-4226-a8ae-c28cf216eb99 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:24.983040 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfd532-c7a4-49eb-a819-54eabdadcbd9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:25.031495 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d7825-a3b8-4235-b64a-1bd01066a90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:25.033974 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d7825-a3b8-4235-b64a-1bd01066a90e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:25.034467 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d7825-a3b8-4235-b64a-1bd01066a90e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:25.034912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d7825-a3b8-4235-b64a-1bd01066a90e None admin] PATH_INFO: `/v3/users/81970857c96543c4ac8d8b12a1d8dab4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:25.056115 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d7825-a3b8-4235-b64a-1bd01066a90e None admin] RBAC: Authorizing `identity:get_user(user_id=81970857c96543c4ac8d8b12a1d8dab4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:25.059335 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d7825-a3b8-4235-b64a-1bd01066a90e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:25.060702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 160/308] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:24 2022] GET /identity/v3/users/81970857c96543c4ac8d8b12a1d8dab4 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:25.066617 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d7825-a3b8-4235-b64a-1bd01066a90e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:25.100310 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecaf5c-b84b-4226-a8ae-c28cf216eb99 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:25.118394 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:25.144073 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b85879-919e-4d24-8f0a-d63a3316f0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:25.144754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b85879-919e-4d24-8f0a-d63a3316f0b8 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:25.145046 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b85879-919e-4d24-8f0a-d63a3316f0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:25.145325 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b85879-919e-4d24-8f0a-d63a3316f0b8 None admin] PATH_INFO: `/v3/groups` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:25.146203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b85879-919e-4d24-8f0a-d63a3316f0b8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:25.147911 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b85879-919e-4d24-8f0a-d63a3316f0b8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:25.159832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:25.164872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 149/309] 10.222.0.61 () {60 vars in 1134 bytes} [Thu May 26 20:54:24 2022] POST /identity/v3/groups => generated 229 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:54:25.166814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a277c5-0956-40b9-b443-31f010d33e05 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:25.167287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a277c5-0956-40b9-b443-31f010d33e05 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:25.167575 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a277c5-0956-40b9-b443-31f010d33e05 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:25.169838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 150/310] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:25.176583 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550832f-d2e4-442b-abbd-4fc73d8f96fe None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:25.176901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550832f-d2e4-442b-abbd-4fc73d8f96fe None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:25.177194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550832f-d2e4-442b-abbd-4fc73d8f96fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:25.185820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d7825-a3b8-4235-b64a-1bd01066a90e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:25.202784 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9550832f-d2e4-442b-abbd-4fc73d8f96fe None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:25.205441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9550832f-d2e4-442b-abbd-4fc73d8f96fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:25.227305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300486fc-02fd-4db4-87a3-7af700640434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:25.228113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300486fc-02fd-4db4-87a3-7af700640434 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:25.228458 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300486fc-02fd-4db4-87a3-7af700640434 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:25.228791 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300486fc-02fd-4db4-87a3-7af700640434 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:25.229723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300486fc-02fd-4db4-87a3-7af700640434 None admin] RBAC: Adding query filter params (role.id=f6f2b0e067fd4b899c78b84b53d3922c, user.id=81970857c96543c4ac8d8b12a1d8dab4, scope.system=all) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:25.230131 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300486fc-02fd-4db4-87a3-7af700640434 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:25.232041 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300486fc-02fd-4db4-87a3-7af700640434 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:25.239000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 161/311] 10.222.0.61 () {56 vars in 1308 bytes} [Thu May 26 20:54:25 2022] GET /identity/v3/role_assignments?user.id=81970857c96543c4ac8d8b12a1d8dab4&scope.system=all&role.id=f6f2b0e067fd4b899c78b84b53d3922c => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:25.299263 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 151/312] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:25.323062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300486fc-02fd-4db4-87a3-7af700640434 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:25.444372 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300486fc-02fd-4db4-87a3-7af700640434 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:25.456352 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:25.490948 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4d12e-d057-4cf6-b4bd-fe3a3b583002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:25.491783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4d12e-d057-4cf6-b4bd-fe3a3b583002 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:25.492069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4d12e-d057-4cf6-b4bd-fe3a3b583002 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:25.492347 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4d12e-d057-4cf6-b4bd-fe3a3b583002 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:25.503669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4d12e-d057-4cf6-b4bd-fe3a3b583002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:25.511474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-c0d4d12e-d057-4cf6-b4bd-fe3a3b583002 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:54:25.511474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:25.511474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:25.511474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:25.511474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:25.511474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:25.511474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:25.511474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:25.511474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:25.511474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:25.511474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:25.511474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:25.511474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:25.511474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:25.511474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:25.511474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:25.512358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:25.512358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:25.512358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:25.512358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:25.512358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:25.512358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:25.512358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:25.512358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:25.512358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:25.512358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:25.512358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:25.512358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:25.512358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:25.512358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:25.512358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:25.512358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:25.513249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:25.513249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:25.513249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:25.513249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:25.513249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:25.513249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:25.513249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:25.513249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:25.513249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:25.513249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:25.513249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:54:25.513249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:25.513249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 162/313] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:25.519788 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550832f-d2e4-442b-abbd-4fc73d8f96fe None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:25.622285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550832f-d2e4-442b-abbd-4fc73d8f96fe None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:25.654113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:25.660157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b317d3c-6ada-4472-bdcd-4ebbcd18dfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:25.660848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b317d3c-6ada-4472-bdcd-4ebbcd18dfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:25.661131 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b317d3c-6ada-4472-bdcd-4ebbcd18dfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:25.661400 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b317d3c-6ada-4472-bdcd-4ebbcd18dfc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:25.662484 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b317d3c-6ada-4472-bdcd-4ebbcd18dfc7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:25.662981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b317d3c-6ada-4472-bdcd-4ebbcd18dfc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:25.664557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b317d3c-6ada-4472-bdcd-4ebbcd18dfc7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:25.673428 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 152/314] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:25.679115 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4d12e-d057-4cf6-b4bd-fe3a3b583002 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:25.786954 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4d12e-d057-4cf6-b4bd-fe3a3b583002 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:25.822139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833e28c-535b-4262-8fb0-b04c5a4e94e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:25.823089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833e28c-535b-4262-8fb0-b04c5a4e94e7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:25.823374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833e28c-535b-4262-8fb0-b04c5a4e94e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:25.823699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833e28c-535b-4262-8fb0-b04c5a4e94e7 None admin] PATH_INFO: `/v3/users/9b9a3aaa519e46b6a69b351f806d590f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:25.824921 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833e28c-535b-4262-8fb0-b04c5a4e94e7 None admin] RBAC: Authorizing `identity:get_user(user_id=9b9a3aaa519e46b6a69b351f806d590f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:25.826438 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833e28c-535b-4262-8fb0-b04c5a4e94e7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:25.828379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 163/315] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:25 2022] GET /identity/v3/users/9b9a3aaa519e46b6a69b351f806d590f => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:25.834047 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b317d3c-6ada-4472-bdcd-4ebbcd18dfc7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:25.937819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b317d3c-6ada-4472-bdcd-4ebbcd18dfc7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:25.973351 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8f4ca-55a4-4148-9bc5-c5a25da77c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:25.974033 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8f4ca-55a4-4148-9bc5-c5a25da77c69 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:25.974314 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8f4ca-55a4-4148-9bc5-c5a25da77c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:25.974585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8f4ca-55a4-4148-9bc5-c5a25da77c69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:26.035844 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:26.045728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8f4ca-55a4-4148-9bc5-c5a25da77c69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:26.047229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8f4ca-55a4-4148-9bc5-c5a25da77c69 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:26.151013 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 153/316] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:26.156607 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833e28c-535b-4262-8fb0-b04c5a4e94e7 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:26.194007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:26.260422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833e28c-535b-4262-8fb0-b04c5a4e94e7 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:26.294447 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6da157-6d36-47fb-ab59-41aab4a60c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:26.295319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6da157-6d36-47fb-ab59-41aab4a60c79 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:26.295603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6da157-6d36-47fb-ab59-41aab4a60c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:26.295877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6da157-6d36-47fb-ab59-41aab4a60c79 None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:26.297123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6da157-6d36-47fb-ab59-41aab4a60c79 None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:26.298846 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6da157-6d36-47fb-ab59-41aab4a60c79 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:26.300933 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 164/317] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:26 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:26.306659 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8f4ca-55a4-4148-9bc5-c5a25da77c69 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:26.404523 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:26.415699 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8f4ca-55a4-4148-9bc5-c5a25da77c69 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:26.453170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596219f-d90d-437c-a359-9b860af3165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:26.453780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596219f-d90d-437c-a359-9b860af3165c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:26.454306 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596219f-d90d-437c-a359-9b860af3165c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:26.455299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596219f-d90d-437c-a359-9b860af3165c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:26.456156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596219f-d90d-437c-a359-9b860af3165c None admin] RBAC: Adding query filter params (role.id=f6f2b0e067fd4b899c78b84b53d3922c, scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef, user.id=9b9a3aaa519e46b6a69b351f806d590f) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:26.456470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596219f-d90d-437c-a359-9b860af3165c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:26.457953 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596219f-d90d-437c-a359-9b860af3165c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:26.464883 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 154/318] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:26 2022] GET /identity/v3/role_assignments?user.id=9b9a3aaa519e46b6a69b351f806d590f&scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef&role.id=f6f2b0e067fd4b899c78b84b53d3922c => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:27.188884 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9ca66-3a7e-4e65-8fa3-b54456195a41 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:27.189407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9ca66-3a7e-4e65-8fa3-b54456195a41 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:27.189407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9ca66-3a7e-4e65-8fa3-b54456195a41 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:27.191025 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 165/319] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:27.196273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28098c2-bd79-4c93-b2cd-5044722bb194 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:27.196698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28098c2-bd79-4c93-b2cd-5044722bb194 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:27.196862 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28098c2-bd79-4c93-b2cd-5044722bb194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:27.214414 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e28098c2-bd79-4c93-b2cd-5044722bb194 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:27.215611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e28098c2-bd79-4c93-b2cd-5044722bb194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:27.284865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 155/320] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:27.308309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9ca66-3a7e-4e65-8fa3-b54456195a41 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:27.425207 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9ca66-3a7e-4e65-8fa3-b54456195a41 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:27.427676 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:27.461983 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24967c68-8ee0-44ec-aa84-208264fad95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:27.462722 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24967c68-8ee0-44ec-aa84-208264fad95d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:27.463005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24967c68-8ee0-44ec-aa84-208264fad95d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:27.463276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24967c68-8ee0-44ec-aa84-208264fad95d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:27.473693 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24967c68-8ee0-44ec-aa84-208264fad95d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:27.481427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-24967c68-8ee0-44ec-aa84-208264fad95d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:27.481427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:27.481427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:27.481427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:27.481427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:27.481427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:27.481427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:27.481427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:27.481427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:27.481427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:27.481427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:27.481427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:27.481427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:27.481427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:27.481427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:27.481427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:27.482482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:27.482482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:27.482482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:27.482482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:27.482482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:27.482482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:27.482482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:27.482482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:27.482482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:27.482482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:27.482482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:27.482482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:27.482482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:27.482482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:27.482482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:27.482482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:27.483346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:27.483346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:27.483346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:27.483346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:27.483346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:27.483346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:27.483346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:27.483346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:27.483346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:27.483346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:27.483346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:27.483346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:27.483346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 166/321] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:27.488759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28098c2-bd79-4c93-b2cd-5044722bb194 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:27.522171 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c6b4b-3666-43fc-9ba2-2839f95ab83e None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:27.522524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c6b4b-3666-43fc-9ba2-2839f95ab83e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:27.522726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c6b4b-3666-43fc-9ba2-2839f95ab83e None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:27.524113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 167/322] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:27.529393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a62a58-ae41-4fcd-aefe-c4250feb7e86 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:27.529681 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a62a58-ae41-4fcd-aefe-c4250feb7e86 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:27.529991 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a62a58-ae41-4fcd-aefe-c4250feb7e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:27.546643 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-34a62a58-ae41-4fcd-aefe-c4250feb7e86 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:27.547841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-34a62a58-ae41-4fcd-aefe-c4250feb7e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:27.579198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:27.596476 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28098c2-bd79-4c93-b2cd-5044722bb194 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:27.615345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 168/323] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:27.616844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9805dd-6bd6-4a5d-98ca-1a00b805bdf0 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:27.617140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9805dd-6bd6-4a5d-98ca-1a00b805bdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:27.617406 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9805dd-6bd6-4a5d-98ca-1a00b805bdf0 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:27.618853 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 169/324] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:27.624078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1191a7-a5a2-4fbc-ace4-e7d29de20864 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:27.624406 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1191a7-a5a2-4fbc-ace4-e7d29de20864 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:27.624692 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1191a7-a5a2-4fbc-ace4-e7d29de20864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:27.633538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ff955-6977-4b37-ba14-3d0d38edd31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:27.634254 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ff955-6977-4b37-ba14-3d0d38edd31b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:27.634539 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ff955-6977-4b37-ba14-3d0d38edd31b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:27.634812 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ff955-6977-4b37-ba14-3d0d38edd31b None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:27.635729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ff955-6977-4b37-ba14-3d0d38edd31b None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:27.636036 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ff955-6977-4b37-ba14-3d0d38edd31b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:27.637587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ff955-6977-4b37-ba14-3d0d38edd31b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:27.640908 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1e1191a7-a5a2-4fbc-ace4-e7d29de20864 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:27.642196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1e1191a7-a5a2-4fbc-ace4-e7d29de20864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:27.646275 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 156/325] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:27.648240 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ff955-6977-4b37-ba14-3d0d38edd31b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:27.708014 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 170/326] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:27.715407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1191a7-a5a2-4fbc-ace4-e7d29de20864 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:27.733033 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:27.755781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ff955-6977-4b37-ba14-3d0d38edd31b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:27.790809 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81bcb3-0eb1-4edc-b869-aa071dfcbbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:27.791628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81bcb3-0eb1-4edc-b869-aa071dfcbbbd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:27.791928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81bcb3-0eb1-4edc-b869-aa071dfcbbbd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:27.792203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81bcb3-0eb1-4edc-b869-aa071dfcbbbd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:27.802941 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81bcb3-0eb1-4edc-b869-aa071dfcbbbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:27.810599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-df81bcb3-0eb1-4edc-b869-aa071dfcbbbd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:54:27.810599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:27.810599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:27.810599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:27.810599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:27.810599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:27.810599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:27.810599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:27.810599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:27.810599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:27.810599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:27.810599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:27.810599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:27.810599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:27.810599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:27.810599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:27.811473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:27.811473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:27.811473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:27.811473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:27.811473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:27.811473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:27.811473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:27.811473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:27.811473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:27.811473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:27.811473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:27.811473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:27.811473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:27.811473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:27.811473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:27.811473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:27.812229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:27.812229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:27.812229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:27.812229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:27.812229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:27.812229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:27.812229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:27.812229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:27.812229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:27.812229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:27.812229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:54:27.812229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:27.812817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1191a7-a5a2-4fbc-ace4-e7d29de20864 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:27.812893 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 157/327] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:27.812893 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81bcb3-0eb1-4edc-b869-aa071dfcbbbd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:27.823886 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:27.848202 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5d028-6d0e-4c21-85a2-64cc36021935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:27.849075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d028-6d0e-4c21-85a2-64cc36021935 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:27.849368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d028-6d0e-4c21-85a2-64cc36021935 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:27.849635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d028-6d0e-4c21-85a2-64cc36021935 None admin] PATH_INFO: `/v3/users/0e07123213af4d438a5423706c93f0b6` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:27.850859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5d028-6d0e-4c21-85a2-64cc36021935 None admin] RBAC: Authorizing `identity:get_user(user_id=0e07123213af4d438a5423706c93f0b6)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:27.852332 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5d028-6d0e-4c21-85a2-64cc36021935 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:27.858825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 171/328] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:27 2022] GET /identity/v3/users/0e07123213af4d438a5423706c93f0b6 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:27.858825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5d028-6d0e-4c21-85a2-64cc36021935 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:27.920469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81bcb3-0eb1-4edc-b869-aa071dfcbbbd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:27.943243 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:27.952139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5d028-6d0e-4c21-85a2-64cc36021935 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:27.958828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cfa9d-a88e-49d4-a591-1bd5cea84383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:27.959642 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cfa9d-a88e-49d4-a591-1bd5cea84383 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:27.959927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cfa9d-a88e-49d4-a591-1bd5cea84383 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:27.960201 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cfa9d-a88e-49d4-a591-1bd5cea84383 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:27.961732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cfa9d-a88e-49d4-a591-1bd5cea84383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:27.963242 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cfa9d-a88e-49d4-a591-1bd5cea84383 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:27.964869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 158/329] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:27.965684 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cfa9d-a88e-49d4-a591-1bd5cea84383 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:27.993039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478db63-b764-4c0d-b179-e39f43173fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:27.993722 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478db63-b764-4c0d-b179-e39f43173fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:27.994016 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478db63-b764-4c0d-b179-e39f43173fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:27.994288 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478db63-b764-4c0d-b179-e39f43173fb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:27.995038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478db63-b764-4c0d-b179-e39f43173fb6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:27.995329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478db63-b764-4c0d-b179-e39f43173fb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:27.996721 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478db63-b764-4c0d-b179-e39f43173fb6 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:28.005216 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 172/330] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:28.006212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478db63-b764-4c0d-b179-e39f43173fb6 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:28.048248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:28.070582 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cfa9d-a88e-49d4-a591-1bd5cea84383 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:28.105114 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaa69c-e09e-4e52-9d6c-cc2a3a658518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:28.105768 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaa69c-e09e-4e52-9d6c-cc2a3a658518 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:28.105994 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478db63-b764-4c0d-b179-e39f43173fb6 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:28.106129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaa69c-e09e-4e52-9d6c-cc2a3a658518 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:28.106352 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaa69c-e09e-4e52-9d6c-cc2a3a658518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:28.107179 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaa69c-e09e-4e52-9d6c-cc2a3a658518 None admin] RBAC: Adding query filter params (role.id=7f252cd3de7047e396a0daf6e7d4d2ee, user.id=0e07123213af4d438a5423706c93f0b6, scope.system=all) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:28.107491 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaa69c-e09e-4e52-9d6c-cc2a3a658518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:28.108926 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaa69c-e09e-4e52-9d6c-cc2a3a658518 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:28.120735 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 159/331] 10.222.0.61 () {56 vars in 1308 bytes} [Thu May 26 20:54:27 2022] GET /identity/v3/role_assignments?user.id=0e07123213af4d438a5423706c93f0b6&scope.system=all&role.id=7f252cd3de7047e396a0daf6e7d4d2ee => generated 510 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:28.121538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaa69c-e09e-4e52-9d6c-cc2a3a658518 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:28.156293 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5b9d1-470f-4d83-977e-cae3335937fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:28.157078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5b9d1-470f-4d83-977e-cae3335937fb None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:28.157437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5b9d1-470f-4d83-977e-cae3335937fb None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:28.157717 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5b9d1-470f-4d83-977e-cae3335937fb None admin] PATH_INFO: `/v3/groups` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:28.158472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5b9d1-470f-4d83-977e-cae3335937fb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:28.159976 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5b9d1-470f-4d83-977e-cae3335937fb None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:28.179609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 173/332] 10.222.0.61 () {60 vars in 1134 bytes} [Thu May 26 20:54:28 2022] POST /identity/v3/groups => generated 226 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:54:28.240628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaa69c-e09e-4e52-9d6c-cc2a3a658518 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:28.281225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7046289-9396-4486-aea3-890867af7fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:28.282391 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7046289-9396-4486-aea3-890867af7fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:28.282759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7046289-9396-4486-aea3-890867af7fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:28.283070 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7046289-9396-4486-aea3-890867af7fe0 None admin] PATH_INFO: `/v3/users/81970857c96543c4ac8d8b12a1d8dab4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:28.284554 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7046289-9396-4486-aea3-890867af7fe0 None admin] RBAC: Authorizing `identity:get_user(user_id=81970857c96543c4ac8d8b12a1d8dab4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:28.286116 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7046289-9396-4486-aea3-890867af7fe0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:28.288123 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 160/333] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:28 2022] GET /identity/v3/users/81970857c96543c4ac8d8b12a1d8dab4 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:28.294053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5b9d1-470f-4d83-977e-cae3335937fb None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:28.312783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:28.413723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5b9d1-470f-4d83-977e-cae3335937fb None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:28.447215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968ecfa-a09c-4b59-abd3-9c9585f887c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:28.448098 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968ecfa-a09c-4b59-abd3-9c9585f887c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:28.448380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968ecfa-a09c-4b59-abd3-9c9585f887c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:28.448654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968ecfa-a09c-4b59-abd3-9c9585f887c2 None admin] PATH_INFO: `/v3/system/users/81970857c96543c4ac8d8b12a1d8dab4/roles/f6f2b0e067fd4b899c78b84b53d3922c` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:28.450208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968ecfa-a09c-4b59-abd3-9c9585f887c2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=81970857c96543c4ac8d8b12a1d8dab4, role_id=f6f2b0e067fd4b899c78b84b53d3922c)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:28.451620 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968ecfa-a09c-4b59-abd3-9c9585f887c2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:28.460676 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 174/334] 10.222.0.61 () {58 vars in 1334 bytes} [Thu May 26 20:54:28 2022] PUT /identity/v3/system/users/81970857c96543c4ac8d8b12a1d8dab4/roles/f6f2b0e067fd4b899c78b84b53d3922c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:54:30.569780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f231a-10ea-45c1-bef2-beca842683b9 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:30.570340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f231a-10ea-45c1-bef2-beca842683b9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:30.570340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f231a-10ea-45c1-bef2-beca842683b9 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:30.572010 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 161/335] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:30.579524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb667878-4e0b-4edc-9acf-0175441faf54 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:30.580076 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb667878-4e0b-4edc-9acf-0175441faf54 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:30.580199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb667878-4e0b-4edc-9acf-0175441faf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:30.602892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-eb667878-4e0b-4edc-9acf-0175441faf54 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:30.604190 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-eb667878-4e0b-4edc-9acf-0175441faf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:30.693350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 175/336] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:30.728722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f231a-10ea-45c1-bef2-beca842683b9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:30.738094 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:30.877045 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f231a-10ea-45c1-bef2-beca842683b9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:30.922703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af861b7c-2779-41f7-ad0a-2105eeff92bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:30.923728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af861b7c-2779-41f7-ad0a-2105eeff92bc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:30.924021 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af861b7c-2779-41f7-ad0a-2105eeff92bc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:30.924294 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af861b7c-2779-41f7-ad0a-2105eeff92bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:30.942737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af861b7c-2779-41f7-ad0a-2105eeff92bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:30.950538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-af861b7c-2779-41f7-ad0a-2105eeff92bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:30.950538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:30.950538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:30.950538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:30.950538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:30.950538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:30.950538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:30.950538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:30.950538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:30.950538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:30.950538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:30.950538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:30.950538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:30.950538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:30.950538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:30.950538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:30.951468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:30.951468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:30.951468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:30.951468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:30.951468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:30.951468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:30.951468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:30.951468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:30.951468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:30.951468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:30.951468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:30.951468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:30.951468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:30.951468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:30.951468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:30.951468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:30.952218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:30.952218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:30.952218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:30.952218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:30.952218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:30.952218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:30.952218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:30.952218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:30.952218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:30.952218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:30.952218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:30.952218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:30.952218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 162/337] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:30.958231 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb667878-4e0b-4edc-9acf-0175441faf54 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:30.977703 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:30.994416 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295a85b-0d69-49a7-a162-aa6f63da4168 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:30.994721 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295a85b-0d69-49a7-a162-aa6f63da4168 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:30.994988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295a85b-0d69-49a7-a162-aa6f63da4168 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:30.996388 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 163/338] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:54:31.007563 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c8e7a-5bdd-4fe7-b1b8-9b450aacdd5a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:31.007848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c8e7a-5bdd-4fe7-b1b8-9b450aacdd5a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:31.008132 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c8e7a-5bdd-4fe7-b1b8-9b450aacdd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:31.032140 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f41c8e7a-5bdd-4fe7-b1b8-9b450aacdd5a None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:31.033489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f41c8e7a-5bdd-4fe7-b1b8-9b450aacdd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:31.183017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:31.190243 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb667878-4e0b-4edc-9acf-0175441faf54 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:31.213950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 164/339] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:31.249211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c8e7a-5bdd-4fe7-b1b8-9b450aacdd5a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:31.284729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18feda2e-b0bf-4a3d-929d-087b5d562f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:31.285431 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feda2e-b0bf-4a3d-929d-087b5d562f15 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:31.285709 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feda2e-b0bf-4a3d-929d-087b5d562f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:31.286005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feda2e-b0bf-4a3d-929d-087b5d562f15 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:31.286778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18feda2e-b0bf-4a3d-929d-087b5d562f15 None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:31.287081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18feda2e-b0bf-4a3d-929d-087b5d562f15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:31.288565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18feda2e-b0bf-4a3d-929d-087b5d562f15 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:31.309109 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 176/340] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:31.316062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18feda2e-b0bf-4a3d-929d-087b5d562f15 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:31.456561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c8e7a-5bdd-4fe7-b1b8-9b450aacdd5a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:31.466231 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:31.514827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18feda2e-b0bf-4a3d-929d-087b5d562f15 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:31.524505 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afff681-7ecb-4503-b183-933a7f9553a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:31.525329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afff681-7ecb-4503-b183-933a7f9553a4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:31.525609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afff681-7ecb-4503-b183-933a7f9553a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:31.525902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afff681-7ecb-4503-b183-933a7f9553a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:31.548732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afff681-7ecb-4503-b183-933a7f9553a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:31.556473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-2afff681-7ecb-4503-b183-933a7f9553a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:31.556473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:31.556473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:31.556473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:31.556473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:31.556473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:31.556473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:31.556473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:31.556473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:31.556473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:31.556473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:31.556473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:31.556473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:31.556473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:31.556473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:31.556473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:31.557336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:31.557336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:31.557336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:31.557336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:31.557336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:31.557336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:31.557336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:31.557336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:31.557336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:31.557336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:31.557336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:31.557336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:31.557336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:31.557336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:31.557336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:31.557336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:31.558271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:31.558271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:31.558271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:31.558271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:31.558271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:31.558271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:31.558271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:31.558271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:31.558271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:31.558271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:31.558271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:31.558271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:31.558271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 165/341] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:31.563195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3a6be-97b8-46ef-b318-97ce89631988 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:31.563476 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3a6be-97b8-46ef-b318-97ce89631988 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:31.563758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3a6be-97b8-46ef-b318-97ce89631988 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:31.565201 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 166/342] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:31.566360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdc654-4207-4203-b206-6de01bc4ff62 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:31.566638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdc654-4207-4203-b206-6de01bc4ff62 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:31.566970 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdc654-4207-4203-b206-6de01bc4ff62 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:31.568203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 167/343] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:31.569700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdc654-4207-4203-b206-6de01bc4ff62 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:31.582823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70310404-fbdf-4143-bc7c-0188f26c3378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:31.583984 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70310404-fbdf-4143-bc7c-0188f26c3378 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:31.584275 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70310404-fbdf-4143-bc7c-0188f26c3378 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:31.584555 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70310404-fbdf-4143-bc7c-0188f26c3378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:31.633350 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:31.678250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70310404-fbdf-4143-bc7c-0188f26c3378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:31.680410 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70310404-fbdf-4143-bc7c-0188f26c3378 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:31.692333 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdc654-4207-4203-b206-6de01bc4ff62 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:31.730418 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28553f-d875-41f5-a231-d43eae5f28b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:31.731017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28553f-d875-41f5-a231-d43eae5f28b1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:31.731292 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28553f-d875-41f5-a231-d43eae5f28b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:31.731562 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28553f-d875-41f5-a231-d43eae5f28b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:31.735092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28553f-d875-41f5-a231-d43eae5f28b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:31.735409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28553f-d875-41f5-a231-d43eae5f28b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:31.736814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28553f-d875-41f5-a231-d43eae5f28b1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:31.748609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 168/344] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:31.754204 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49594be9-00a4-4d9a-847f-177436e54b11 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:31.754553 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49594be9-00a4-4d9a-847f-177436e54b11 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:31.754828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49594be9-00a4-4d9a-847f-177436e54b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:31.777343 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-49594be9-00a4-4d9a-847f-177436e54b11 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:31.777997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:31.778819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-49594be9-00a4-4d9a-847f-177436e54b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:31.813451 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 177/345] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:31.816579 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c29c88-7142-4453-82e5-7369e26b6d8e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:31.816990 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c29c88-7142-4453-82e5-7369e26b6d8e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:31.817273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c29c88-7142-4453-82e5-7369e26b6d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:31.845996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b0c29c88-7142-4453-82e5-7369e26b6d8e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:31.847219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b0c29c88-7142-4453-82e5-7369e26b6d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:31.866088 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 169/346] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:31.867305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49594be9-00a4-4d9a-847f-177436e54b11 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:31.924461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:31.945995 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 178/347] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:31.947175 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c29c88-7142-4453-82e5-7369e26b6d8e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:31.996194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49594be9-00a4-4d9a-847f-177436e54b11 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:32.039288 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a5f48-d8c4-4c85-81a3-baf8018adf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:32.039957 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a5f48-d8c4-4c85-81a3-baf8018adf67 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:32.040241 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a5f48-d8c4-4c85-81a3-baf8018adf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:32.040517 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a5f48-d8c4-4c85-81a3-baf8018adf67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:32.074759 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:32.078331 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c29c88-7142-4453-82e5-7369e26b6d8e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:32.113923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44f25c-ef9b-400b-97d1-bc900c206120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:32.114696 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a5f48-d8c4-4c85-81a3-baf8018adf67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:32.114802 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44f25c-ef9b-400b-97d1-bc900c206120 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:32.115089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44f25c-ef9b-400b-97d1-bc900c206120 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:32.115366 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44f25c-ef9b-400b-97d1-bc900c206120 None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:32.116192 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a5f48-d8c4-4c85-81a3-baf8018adf67 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:32.116565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44f25c-ef9b-400b-97d1-bc900c206120 None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:32.118052 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44f25c-ef9b-400b-97d1-bc900c206120 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:32.119763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 179/348] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:31 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:32.120530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44f25c-ef9b-400b-97d1-bc900c206120 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:32.166106 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:32.225771 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44f25c-ef9b-400b-97d1-bc900c206120 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:32.227459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 170/349] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:32.228384 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a5f48-d8c4-4c85-81a3-baf8018adf67 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:32.266950 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf96a6-162c-42c1-bc96-426858d77668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:32.267661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf96a6-162c-42c1-bc96-426858d77668 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:32.267937 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf96a6-162c-42c1-bc96-426858d77668 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:32.268205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf96a6-162c-42c1-bc96-426858d77668 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:32.279166 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf96a6-162c-42c1-bc96-426858d77668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:32.291603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-6fdf96a6-162c-42c1-bc96-426858d77668 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:54:32.291603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:32.291603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:32.291603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:32.291603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:32.291603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:32.291603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:32.291603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:32.291603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:32.291603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:32.291603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:32.291603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:32.291603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:32.291603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:32.291603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:32.291603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:32.292525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:32.292525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:32.292525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:32.292525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:32.292525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:32.292525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:32.292525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:32.292525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:32.292525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:32.292525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:32.292525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:32.292525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:32.292525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:32.292525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:32.292525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:32.292525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:32.293412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:32.293412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:32.293412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:32.293412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:32.293412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:32.293412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:32.293412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:32.293412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:32.293412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:32.293412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:32.293412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 20:54:32.293412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:32.293412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 180/350] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:32.294597 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf96a6-162c-42c1-bc96-426858d77668 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:32.334224 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:32.338860 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a5f48-d8c4-4c85-81a3-baf8018adf67 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:32.385830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c8a56-c449-497c-a04e-e2989d1ec1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:32.385830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c8a56-c449-497c-a04e-e2989d1ec1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:32.385830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c8a56-c449-497c-a04e-e2989d1ec1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:32.385830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c8a56-c449-497c-a04e-e2989d1ec1b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:32.399034 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c8a56-c449-497c-a04e-e2989d1ec1b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:32.407710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-172c8a56-c449-497c-a04e-e2989d1ec1b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:32.407710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:32.407710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:32.407710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:32.407710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:32.407710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:32.407710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:32.407710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:32.407710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:32.407710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:32.407710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:32.407710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:32.407710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:32.407710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:32.407710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:32.407710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:32.408661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:32.408661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:32.408661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:32.408661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:32.408661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:32.408661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:32.408661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:32.408661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:32.408661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:32.408661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:32.408661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:32.408661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:32.408661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:32.408661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:32.408661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:32.408661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:32.409446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:32.409446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:32.409446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:32.409446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:32.409446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:32.409446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:32.409446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:32.409446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:32.409446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:32.409446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:32.409446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:32.409446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:32.409446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 171/351] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:54:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:32.414337 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c8a56-c449-497c-a04e-e2989d1ec1b7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:32.422176 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:32.439676 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf96a6-162c-42c1-bc96-426858d77668 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:32.478308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c48d41-8a76-409d-9345-e3c369256efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:32.479189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c48d41-8a76-409d-9345-e3c369256efa None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:32.479563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c48d41-8a76-409d-9345-e3c369256efa None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:32.479828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c48d41-8a76-409d-9345-e3c369256efa None admin] PATH_INFO: `/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:32.487057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c48d41-8a76-409d-9345-e3c369256efa None admin] RBAC: Authorizing `identity:get_group(group_id=9fdf21fe474b46c2a7f5888244d8a1a4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:32.488490 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c48d41-8a76-409d-9345-e3c369256efa None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:32.490552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 181/352] 10.222.0.61 () {56 vars in 1180 bytes} [Thu May 26 20:54:32 2022] GET /identity/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:32.491483 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c48d41-8a76-409d-9345-e3c369256efa None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:32.533782 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c8a56-c449-497c-a04e-e2989d1ec1b7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:32.593750 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1bd42-27aa-4856-a971-4d93c885da44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:32.595491 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1bd42-27aa-4856-a971-4d93c885da44 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:32.595998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1bd42-27aa-4856-a971-4d93c885da44 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:32.596281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1bd42-27aa-4856-a971-4d93c885da44 None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:32.600623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1bd42-27aa-4856-a971-4d93c885da44 None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:32.602392 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1bd42-27aa-4856-a971-4d93c885da44 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:32.604540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 172/353] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:32 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:32.605153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1bd42-27aa-4856-a971-4d93c885da44 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:32.664477 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:32.675257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c48d41-8a76-409d-9345-e3c369256efa None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:32.725641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:32.726948 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794f209-7554-423c-b78e-ee93374692d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:32.727999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794f209-7554-423c-b78e-ee93374692d9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:32.727999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794f209-7554-423c-b78e-ee93374692d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:32.728189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794f209-7554-423c-b78e-ee93374692d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:32.728907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794f209-7554-423c-b78e-ee93374692d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:32.729223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794f209-7554-423c-b78e-ee93374692d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:32.731382 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794f209-7554-423c-b78e-ee93374692d9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:32.745563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 182/354] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:32.746506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794f209-7554-423c-b78e-ee93374692d9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:32.778673 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1bd42-27aa-4856-a971-4d93c885da44 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:32.826185 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e7733-9635-4f7b-9e23-c2a99e69d608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:32.826802 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e7733-9635-4f7b-9e23-c2a99e69d608 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:32.827086 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e7733-9635-4f7b-9e23-c2a99e69d608 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:32.827723 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e7733-9635-4f7b-9e23-c2a99e69d608 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:32.828118 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e7733-9635-4f7b-9e23-c2a99e69d608 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:32.829950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e7733-9635-4f7b-9e23-c2a99e69d608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:32.830151 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e7733-9635-4f7b-9e23-c2a99e69d608 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:32.845562 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 173/355] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:54:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:32.847654 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e7733-9635-4f7b-9e23-c2a99e69d608 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:32.872767 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794f209-7554-423c-b78e-ee93374692d9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:32.917745 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c725ec-865e-483c-886f-3385b69f2162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:32.918617 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c725ec-865e-483c-886f-3385b69f2162 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:32.918871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c725ec-865e-483c-886f-3385b69f2162 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:32.919146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c725ec-865e-483c-886f-3385b69f2162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:32.920010 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c725ec-865e-483c-886f-3385b69f2162 None admin] RBAC: Adding query filter params (group.id=9fdf21fe474b46c2a7f5888244d8a1a4, role.id=7f252cd3de7047e396a0daf6e7d4d2ee, scope.project.id=839fd844cfbb442e8202597c69e6bbee) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:32.920319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c725ec-865e-483c-886f-3385b69f2162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:32.922095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c725ec-865e-483c-886f-3385b69f2162 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:32.933375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 183/356] 10.222.0.61 () {56 vars in 1376 bytes} [Thu May 26 20:54:32 2022] GET /identity/v3/role_assignments?group.id=9fdf21fe474b46c2a7f5888244d8a1a4&scope.project.id=839fd844cfbb442e8202597c69e6bbee&role.id=7f252cd3de7047e396a0daf6e7d4d2ee => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:32.933375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd78c2-0969-4eb6-bf0f-a0be617a9d46 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:32.933375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd78c2-0969-4eb6-bf0f-a0be617a9d46 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:32.933713 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd78c2-0969-4eb6-bf0f-a0be617a9d46 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:32.936470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 184/357] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:32.936470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd78c2-0969-4eb6-bf0f-a0be617a9d46 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:32.987422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:33.031180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e7733-9635-4f7b-9e23-c2a99e69d608 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:33.078314 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d5cd0-532b-4131-9387-a4ae5d61d3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:33.080677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d5cd0-532b-4131-9387-a4ae5d61d3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:33.082109 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d5cd0-532b-4131-9387-a4ae5d61d3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:33.085306 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d5cd0-532b-4131-9387-a4ae5d61d3a0 None admin] PATH_INFO: `/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:33.087796 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d5cd0-532b-4131-9387-a4ae5d61d3a0 None admin] RBAC: Authorizing `identity:get_group(group_id=9fdf21fe474b46c2a7f5888244d8a1a4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:33.089722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d5cd0-532b-4131-9387-a4ae5d61d3a0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:33.092842 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 174/358] 10.222.0.61 () {56 vars in 1180 bytes} [Thu May 26 20:54:32 2022] GET /identity/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:33.093658 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d5cd0-532b-4131-9387-a4ae5d61d3a0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:33.097173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:33.133023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd78c2-0969-4eb6-bf0f-a0be617a9d46 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:33.180079 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae572c-f6d7-4640-9b46-095ea0454131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:33.180988 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae572c-f6d7-4640-9b46-095ea0454131 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:33.181268 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae572c-f6d7-4640-9b46-095ea0454131 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:33.181536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae572c-f6d7-4640-9b46-095ea0454131 None admin] PATH_INFO: `/v3/users/81970857c96543c4ac8d8b12a1d8dab4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:33.183559 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae572c-f6d7-4640-9b46-095ea0454131 None admin] RBAC: Authorizing `identity:get_user(user_id=81970857c96543c4ac8d8b12a1d8dab4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:33.185029 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae572c-f6d7-4640-9b46-095ea0454131 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:33.186890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 185/359] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:54:32 2022] GET /identity/v3/users/81970857c96543c4ac8d8b12a1d8dab4 => generated 293 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:33.187891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98116f15-1da2-4144-962c-4261ebac9e69 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:33.188208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98116f15-1da2-4144-962c-4261ebac9e69 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:33.188609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98116f15-1da2-4144-962c-4261ebac9e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:33.211766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-98116f15-1da2-4144-962c-4261ebac9e69 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:33.212966 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-98116f15-1da2-4144-962c-4261ebac9e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:33.231012 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d5cd0-532b-4131-9387-a4ae5d61d3a0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:33.276897 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c799d4a-d7a1-401a-a440-a4dac566c53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:33.277577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c799d4a-d7a1-401a-a440-a4dac566c53d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:33.277910 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c799d4a-d7a1-401a-a440-a4dac566c53d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:33.278188 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c799d4a-d7a1-401a-a440-a4dac566c53d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:33.304457 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 186/360] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:33.304867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98116f15-1da2-4144-962c-4261ebac9e69 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:33.322800 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:33.378170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c799d4a-d7a1-401a-a440-a4dac566c53d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:33.380862 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c799d4a-d7a1-401a-a440-a4dac566c53d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:33.386358 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:33.427715 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98116f15-1da2-4144-962c-4261ebac9e69 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:33.483246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a209c-5129-4133-8f45-18421b8decd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:33.484709 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a209c-5129-4133-8f45-18421b8decd5 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:33.485366 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a209c-5129-4133-8f45-18421b8decd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:33.486595 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a209c-5129-4133-8f45-18421b8decd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:33.489137 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a209c-5129-4133-8f45-18421b8decd5 None admin] RBAC: Adding query filter params (group.id=9fdf21fe474b46c2a7f5888244d8a1a4, role.id=7f252cd3de7047e396a0daf6e7d4d2ee, scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:33.489137 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a209c-5129-4133-8f45-18421b8decd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:33.489137 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a209c-5129-4133-8f45-18421b8decd5 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:33.496338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 187/361] 10.222.0.61 () {56 vars in 1376 bytes} [Thu May 26 20:54:33 2022] GET /identity/v3/role_assignments?group.id=9fdf21fe474b46c2a7f5888244d8a1a4&scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef&role.id=7f252cd3de7047e396a0daf6e7d4d2ee => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:33.498077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea72a30-cdc5-44b7-8f84-5b09366b9ada None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:33.498595 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea72a30-cdc5-44b7-8f84-5b09366b9ada None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:33.499077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea72a30-cdc5-44b7-8f84-5b09366b9ada None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:33.500829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 188/362] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:33.502888 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea72a30-cdc5-44b7-8f84-5b09366b9ada None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:33.532740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 175/363] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:33.533633 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c799d4a-d7a1-401a-a440-a4dac566c53d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:33.638275 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:33.652911 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c799d4a-d7a1-401a-a440-a4dac566c53d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:33.654945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:33.663104 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea72a30-cdc5-44b7-8f84-5b09366b9ada None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:33.694123 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf212c2-b084-4c57-8762-7ba8936b5033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:33.694968 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf212c2-b084-4c57-8762-7ba8936b5033 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:33.695247 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf212c2-b084-4c57-8762-7ba8936b5033 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:33.695515 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf212c2-b084-4c57-8762-7ba8936b5033 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:33.707615 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf212c2-b084-4c57-8762-7ba8936b5033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:33.709430 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6387c-f535-4506-8c3e-13643db50915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:33.710742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6387c-f535-4506-8c3e-13643db50915 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:33.711574 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6387c-f535-4506-8c3e-13643db50915 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:33.712092 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6387c-f535-4506-8c3e-13643db50915 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:33.713134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6387c-f535-4506-8c3e-13643db50915 None admin] RBAC: Adding query filter params (role.id=f6f2b0e067fd4b899c78b84b53d3922c, user.id=81970857c96543c4ac8d8b12a1d8dab4, scope.system=all) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:33.713647 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6387c-f535-4506-8c3e-13643db50915 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:33.715373 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6387c-f535-4506-8c3e-13643db50915 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:33.717262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ebf212c2-b084-4c57-8762-7ba8936b5033 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:33.717262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:33.717262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:33.717262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:33.717262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:33.717262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:33.717262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:33.717262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:33.717262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:33.717262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:33.717262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:33.717262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:33.717262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:33.717262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:33.717262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:33.717262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:33.718208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:33.718208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:33.718208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:33.718208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:33.718208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:33.718208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:33.718208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:33.718208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:33.718208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:33.718208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:33.718208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:33.718208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:33.718208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:33.718208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:33.718208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:33.718208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:33.719022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:33.719022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:33.719022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:33.719022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:33.719022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:33.719022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:33.719022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:33.719022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:33.719022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:33.719022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:33.719022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:33.719022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:33.719022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 176/364] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:54:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:33.720505 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82693a-7970-4d37-885a-4ed7031a776f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:33.720505 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82693a-7970-4d37-885a-4ed7031a776f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:33.720664 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82693a-7970-4d37-885a-4ed7031a776f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:33.736152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 189/365] 10.222.0.61 () {56 vars in 1308 bytes} [Thu May 26 20:54:33 2022] GET /identity/v3/role_assignments?user.id=81970857c96543c4ac8d8b12a1d8dab4&scope.system=all&role.id=f6f2b0e067fd4b899c78b84b53d3922c => generated 510 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:33.737353 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6387c-f535-4506-8c3e-13643db50915 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:33.743426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bd82693a-7970-4d37-885a-4ed7031a776f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:33.744217 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bd82693a-7970-4d37-885a-4ed7031a776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:33.854818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 177/366] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:33.855828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82693a-7970-4d37-885a-4ed7031a776f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:33.945532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6387c-f535-4506-8c3e-13643db50915 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:33.983583 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ff095-bfcd-4a7c-b621-79712a68784a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:33.984531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff095-bfcd-4a7c-b621-79712a68784a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:33.984806 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff095-bfcd-4a7c-b621-79712a68784a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:33.985212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff095-bfcd-4a7c-b621-79712a68784a None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:33.990629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ff095-bfcd-4a7c-b621-79712a68784a None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:33.992118 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ff095-bfcd-4a7c-b621-79712a68784a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:33.993910 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 190/367] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:33 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:33.994675 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ff095-bfcd-4a7c-b621-79712a68784a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:34.008120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:34.026633 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:34.037390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82693a-7970-4d37-885a-4ed7031a776f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:34.077511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2f791-a02e-42fc-9e24-d46b778f36ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:34.078239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2f791-a02e-42fc-9e24-d46b778f36ee None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:34.078519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2f791-a02e-42fc-9e24-d46b778f36ee None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:34.078830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2f791-a02e-42fc-9e24-d46b778f36ee None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:34.079590 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2f791-a02e-42fc-9e24-d46b778f36ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:34.079891 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2f791-a02e-42fc-9e24-d46b778f36ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:34.081272 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2f791-a02e-42fc-9e24-d46b778f36ee None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:34.091617 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 178/368] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:54:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:34.092471 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2f791-a02e-42fc-9e24-d46b778f36ee None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:34.115925 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ff095-bfcd-4a7c-b621-79712a68784a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:34.153228 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529445f-284e-48d5-badf-ad13e452f309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:34.154082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529445f-284e-48d5-badf-ad13e452f309 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:34.154371 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529445f-284e-48d5-badf-ad13e452f309 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:34.154649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529445f-284e-48d5-badf-ad13e452f309 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:34.166665 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529445f-284e-48d5-badf-ad13e452f309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:34.175089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-1529445f-284e-48d5-badf-ad13e452f309 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:54:34.175089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:34.175089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:34.175089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:34.175089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:34.175089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:34.175089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:34.175089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:34.175089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:34.175089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:34.175089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:34.175089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:34.175089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:34.175089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:34.175089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:34.175089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:34.177241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:34.177241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:34.177241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:34.177241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:34.177241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:34.177241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:34.177241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:34.177241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:34.177241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:34.177241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:34.177241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:34.177241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:34.177241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:34.177241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:34.177241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:34.177241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:34.179050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:34.179050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:34.179050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:34.179050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:34.179050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:34.179050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:34.179050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:34.179050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:34.179050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:34.179050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:34.179050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:54:34.179050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:34.179050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 191/369] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:54:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:34.179050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529445f-284e-48d5-badf-ad13e452f309 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:34.204169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2f791-a02e-42fc-9e24-d46b778f36ee None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:34.247519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94120d-e097-406e-947e-4bcce46d46aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:34.248555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94120d-e097-406e-947e-4bcce46d46aa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:34.248972 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94120d-e097-406e-947e-4bcce46d46aa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:34.249262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94120d-e097-406e-947e-4bcce46d46aa None admin] PATH_INFO: `/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:34.251540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94120d-e097-406e-947e-4bcce46d46aa None admin] RBAC: Authorizing `identity:get_group(group_id=9fdf21fe474b46c2a7f5888244d8a1a4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:34.253303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94120d-e097-406e-947e-4bcce46d46aa None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:34.254501 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:34.255441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 179/370] 10.222.0.61 () {56 vars in 1180 bytes} [Thu May 26 20:54:34 2022] GET /identity/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:34.256336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94120d-e097-406e-947e-4bcce46d46aa None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:34.288718 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:34.307506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529445f-284e-48d5-badf-ad13e452f309 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:34.350206 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e54bf-11a8-4be7-8c99-be5eabca13de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:34.351309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e54bf-11a8-4be7-8c99-be5eabca13de None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:34.351687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e54bf-11a8-4be7-8c99-be5eabca13de None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:34.352030 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e54bf-11a8-4be7-8c99-be5eabca13de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:34.380553 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94120d-e097-406e-947e-4bcce46d46aa None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:34.422609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d2c6a-f706-4a0e-a3ed-06e80c661ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:34.423419 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d2c6a-f706-4a0e-a3ed-06e80c661ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:34.423703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d2c6a-f706-4a0e-a3ed-06e80c661ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:34.423976 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d2c6a-f706-4a0e-a3ed-06e80c661ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:34.425173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d2c6a-f706-4a0e-a3ed-06e80c661ea9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:34.425488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d2c6a-f706-4a0e-a3ed-06e80c661ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:34.427159 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d2c6a-f706-4a0e-a3ed-06e80c661ea9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:34.432750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e54bf-11a8-4be7-8c99-be5eabca13de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:34.434526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e54bf-11a8-4be7-8c99-be5eabca13de None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:34.436914 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 180/371] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:34.438337 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d2c6a-f706-4a0e-a3ed-06e80c661ea9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:34.526271 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:34.541285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:34.554712 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 192/372] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:34.555780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e54bf-11a8-4be7-8c99-be5eabca13de None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:34.560550 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d2c6a-f706-4a0e-a3ed-06e80c661ea9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:34.598519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa315f2-4d12-4965-9b39-d1b9d4f980ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:34.599311 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa315f2-4d12-4965-9b39-d1b9d4f980ac None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:34.599311 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa315f2-4d12-4965-9b39-d1b9d4f980ac None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:34.599571 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa315f2-4d12-4965-9b39-d1b9d4f980ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:34.600442 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa315f2-4d12-4965-9b39-d1b9d4f980ac None admin] RBAC: Adding query filter params (group.id=9fdf21fe474b46c2a7f5888244d8a1a4, role.id=3695c157587346198902d1f6ec05153a, scope.project.id=839fd844cfbb442e8202597c69e6bbee) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:34.600786 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa315f2-4d12-4965-9b39-d1b9d4f980ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:34.602794 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa315f2-4d12-4965-9b39-d1b9d4f980ac None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:34.611084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 181/373] 10.222.0.61 () {56 vars in 1376 bytes} [Thu May 26 20:54:34 2022] GET /identity/v3/role_assignments?group.id=9fdf21fe474b46c2a7f5888244d8a1a4&scope.project.id=839fd844cfbb442e8202597c69e6bbee&role.id=3695c157587346198902d1f6ec05153a => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:34.611903 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa315f2-4d12-4965-9b39-d1b9d4f980ac None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:34.698610 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e54bf-11a8-4be7-8c99-be5eabca13de None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:34.722184 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa315f2-4d12-4965-9b39-d1b9d4f980ac None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:34.753176 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479df47-6c05-4a8c-98e3-ff35e641f0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:34.753988 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479df47-6c05-4a8c-98e3-ff35e641f0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:34.754274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479df47-6c05-4a8c-98e3-ff35e641f0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:34.754552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479df47-6c05-4a8c-98e3-ff35e641f0e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:34.760888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dd516-bdd7-461e-984f-b2b5d1f2777d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:34.760888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dd516-bdd7-461e-984f-b2b5d1f2777d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:34.760888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dd516-bdd7-461e-984f-b2b5d1f2777d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:34.760888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dd516-bdd7-461e-984f-b2b5d1f2777d None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:34.761664 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dd516-bdd7-461e-984f-b2b5d1f2777d None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:34.762927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dd516-bdd7-461e-984f-b2b5d1f2777d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:34.765818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 182/374] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:34 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:34.772399 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dd516-bdd7-461e-984f-b2b5d1f2777d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:34.794281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:34.813669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:34.865704 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479df47-6c05-4a8c-98e3-ff35e641f0e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:34.867474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479df47-6c05-4a8c-98e3-ff35e641f0e7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:34.888605 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dd516-bdd7-461e-984f-b2b5d1f2777d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:34.927977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d7954-ba98-4757-9ba7-3340b78680f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:34.928906 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d7954-ba98-4757-9ba7-3340b78680f5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:34.929299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d7954-ba98-4757-9ba7-3340b78680f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:34.929694 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d7954-ba98-4757-9ba7-3340b78680f5 None admin] PATH_INFO: `/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:34.931440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d7954-ba98-4757-9ba7-3340b78680f5 None admin] RBAC: Authorizing `identity:get_group(group_id=9fdf21fe474b46c2a7f5888244d8a1a4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:34.932949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d7954-ba98-4757-9ba7-3340b78680f5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:34.935513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 183/375] 10.222.0.61 () {56 vars in 1180 bytes} [Thu May 26 20:54:34 2022] GET /identity/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:34.941328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d7954-ba98-4757-9ba7-3340b78680f5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:35.013717 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 193/376] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:35.020769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479df47-6c05-4a8c-98e3-ff35e641f0e7 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:35.050394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:35.070043 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d7954-ba98-4757-9ba7-3340b78680f5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:35.110062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:35.123751 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce16ce0-6038-4476-81a2-bc68395f565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:35.125122 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce16ce0-6038-4476-81a2-bc68395f565d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:35.126087 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce16ce0-6038-4476-81a2-bc68395f565d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:35.126517 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce16ce0-6038-4476-81a2-bc68395f565d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:35.127766 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce16ce0-6038-4476-81a2-bc68395f565d None admin] RBAC: Adding query filter params (group.id=9fdf21fe474b46c2a7f5888244d8a1a4, role.id=3695c157587346198902d1f6ec05153a, scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:35.128217 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce16ce0-6038-4476-81a2-bc68395f565d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:35.130638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce16ce0-6038-4476-81a2-bc68395f565d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:35.139174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 184/377] 10.222.0.61 () {56 vars in 1376 bytes} [Thu May 26 20:54:34 2022] GET /identity/v3/role_assignments?group.id=9fdf21fe474b46c2a7f5888244d8a1a4&scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef&role.id=3695c157587346198902d1f6ec05153a => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:35.155259 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479df47-6c05-4a8c-98e3-ff35e641f0e7 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:35.196433 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d691ce4-5612-4895-8dec-8ba3e632c6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:35.197336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d691ce4-5612-4895-8dec-8ba3e632c6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:35.197624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d691ce4-5612-4895-8dec-8ba3e632c6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:35.197936 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d691ce4-5612-4895-8dec-8ba3e632c6f0 None admin] PATH_INFO: `/v3/projects/b75eb758e320488d94c4fcec41d7e80a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:35.199194 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d691ce4-5612-4895-8dec-8ba3e632c6f0 None admin] RBAC: Authorizing `identity:get_project(project_id=b75eb758e320488d94c4fcec41d7e80a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:35.200686 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d691ce4-5612-4895-8dec-8ba3e632c6f0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:35.202933 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 194/378] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:35 2022] GET /identity/v3/projects/b75eb758e320488d94c4fcec41d7e80a => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:35.209056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce16ce0-6038-4476-81a2-bc68395f565d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:35.330953 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce16ce0-6038-4476-81a2-bc68395f565d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:35.370023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3ad85-3fcc-4f77-b875-a6fc165406f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:35.371316 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3ad85-3fcc-4f77-b875-a6fc165406f5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:35.371816 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3ad85-3fcc-4f77-b875-a6fc165406f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:35.372294 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3ad85-3fcc-4f77-b875-a6fc165406f5 None admin] PATH_INFO: `/v3/groups/b9715982cd3846dd85dd88cae259e963` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:35.380311 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3ad85-3fcc-4f77-b875-a6fc165406f5 None admin] RBAC: Authorizing `identity:get_group(group_id=b9715982cd3846dd85dd88cae259e963)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:35.382307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3ad85-3fcc-4f77-b875-a6fc165406f5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:35.384855 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 185/379] 10.222.0.61 () {56 vars in 1180 bytes} [Thu May 26 20:54:35 2022] GET /identity/v3/groups/b9715982cd3846dd85dd88cae259e963 => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:35.391415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d691ce4-5612-4895-8dec-8ba3e632c6f0 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:35.556068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d691ce4-5612-4895-8dec-8ba3e632c6f0 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:35.571667 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976da8c3-b287-4f60-b47b-47c8cdff29eb None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:35.572274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976da8c3-b287-4f60-b47b-47c8cdff29eb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:35.572761 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976da8c3-b287-4f60-b47b-47c8cdff29eb None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:35.574634 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 186/380] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:35.583330 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db256c5-30d6-4844-aa92-008e674d6ec2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:35.583835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db256c5-30d6-4844-aa92-008e674d6ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:35.584115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db256c5-30d6-4844-aa92-008e674d6ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:35.604041 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86456e-f1dd-4b8f-835b-fd376a8f36a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:35.604735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86456e-f1dd-4b8f-835b-fd376a8f36a5 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:35.605067 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86456e-f1dd-4b8f-835b-fd376a8f36a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:35.605347 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86456e-f1dd-4b8f-835b-fd376a8f36a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:35.606230 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86456e-f1dd-4b8f-835b-fd376a8f36a5 None admin] RBAC: Adding query filter params (group.id=b9715982cd3846dd85dd88cae259e963, role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=b75eb758e320488d94c4fcec41d7e80a) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:35.606596 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86456e-f1dd-4b8f-835b-fd376a8f36a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:35.608023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0db256c5-30d6-4844-aa92-008e674d6ec2 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:35.608133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86456e-f1dd-4b8f-835b-fd376a8f36a5 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:35.609207 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0db256c5-30d6-4844-aa92-008e674d6ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:35.610274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:35.615656 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 195/381] 10.222.0.61 () {56 vars in 1376 bytes} [Thu May 26 20:54:35 2022] GET /identity/v3/role_assignments?group.id=b9715982cd3846dd85dd88cae259e963&scope.project.id=b75eb758e320488d94c4fcec41d7e80a&role.id=aefba81d87bf47258c17064af7d9a05f => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:35.621941 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:35.702928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 187/382] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:35.740006 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86456e-f1dd-4b8f-835b-fd376a8f36a5 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:35.857674 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86456e-f1dd-4b8f-835b-fd376a8f36a5 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:35.897827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b726124-e32d-449e-8716-ce4a785d32dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:35.898668 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b726124-e32d-449e-8716-ce4a785d32dc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:35.898950 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b726124-e32d-449e-8716-ce4a785d32dc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:35.899226 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b726124-e32d-449e-8716-ce4a785d32dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:35.912761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b726124-e32d-449e-8716-ce4a785d32dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:35.920563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-3b726124-e32d-449e-8716-ce4a785d32dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:35.920563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:35.920563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:35.920563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:35.920563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:35.920563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:35.920563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:35.920563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:35.920563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:35.920563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:35.920563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:35.920563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:35.920563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:35.920563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:35.920563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:35.920563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:35.921429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:35.921429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:35.921429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:35.921429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:35.921429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:35.921429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:35.921429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:35.921429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:35.921429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:35.921429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:35.921429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:35.921429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:35.921429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:35.921429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:35.921429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:35.921429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:35.922325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:35.922325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:35.922325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:35.922325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:35.922325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:35.922325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:35.922325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:35.922325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:35.922325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:35.922325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:35.922325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:35.922325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:35.922325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 196/383] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:35.927868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db256c5-30d6-4844-aa92-008e674d6ec2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:36.076560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db256c5-30d6-4844-aa92-008e674d6ec2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:36.118977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce135ae-dd9a-4243-9a53-e2b3dfcf0920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:36.119895 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce135ae-dd9a-4243-9a53-e2b3dfcf0920 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:36.120311 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce135ae-dd9a-4243-9a53-e2b3dfcf0920 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:36.120727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce135ae-dd9a-4243-9a53-e2b3dfcf0920 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:36.121609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce135ae-dd9a-4243-9a53-e2b3dfcf0920 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:36.122077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce135ae-dd9a-4243-9a53-e2b3dfcf0920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:36.123615 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce135ae-dd9a-4243-9a53-e2b3dfcf0920 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:36.139106 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 188/384] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:36.145435 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b726124-e32d-449e-8716-ce4a785d32dc None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:36.256857 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:36.307397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b726124-e32d-449e-8716-ce4a785d32dc None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:36.347275 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743350c-5d75-45c3-a810-c448e49e1085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:36.348164 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743350c-5d75-45c3-a810-c448e49e1085 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:36.348446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743350c-5d75-45c3-a810-c448e49e1085 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:36.348718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743350c-5d75-45c3-a810-c448e49e1085 None admin] PATH_INFO: `/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:36.349946 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743350c-5d75-45c3-a810-c448e49e1085 None admin] RBAC: Authorizing `identity:get_group(group_id=9fdf21fe474b46c2a7f5888244d8a1a4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:36.351436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743350c-5d75-45c3-a810-c448e49e1085 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:36.353410 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 197/385] 10.222.0.61 () {56 vars in 1180 bytes} [Thu May 26 20:54:36 2022] GET /identity/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:36.358670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce135ae-dd9a-4243-9a53-e2b3dfcf0920 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:36.379904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:36.446990 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1d87d-35db-4fbb-8e65-05969bbd5957 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:36.447279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1d87d-35db-4fbb-8e65-05969bbd5957 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:36.447563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1d87d-35db-4fbb-8e65-05969bbd5957 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:36.449249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 198/386] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:54:36.455629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff06adb-3ecb-469e-b69e-c27e98c4de8c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:36.455917 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff06adb-3ecb-469e-b69e-c27e98c4de8c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:36.456196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff06adb-3ecb-469e-b69e-c27e98c4de8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:36.477674 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-eff06adb-3ecb-469e-b69e-c27e98c4de8c None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:36.478922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-eff06adb-3ecb-469e-b69e-c27e98c4de8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:36.518954 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce135ae-dd9a-4243-9a53-e2b3dfcf0920 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:36.560205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a76c0d-c08d-463b-b368-f83f85d7448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:36.561367 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a76c0d-c08d-463b-b368-f83f85d7448d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:36.561820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a76c0d-c08d-463b-b368-f83f85d7448d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:36.562228 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a76c0d-c08d-463b-b368-f83f85d7448d None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:36.568316 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a76c0d-c08d-463b-b368-f83f85d7448d None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:36.570013 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a76c0d-c08d-463b-b368-f83f85d7448d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:36.572127 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 189/387] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:36 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:36.580029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a76c0d-c08d-463b-b368-f83f85d7448d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:36.628057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 199/388] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:36.662785 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff06adb-3ecb-469e-b69e-c27e98c4de8c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:36.672820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:36.718968 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a76c0d-c08d-463b-b368-f83f85d7448d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:36.776699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:36.812173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927556eb-6b51-46d1-8173-e84ab9f9026c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:36.813644 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927556eb-6b51-46d1-8173-e84ab9f9026c None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:36.814456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927556eb-6b51-46d1-8173-e84ab9f9026c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:36.814743 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927556eb-6b51-46d1-8173-e84ab9f9026c None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee/groups/9fdf21fe474b46c2a7f5888244d8a1a4/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:36.818495 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927556eb-6b51-46d1-8173-e84ab9f9026c None admin] RBAC: Authorizing `identity:create_grant(project_id=839fd844cfbb442e8202597c69e6bbee, group_id=9fdf21fe474b46c2a7f5888244d8a1a4, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:36.821306 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927556eb-6b51-46d1-8173-e84ab9f9026c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:36.840740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 190/389] 10.222.0.61 () {58 vars in 1442 bytes} [Thu May 26 20:54:36 2022] PUT /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee/groups/9fdf21fe474b46c2a7f5888244d8a1a4/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:54:36.850257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff06adb-3ecb-469e-b69e-c27e98c4de8c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:36.923272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d0cf4-c660-4c37-83c3-2a24457ca14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:36.923918 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d0cf4-c660-4c37-83c3-2a24457ca14a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:36.923918 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d0cf4-c660-4c37-83c3-2a24457ca14a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:36.924159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d0cf4-c660-4c37-83c3-2a24457ca14a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:36.938988 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d0cf4-c660-4c37-83c3-2a24457ca14a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:36.946727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-604d0cf4-c660-4c37-83c3-2a24457ca14a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:36.946727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:36.946727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:36.946727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:36.946727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:36.946727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:36.946727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:36.946727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:36.946727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:36.946727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:36.946727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:36.946727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:36.946727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:36.946727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:36.946727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:36.946727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:36.947639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:36.947639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:36.947639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:36.947639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:36.947639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:36.947639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:36.947639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:36.947639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:36.947639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:36.947639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:36.947639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:36.947639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:36.947639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:36.947639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:36.947639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:36.947639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:36.948809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:36.948809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:36.948809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:36.948809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:36.948809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:36.948809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:36.948809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:36.948809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:36.948809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:36.948809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:36.948809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:36.948809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:36.948809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 200/390] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:36.956603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927556eb-6b51-46d1-8173-e84ab9f9026c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:37.099795 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927556eb-6b51-46d1-8173-e84ab9f9026c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:37.132524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:37.141768 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481356fe-323a-4a55-8461-840cf4c590d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:37.142427 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481356fe-323a-4a55-8461-840cf4c590d7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:37.143128 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481356fe-323a-4a55-8461-840cf4c590d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:37.143807 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481356fe-323a-4a55-8461-840cf4c590d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:37.145247 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481356fe-323a-4a55-8461-840cf4c590d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:37.145856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481356fe-323a-4a55-8461-840cf4c590d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:37.147293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481356fe-323a-4a55-8461-840cf4c590d7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:37.158359 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 191/391] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:37.164066 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d0cf4-c660-4c37-83c3-2a24457ca14a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:37.289353 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d0cf4-c660-4c37-83c3-2a24457ca14a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:37.306768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:37.331862 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964d707-5163-4ac5-a9da-5c8389a43061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:37.332753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964d707-5163-4ac5-a9da-5c8389a43061 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:37.333031 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964d707-5163-4ac5-a9da-5c8389a43061 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:37.333419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964d707-5163-4ac5-a9da-5c8389a43061 None admin] PATH_INFO: `/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:37.334647 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964d707-5163-4ac5-a9da-5c8389a43061 None admin] RBAC: Authorizing `identity:get_group(group_id=9fdf21fe474b46c2a7f5888244d8a1a4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:37.336647 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964d707-5163-4ac5-a9da-5c8389a43061 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:37.338657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 201/392] 10.222.0.61 () {56 vars in 1180 bytes} [Thu May 26 20:54:37 2022] GET /identity/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:37.344500 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481356fe-323a-4a55-8461-840cf4c590d7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:37.455231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481356fe-323a-4a55-8461-840cf4c590d7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:37.504312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8e712-dc85-49ae-9d4e-b38f8d8e68f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:37.505259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8e712-dc85-49ae-9d4e-b38f8d8e68f1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:37.505544 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8e712-dc85-49ae-9d4e-b38f8d8e68f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:37.505832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8e712-dc85-49ae-9d4e-b38f8d8e68f1 None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:37.507092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8e712-dc85-49ae-9d4e-b38f8d8e68f1 None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:37.508544 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8e712-dc85-49ae-9d4e-b38f8d8e68f1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:37.510307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 192/393] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:37 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:37.516196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964d707-5163-4ac5-a9da-5c8389a43061 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:37.637899 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964d707-5163-4ac5-a9da-5c8389a43061 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:37.686528 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbde23-1f45-420b-9eba-27856963abb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:37.687452 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbde23-1f45-420b-9eba-27856963abb2 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:37.687739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbde23-1f45-420b-9eba-27856963abb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:37.688058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbde23-1f45-420b-9eba-27856963abb2 None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef/groups/9fdf21fe474b46c2a7f5888244d8a1a4/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:37.690168 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbde23-1f45-420b-9eba-27856963abb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=bae39b4f40ce46c7af4ffe6265f259ef, group_id=9fdf21fe474b46c2a7f5888244d8a1a4, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:37.691644 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbde23-1f45-420b-9eba-27856963abb2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:37.727659 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 202/394] 10.222.0.61 () {58 vars in 1442 bytes} [Thu May 26 20:54:37 2022] PUT /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef/groups/9fdf21fe474b46c2a7f5888244d8a1a4/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:54:38.113841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cee600-a971-43a7-967d-f4ca75d2731b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:38.113841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cee600-a971-43a7-967d-f4ca75d2731b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:38.113841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cee600-a971-43a7-967d-f4ca75d2731b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:38.115791 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 193/395] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:38.117670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8d152-48b2-4fc6-b1ad-5e81e83e9522 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:38.118479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8d152-48b2-4fc6-b1ad-5e81e83e9522 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:38.118955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8d152-48b2-4fc6-b1ad-5e81e83e9522 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:38.122073 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad541d22-48d2-47f2-8115-10525438fdfa None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:38.122362 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad541d22-48d2-47f2-8115-10525438fdfa None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:38.122638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad541d22-48d2-47f2-8115-10525438fdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:38.126233 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 203/396] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:38.131793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965a593-1f5c-4707-a065-e528a026dc45 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:38.132083 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965a593-1f5c-4707-a065-e528a026dc45 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:38.132360 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965a593-1f5c-4707-a065-e528a026dc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:38.140264 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ad541d22-48d2-47f2-8115-10525438fdfa None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:38.141591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ad541d22-48d2-47f2-8115-10525438fdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:38.155756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6965a593-1f5c-4707-a065-e528a026dc45 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:38.157077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6965a593-1f5c-4707-a065-e528a026dc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:38.240120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:38.265851 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:38.285361 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 194/397] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:38.299538 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 204/398] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:38.306790 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad541d22-48d2-47f2-8115-10525438fdfa None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:38.329243 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965a593-1f5c-4707-a065-e528a026dc45 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:38.475688 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad541d22-48d2-47f2-8115-10525438fdfa None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:38.515816 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965a593-1f5c-4707-a065-e528a026dc45 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:38.553297 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d79e9-edba-4823-8509-a9c429f7d17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:38.554164 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d79e9-edba-4823-8509-a9c429f7d17d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:38.554444 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d79e9-edba-4823-8509-a9c429f7d17d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:38.554716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d79e9-edba-4823-8509-a9c429f7d17d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:38.566509 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d79e9-edba-4823-8509-a9c429f7d17d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:38.574650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e72d79e9-edba-4823-8509-a9c429f7d17d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:38.574650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:38.574650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:38.574650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:38.574650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:38.574650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:38.574650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:38.574650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:38.574650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:38.574650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:38.574650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:38.574650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:38.574650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:38.574650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:38.574650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:38.574650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:38.575513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:38.575513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:38.575513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:38.575513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:38.575513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:38.575513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:38.575513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:38.575513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:38.575513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:38.575513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:38.575513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:38.575513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:38.575513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:38.575513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:38.575513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:38.575513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:38.576733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:38.576733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:38.576733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:38.576733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:38.576733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:38.576733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:38.576733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:38.576733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:38.576733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:38.576733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:38.576733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:38.576733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:38.576733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 195/399] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:54:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:38.581851 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d79e9-edba-4823-8509-a9c429f7d17d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:38.586255 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb40be4-b11d-4072-938e-d57318a933bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:38.587082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb40be4-b11d-4072-938e-d57318a933bc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:38.587370 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb40be4-b11d-4072-938e-d57318a933bc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:38.587650 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb40be4-b11d-4072-938e-d57318a933bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:38.612870 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb40be4-b11d-4072-938e-d57318a933bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:38.628211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-8bb40be4-b11d-4072-938e-d57318a933bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:38.628211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:38.628211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:38.628211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:38.628211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:38.628211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:38.628211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:38.628211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:38.628211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:38.628211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:38.628211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:38.628211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:38.628211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:38.628211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:38.628211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:38.628211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:38.629145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:38.629145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:38.629145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:38.629145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:38.629145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:38.629145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:38.629145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:38.629145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:38.629145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:38.629145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:38.629145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:38.629145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:38.629145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:38.629145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:38.629145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:38.629145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:38.629959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:38.629959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:38.629959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:38.629959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:38.629959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:38.629959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:38.629959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:38.629959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:38.629959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:38.629959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:38.629959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:38.629959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:38.632073 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 205/400] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:54:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:38.640395 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb40be4-b11d-4072-938e-d57318a933bc None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:38.674595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:38.722180 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:38.744194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d79e9-edba-4823-8509-a9c429f7d17d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:38.778193 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb40be4-b11d-4072-938e-d57318a933bc None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:38.799864 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cb167-12ab-4bd3-8968-2a412d2ffc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:38.800891 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cb167-12ab-4bd3-8968-2a412d2ffc2d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:38.801402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cb167-12ab-4bd3-8968-2a412d2ffc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:38.801911 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cb167-12ab-4bd3-8968-2a412d2ffc2d None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:38.803374 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cb167-12ab-4bd3-8968-2a412d2ffc2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:38.804108 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cb167-12ab-4bd3-8968-2a412d2ffc2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:38.806351 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cb167-12ab-4bd3-8968-2a412d2ffc2d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:38.818305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125c0bc-ea53-479a-9692-100e099f10a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:38.818663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 196/401] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:54:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:38.819116 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125c0bc-ea53-479a-9692-100e099f10a5 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:38.819463 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125c0bc-ea53-479a-9692-100e099f10a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:38.819805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125c0bc-ea53-479a-9692-100e099f10a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:38.820630 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125c0bc-ea53-479a-9692-100e099f10a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:38.820999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125c0bc-ea53-479a-9692-100e099f10a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:38.821240 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58413743-0ca8-44f3-a4e7-e154ea562594 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:38.821693 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58413743-0ca8-44f3-a4e7-e154ea562594 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:38.822220 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58413743-0ca8-44f3-a4e7-e154ea562594 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:38.822723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125c0bc-ea53-479a-9692-100e099f10a5 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:38.824459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 197/402] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:38.825387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58413743-0ca8-44f3-a4e7-e154ea562594 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:38.845326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 206/403] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:54:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:38.845326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824c521-ad04-4145-9a93-35f2fd340726 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:38.845326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824c521-ad04-4145-9a93-35f2fd340726 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:38.845326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824c521-ad04-4145-9a93-35f2fd340726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:38.862549 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2824c521-ad04-4145-9a93-35f2fd340726 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:38.864430 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2824c521-ad04-4145-9a93-35f2fd340726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:38.948785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58413743-0ca8-44f3-a4e7-e154ea562594 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:38.952674 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 207/404] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:38.954068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824c521-ad04-4145-9a93-35f2fd340726 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:38.978733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:38.993294 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:39.002293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaf7f2-552a-4f6d-9e4b-2f5e6293db28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:39.004175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaf7f2-552a-4f6d-9e4b-2f5e6293db28 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:39.004662 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaf7f2-552a-4f6d-9e4b-2f5e6293db28 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:39.005114 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaf7f2-552a-4f6d-9e4b-2f5e6293db28 None admin] PATH_INFO: `/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:39.006533 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aaf7f2-552a-4f6d-9e4b-2f5e6293db28 None admin] RBAC: Authorizing `identity:get_group(group_id=9fdf21fe474b46c2a7f5888244d8a1a4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:39.008620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aaf7f2-552a-4f6d-9e4b-2f5e6293db28 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:39.010875 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 198/405] 10.222.0.61 () {56 vars in 1180 bytes} [Thu May 26 20:54:38 2022] GET /identity/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:39.012289 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaf7f2-552a-4f6d-9e4b-2f5e6293db28 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:39.093646 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824c521-ad04-4145-9a93-35f2fd340726 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:39.129215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50296b-ffb3-46ed-95d7-c7eda7709440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:39.130161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50296b-ffb3-46ed-95d7-c7eda7709440 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:39.130437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50296b-ffb3-46ed-95d7-c7eda7709440 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:39.130708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50296b-ffb3-46ed-95d7-c7eda7709440 None admin] PATH_INFO: `/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:39.131907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50296b-ffb3-46ed-95d7-c7eda7709440 None admin] RBAC: Authorizing `identity:get_group(group_id=9fdf21fe474b46c2a7f5888244d8a1a4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:39.133362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50296b-ffb3-46ed-95d7-c7eda7709440 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:39.139461 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 208/406] 10.222.0.61 () {56 vars in 1180 bytes} [Thu May 26 20:54:38 2022] GET /identity/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:39.139461 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50296b-ffb3-46ed-95d7-c7eda7709440 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:39.140159 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaf7f2-552a-4f6d-9e4b-2f5e6293db28 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:39.180479 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbf2d2-62ea-4d04-926c-b1b4a219a8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:39.181931 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbf2d2-62ea-4d04-926c-b1b4a219a8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:39.182360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbf2d2-62ea-4d04-926c-b1b4a219a8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:39.183080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbf2d2-62ea-4d04-926c-b1b4a219a8d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:39.197175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbf2d2-62ea-4d04-926c-b1b4a219a8d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:39.207923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d6bbf2d2-62ea-4d04-926c-b1b4a219a8d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:54:39.207923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:39.207923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:39.207923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:39.207923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:39.207923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:39.207923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:39.207923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:39.207923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:39.207923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:39.207923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:39.207923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:39.207923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:39.207923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:39.207923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:39.207923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:39.209068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:39.209068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:39.209068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:39.209068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:39.209068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:39.209068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:39.209068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:39.209068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:39.209068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:39.209068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:39.209068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:39.209068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:39.209068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:39.209068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:39.209068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:39.209068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:39.210083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:39.210083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:39.210083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:39.210083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:39.210083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:39.210083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:39.210083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:39.210083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:39.210083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:39.210083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:39.210083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:54:39.210083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:39.213304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 199/407] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:54:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:39.214472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbf2d2-62ea-4d04-926c-b1b4a219a8d2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:39.245613 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:39.253338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50296b-ffb3-46ed-95d7-c7eda7709440 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:39.262828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:39.291170 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d398c3-62a4-408c-94e3-d2072a50120f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:39.292337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d398c3-62a4-408c-94e3-d2072a50120f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:39.292676 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d398c3-62a4-408c-94e3-d2072a50120f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:39.293089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d398c3-62a4-408c-94e3-d2072a50120f None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:39.294553 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d398c3-62a4-408c-94e3-d2072a50120f None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:39.296127 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d398c3-62a4-408c-94e3-d2072a50120f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:39.298601 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 209/408] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:39 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:39.299621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d398c3-62a4-408c-94e3-d2072a50120f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:39.326170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbf2d2-62ea-4d04-926c-b1b4a219a8d2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:39.363318 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0877bcc-9e2c-4a40-a704-490eb823fbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:39.364598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0877bcc-9e2c-4a40-a704-490eb823fbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:39.365356 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0877bcc-9e2c-4a40-a704-490eb823fbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:39.365822 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0877bcc-9e2c-4a40-a704-490eb823fbb3 None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:39.367612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0877bcc-9e2c-4a40-a704-490eb823fbb3 None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:39.369844 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0877bcc-9e2c-4a40-a704-490eb823fbb3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:39.372071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 200/409] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:39 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:39.373540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0877bcc-9e2c-4a40-a704-490eb823fbb3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:39.419969 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d398c3-62a4-408c-94e3-d2072a50120f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:39.474078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71944c-41e2-4fb6-b4b5-8dadb3554bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:39.475721 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71944c-41e2-4fb6-b4b5-8dadb3554bac None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:39.476152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71944c-41e2-4fb6-b4b5-8dadb3554bac None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:39.476571 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71944c-41e2-4fb6-b4b5-8dadb3554bac None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:39.477586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71944c-41e2-4fb6-b4b5-8dadb3554bac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:39.478056 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71944c-41e2-4fb6-b4b5-8dadb3554bac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:39.480210 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71944c-41e2-4fb6-b4b5-8dadb3554bac None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:39.491549 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 210/410] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:39.492648 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71944c-41e2-4fb6-b4b5-8dadb3554bac None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:39.497248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0877bcc-9e2c-4a40-a704-490eb823fbb3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:39.509302 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:39.524166 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:39.536767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749993b-e164-4400-af5c-eae100bc7f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:39.537706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749993b-e164-4400-af5c-eae100bc7f58 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:39.538079 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749993b-e164-4400-af5c-eae100bc7f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:39.538936 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749993b-e164-4400-af5c-eae100bc7f58 None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef/groups/9fdf21fe474b46c2a7f5888244d8a1a4/roles/3695c157587346198902d1f6ec05153a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:39.541273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749993b-e164-4400-af5c-eae100bc7f58 None admin] RBAC: Authorizing `identity:create_grant(project_id=bae39b4f40ce46c7af4ffe6265f259ef, group_id=9fdf21fe474b46c2a7f5888244d8a1a4, role_id=3695c157587346198902d1f6ec05153a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:39.543106 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749993b-e164-4400-af5c-eae100bc7f58 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:39.564551 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 201/411] 10.222.0.61 () {58 vars in 1442 bytes} [Thu May 26 20:54:39 2022] PUT /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef/groups/9fdf21fe474b46c2a7f5888244d8a1a4/roles/3695c157587346198902d1f6ec05153a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:54:39.565867 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749993b-e164-4400-af5c-eae100bc7f58 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:39.620134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71944c-41e2-4fb6-b4b5-8dadb3554bac None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:39.671097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a3608-574a-43e8-a538-6ed7461fea54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:39.672837 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a3608-574a-43e8-a538-6ed7461fea54 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:39.673900 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a3608-574a-43e8-a538-6ed7461fea54 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:39.674376 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a3608-574a-43e8-a538-6ed7461fea54 None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee/groups/9fdf21fe474b46c2a7f5888244d8a1a4/roles/3695c157587346198902d1f6ec05153a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:39.677331 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a3608-574a-43e8-a538-6ed7461fea54 None admin] RBAC: Authorizing `identity:create_grant(project_id=839fd844cfbb442e8202597c69e6bbee, group_id=9fdf21fe474b46c2a7f5888244d8a1a4, role_id=3695c157587346198902d1f6ec05153a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:39.679118 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a3608-574a-43e8-a538-6ed7461fea54 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:39.699812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 211/412] 10.222.0.61 () {58 vars in 1442 bytes} [Thu May 26 20:54:39 2022] PUT /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee/groups/9fdf21fe474b46c2a7f5888244d8a1a4/roles/3695c157587346198902d1f6ec05153a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:54:39.700004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749993b-e164-4400-af5c-eae100bc7f58 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:39.701690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78eb9-78d6-46d5-bff4-a61834c30dd8 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:39.702466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78eb9-78d6-46d5-bff4-a61834c30dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:39.702954 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78eb9-78d6-46d5-bff4-a61834c30dd8 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:39.707125 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 212/413] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:39.712990 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf732aa4-ffe6-4e6f-9b0e-51b239e580f2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:39.714232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf732aa4-ffe6-4e6f-9b0e-51b239e580f2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:39.714729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf732aa4-ffe6-4e6f-9b0e-51b239e580f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:39.741482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-bf732aa4-ffe6-4e6f-9b0e-51b239e580f2 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:39.743040 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bf732aa4-ffe6-4e6f-9b0e-51b239e580f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:39.745744 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cff725-3b38-45fc-8b5f-1cdaf14290b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:39.747425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cff725-3b38-45fc-8b5f-1cdaf14290b2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:39.747425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cff725-3b38-45fc-8b5f-1cdaf14290b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:39.747594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cff725-3b38-45fc-8b5f-1cdaf14290b2 None admin] PATH_INFO: `/v3/groups/b9715982cd3846dd85dd88cae259e963` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:39.748937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cff725-3b38-45fc-8b5f-1cdaf14290b2 None admin] RBAC: Authorizing `identity:get_group(group_id=b9715982cd3846dd85dd88cae259e963)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:39.750633 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cff725-3b38-45fc-8b5f-1cdaf14290b2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:39.752517 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 202/414] 10.222.0.61 () {56 vars in 1180 bytes} [Thu May 26 20:54:39 2022] GET /identity/v3/groups/b9715982cd3846dd85dd88cae259e963 => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:39.761458 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cff725-3b38-45fc-8b5f-1cdaf14290b2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:39.823467 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:39.851223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 213/415] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:39.886023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf732aa4-ffe6-4e6f-9b0e-51b239e580f2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:39.904582 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:39.910256 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cff725-3b38-45fc-8b5f-1cdaf14290b2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:39.949570 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f757e04-a232-4bdf-b57d-d53512744413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:39.950499 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f757e04-a232-4bdf-b57d-d53512744413 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:39.950783 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f757e04-a232-4bdf-b57d-d53512744413 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:39.951062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f757e04-a232-4bdf-b57d-d53512744413 None admin] PATH_INFO: `/v3/projects/b75eb758e320488d94c4fcec41d7e80a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:39.952383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f757e04-a232-4bdf-b57d-d53512744413 None admin] RBAC: Authorizing `identity:get_project(project_id=b75eb758e320488d94c4fcec41d7e80a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:39.954598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f757e04-a232-4bdf-b57d-d53512744413 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:39.957943 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 203/416] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:39 2022] GET /identity/v3/projects/b75eb758e320488d94c4fcec41d7e80a => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:39.963482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f757e04-a232-4bdf-b57d-d53512744413 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:40.024926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf732aa4-ffe6-4e6f-9b0e-51b239e580f2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:40.073340 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf439d-d51c-4813-a93d-3c8f278582a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:40.074896 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf439d-d51c-4813-a93d-3c8f278582a0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:40.075447 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf439d-d51c-4813-a93d-3c8f278582a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:40.075865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf439d-d51c-4813-a93d-3c8f278582a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:40.090158 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf439d-d51c-4813-a93d-3c8f278582a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:40.097520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f757e04-a232-4bdf-b57d-d53512744413 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:40.100844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-23cf439d-d51c-4813-a93d-3c8f278582a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:40.100844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:40.100844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:40.100844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:40.100844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:40.100844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:40.100844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:40.100844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:40.100844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:40.100844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:40.100844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:40.100844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:40.100844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:40.100844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:40.100844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:40.100844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:40.102003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:40.102003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:40.102003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:40.102003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:40.102003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:40.102003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:40.102003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:40.102003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:40.102003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:40.102003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:40.102003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:40.102003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:40.102003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:40.102003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:40.102003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:40.102003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:40.102986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:40.102986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:40.102986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:40.102986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:40.102986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:40.102986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:40.102986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:40.102986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:40.102986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:40.102986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:40.102986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:40.102986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:40.105341 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 214/417] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:40.108621 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:40.112736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf439d-d51c-4813-a93d-3c8f278582a0 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:40.142471 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4974fc3-f3a8-4ab4-83da-6bb247ae147a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:40.143482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4974fc3-f3a8-4ab4-83da-6bb247ae147a None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:40.143827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4974fc3-f3a8-4ab4-83da-6bb247ae147a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:40.144166 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4974fc3-f3a8-4ab4-83da-6bb247ae147a None admin] PATH_INFO: `/v3/projects/b75eb758e320488d94c4fcec41d7e80a/groups/b9715982cd3846dd85dd88cae259e963/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:40.146236 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4974fc3-f3a8-4ab4-83da-6bb247ae147a None admin] RBAC: Authorizing `identity:create_grant(project_id=b75eb758e320488d94c4fcec41d7e80a, group_id=b9715982cd3846dd85dd88cae259e963, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:40.147875 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4974fc3-f3a8-4ab4-83da-6bb247ae147a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:40.199306 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:40.200440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 204/418] 10.222.0.61 () {58 vars in 1442 bytes} [Thu May 26 20:54:39 2022] PUT /identity/v3/projects/b75eb758e320488d94c4fcec41d7e80a/groups/b9715982cd3846dd85dd88cae259e963/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:54:40.230606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf439d-d51c-4813-a93d-3c8f278582a0 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:40.273537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e75498-4482-4dba-982a-ebf5c4441d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:40.274516 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e75498-4482-4dba-982a-ebf5c4441d83 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:40.274998 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e75498-4482-4dba-982a-ebf5c4441d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:40.275414 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e75498-4482-4dba-982a-ebf5c4441d83 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:40.276336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e75498-4482-4dba-982a-ebf5c4441d83 None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:40.276801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e75498-4482-4dba-982a-ebf5c4441d83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:40.278432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e75498-4482-4dba-982a-ebf5c4441d83 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:40.288627 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 215/419] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:40.294973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4974fc3-f3a8-4ab4-83da-6bb247ae147a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:40.461679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edfa1f-b003-42d2-b841-6f3dcb134c88 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:40.462063 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edfa1f-b003-42d2-b841-6f3dcb134c88 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:40.462278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edfa1f-b003-42d2-b841-6f3dcb134c88 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:40.464014 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 216/420] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:40.470960 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189121b5-a256-450d-b70a-b073c1aac832 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:40.471241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189121b5-a256-450d-b70a-b073c1aac832 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:40.471516 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189121b5-a256-450d-b70a-b073c1aac832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:40.491769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-189121b5-a256-450d-b70a-b073c1aac832 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:40.493135 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-189121b5-a256-450d-b70a-b073c1aac832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:40.532445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4974fc3-f3a8-4ab4-83da-6bb247ae147a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:40.577919 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013a191-c894-49e2-b873-275800144d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:40.578686 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013a191-c894-49e2-b873-275800144d95 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:40.578999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013a191-c894-49e2-b873-275800144d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:40.579236 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013a191-c894-49e2-b873-275800144d95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:40.586820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 217/421] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:40.610094 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189121b5-a256-450d-b70a-b073c1aac832 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:40.617071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:40.659808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013a191-c894-49e2-b873-275800144d95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:40.661400 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013a191-c894-49e2-b873-275800144d95 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:40.683901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:40.721306 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189121b5-a256-450d-b70a-b073c1aac832 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:40.761451 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3d720-2b3c-4bed-b2de-74fc89bfb964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:40.762397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3d720-2b3c-4bed-b2de-74fc89bfb964 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:40.762836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3d720-2b3c-4bed-b2de-74fc89bfb964 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:40.763189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3d720-2b3c-4bed-b2de-74fc89bfb964 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:40.775374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3d720-2b3c-4bed-b2de-74fc89bfb964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:40.783695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-4bc3d720-2b3c-4bed-b2de-74fc89bfb964 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:40.783695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:40.783695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:40.783695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:40.783695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:40.783695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:40.783695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:40.783695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:40.783695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:40.783695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:40.783695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:40.783695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:40.783695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:40.783695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:40.783695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:40.783695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:40.784735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:40.784735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:40.784735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:40.784735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:40.784735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:40.784735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:40.784735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:40.784735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:40.784735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:40.784735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:40.784735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:40.784735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:40.784735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:40.784735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:40.784735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:40.784735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:40.785737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:40.785737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:40.785737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:40.785737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:40.785737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:40.785737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:40.785737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:40.785737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:40.785737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:40.785737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:40.785737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 20:54:40.785737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:40.785737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 218/422] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:40.790963 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3d720-2b3c-4bed-b2de-74fc89bfb964 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:40.816713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 205/423] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:40.822858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013a191-c894-49e2-b873-275800144d95 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:40.950445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:40.963999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3d720-2b3c-4bed-b2de-74fc89bfb964 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:40.998202 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:41.007216 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534d25c-8298-4d5f-887a-133807d9221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:41.008021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534d25c-8298-4d5f-887a-133807d9221b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:41.008371 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534d25c-8298-4d5f-887a-133807d9221b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:41.008658 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534d25c-8298-4d5f-887a-133807d9221b None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:41.009431 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534d25c-8298-4d5f-887a-133807d9221b None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:41.009745 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534d25c-8298-4d5f-887a-133807d9221b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:41.011417 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534d25c-8298-4d5f-887a-133807d9221b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:41.017606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013a191-c894-49e2-b873-275800144d95 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:41.021213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 219/424] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:54:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:41.026921 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534d25c-8298-4d5f-887a-133807d9221b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:41.083230 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b2824-ce65-4cdb-b107-8448e3a4140f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:41.084275 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b2824-ce65-4cdb-b107-8448e3a4140f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:41.084560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b2824-ce65-4cdb-b107-8448e3a4140f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:41.084840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b2824-ce65-4cdb-b107-8448e3a4140f None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:41.086449 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b2824-ce65-4cdb-b107-8448e3a4140f None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:41.088445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b2824-ce65-4cdb-b107-8448e3a4140f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:41.090506 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 206/425] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:40 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:41.096325 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b2824-ce65-4cdb-b107-8448e3a4140f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:41.190520 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534d25c-8298-4d5f-887a-133807d9221b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:41.240205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408daa4-982c-473b-95f5-20008cd8d23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:41.240966 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408daa4-982c-473b-95f5-20008cd8d23e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:41.241163 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408daa4-982c-473b-95f5-20008cd8d23e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:41.241442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408daa4-982c-473b-95f5-20008cd8d23e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:41.283798 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b2824-ce65-4cdb-b107-8448e3a4140f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:41.322420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:41.342672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408daa4-982c-473b-95f5-20008cd8d23e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:41.344483 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408daa4-982c-473b-95f5-20008cd8d23e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:41.350109 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05e89f-8a44-418f-b2fa-3e25ca02afd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:41.351023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05e89f-8a44-418f-b2fa-3e25ca02afd5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:41.351304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05e89f-8a44-418f-b2fa-3e25ca02afd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:41.351579 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05e89f-8a44-418f-b2fa-3e25ca02afd5 None admin] PATH_INFO: `/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:41.357687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05e89f-8a44-418f-b2fa-3e25ca02afd5 None admin] RBAC: Authorizing `identity:get_group(group_id=9fdf21fe474b46c2a7f5888244d8a1a4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:41.359222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05e89f-8a44-418f-b2fa-3e25ca02afd5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:41.361200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 207/426] 10.222.0.61 () {56 vars in 1180 bytes} [Thu May 26 20:54:41 2022] GET /identity/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4 => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:41.369405 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05e89f-8a44-418f-b2fa-3e25ca02afd5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:41.372605 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:41.511826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 220/427] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:41.517652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408daa4-982c-473b-95f5-20008cd8d23e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:41.612571 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05e89f-8a44-418f-b2fa-3e25ca02afd5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:41.618388 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:41.632832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408daa4-982c-473b-95f5-20008cd8d23e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:41.669065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759c85c-ec65-484a-a560-cb045fc35cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:41.670184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759c85c-ec65-484a-a560-cb045fc35cac None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:41.670532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759c85c-ec65-484a-a560-cb045fc35cac None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:41.671133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759c85c-ec65-484a-a560-cb045fc35cac None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:41.675751 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759c85c-ec65-484a-a560-cb045fc35cac None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:41.677237 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759c85c-ec65-484a-a560-cb045fc35cac None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:41.683361 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 221/428] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:41 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:41.685316 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759c85c-ec65-484a-a560-cb045fc35cac None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:41.707239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae27c8-acd1-439b-a185-a669ab1b9016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:41.707917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae27c8-acd1-439b-a185-a669ab1b9016 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:41.708198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae27c8-acd1-439b-a185-a669ab1b9016 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:41.708472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae27c8-acd1-439b-a185-a669ab1b9016 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:41.709309 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae27c8-acd1-439b-a185-a669ab1b9016 None admin] RBAC: Adding query filter params (group.id=9fdf21fe474b46c2a7f5888244d8a1a4, role.id=7f252cd3de7047e396a0daf6e7d4d2ee, scope.project.id=839fd844cfbb442e8202597c69e6bbee) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:41.709618 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae27c8-acd1-439b-a185-a669ab1b9016 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:41.711469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae27c8-acd1-439b-a185-a669ab1b9016 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:41.725355 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 208/429] 10.222.0.61 () {56 vars in 1376 bytes} [Thu May 26 20:54:41 2022] GET /identity/v3/role_assignments?group.id=9fdf21fe474b46c2a7f5888244d8a1a4&scope.project.id=839fd844cfbb442e8202597c69e6bbee&role.id=7f252cd3de7047e396a0daf6e7d4d2ee => generated 611 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:41.819265 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759c85c-ec65-484a-a560-cb045fc35cac None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:41.857647 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827f050-5711-4112-979b-c687ce330550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:41.858567 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827f050-5711-4112-979b-c687ce330550 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:41.858841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827f050-5711-4112-979b-c687ce330550 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:41.859108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827f050-5711-4112-979b-c687ce330550 None admin] PATH_INFO: `/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:41.860696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827f050-5711-4112-979b-c687ce330550 None admin] RBAC: Authorizing `identity:get_group(group_id=9fdf21fe474b46c2a7f5888244d8a1a4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:41.862210 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827f050-5711-4112-979b-c687ce330550 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:41.864162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 222/430] 10.222.0.61 () {56 vars in 1180 bytes} [Thu May 26 20:54:41 2022] GET /identity/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:41.869817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae27c8-acd1-439b-a185-a669ab1b9016 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:41.943377 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:41.981366 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae27c8-acd1-439b-a185-a669ab1b9016 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:42.016620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf68c57-05aa-4d85-b539-fd5a99279344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:42.017350 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf68c57-05aa-4d85-b539-fd5a99279344 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:42.017634 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf68c57-05aa-4d85-b539-fd5a99279344 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:42.017973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf68c57-05aa-4d85-b539-fd5a99279344 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:42.018815 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf68c57-05aa-4d85-b539-fd5a99279344 None admin] RBAC: Adding query filter params (group.id=9fdf21fe474b46c2a7f5888244d8a1a4, role.id=7f252cd3de7047e396a0daf6e7d4d2ee, scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:42.019127 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf68c57-05aa-4d85-b539-fd5a99279344 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:42.020643 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf68c57-05aa-4d85-b539-fd5a99279344 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:42.027360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 209/431] 10.222.0.61 () {56 vars in 1376 bytes} [Thu May 26 20:54:41 2022] GET /identity/v3/role_assignments?group.id=9fdf21fe474b46c2a7f5888244d8a1a4&scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef&role.id=7f252cd3de7047e396a0daf6e7d4d2ee => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:42.253899 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec1862-6ea6-47f9-8c33-874ff223357d None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:42.254437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec1862-6ea6-47f9-8c33-874ff223357d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:42.254437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec1862-6ea6-47f9-8c33-874ff223357d None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:42.256073 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 223/432] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:42.261304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb625c8-3826-4b51-935f-673777da7b1f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:42.261839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb625c8-3826-4b51-935f-673777da7b1f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:42.262344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb625c8-3826-4b51-935f-673777da7b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:42.282462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4eb625c8-3826-4b51-935f-673777da7b1f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:42.283975 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4eb625c8-3826-4b51-935f-673777da7b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:42.366078 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 210/433] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:42.389915 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec1862-6ea6-47f9-8c33-874ff223357d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:42.419664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:42.503636 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec1862-6ea6-47f9-8c33-874ff223357d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:42.507438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ee63f-c17e-4844-b78f-5941f665761c None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:42.507637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ee63f-c17e-4844-b78f-5941f665761c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:42.507915 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ee63f-c17e-4844-b78f-5941f665761c None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:42.509433 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 211/434] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:54:42.514375 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a21dd-72e3-4e51-8e4b-bb11fe2fa083 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:42.514658 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a21dd-72e3-4e51-8e4b-bb11fe2fa083 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:42.514932 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a21dd-72e3-4e51-8e4b-bb11fe2fa083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:42.534065 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7f4a21dd-72e3-4e51-8e4b-bb11fe2fa083 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:42.535408 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7f4a21dd-72e3-4e51-8e4b-bb11fe2fa083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:42.543283 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b81b1f-b40f-42c6-bd32-8369a47d3c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:42.544119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b81b1f-b40f-42c6-bd32-8369a47d3c07 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:42.544402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b81b1f-b40f-42c6-bd32-8369a47d3c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:42.544682 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b81b1f-b40f-42c6-bd32-8369a47d3c07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:42.555883 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b81b1f-b40f-42c6-bd32-8369a47d3c07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:42.564330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-a5b81b1f-b40f-42c6-bd32-8369a47d3c07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:42.564330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:42.564330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:42.564330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:42.564330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:42.564330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:42.564330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:42.564330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:42.564330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:42.564330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:42.564330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:42.564330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:42.564330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:42.564330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:42.564330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:42.564330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:42.565214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:42.565214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:42.565214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:42.565214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:42.565214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:42.565214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:42.565214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:42.565214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:42.565214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:42.565214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:42.565214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:42.565214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:42.565214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:42.565214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:42.565214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:42.565214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:42.566396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:42.566396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:42.566396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:42.566396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:42.566396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:42.566396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:42.566396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:42.566396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:42.566396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:42.566396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:42.566396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:42.566396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:42.566396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 224/435] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:54:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:42.571276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b81b1f-b40f-42c6-bd32-8369a47d3c07 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:42.599944 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:42.614733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 212/436] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:42.637431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a21dd-72e3-4e51-8e4b-bb11fe2fa083 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:42.674120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:42.691665 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b81b1f-b40f-42c6-bd32-8369a47d3c07 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:42.728121 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39420f6c-6ff2-43bd-9346-d4abfcd33d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:42.728804 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39420f6c-6ff2-43bd-9346-d4abfcd33d28 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:42.729085 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39420f6c-6ff2-43bd-9346-d4abfcd33d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:42.729361 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39420f6c-6ff2-43bd-9346-d4abfcd33d28 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:42.730143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39420f6c-6ff2-43bd-9346-d4abfcd33d28 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:42.730448 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39420f6c-6ff2-43bd-9346-d4abfcd33d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:42.731852 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39420f6c-6ff2-43bd-9346-d4abfcd33d28 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:42.740476 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 225/437] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:54:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:42.745547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39420f6c-6ff2-43bd-9346-d4abfcd33d28 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:42.753104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a21dd-72e3-4e51-8e4b-bb11fe2fa083 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:42.801882 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659628e-d842-4b3a-8c5b-c34b8e7ff3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:42.802717 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659628e-d842-4b3a-8c5b-c34b8e7ff3cf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:42.802996 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659628e-d842-4b3a-8c5b-c34b8e7ff3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:42.803269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659628e-d842-4b3a-8c5b-c34b8e7ff3cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:42.815229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659628e-d842-4b3a-8c5b-c34b8e7ff3cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:42.823336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b659628e-d842-4b3a-8c5b-c34b8e7ff3cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:42.823336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:42.823336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:42.823336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:42.823336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:42.823336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:42.823336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:42.823336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:42.823336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:42.823336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:42.823336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:42.823336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:42.823336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:42.823336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:42.823336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:42.823336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:42.824211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:42.824211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:42.824211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:42.824211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:42.824211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:42.824211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:42.824211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:42.824211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:42.824211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:42.824211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:42.824211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:42.824211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:42.824211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:42.824211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:42.824211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:42.824211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:42.824977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:42.824977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:42.824977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:42.824977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:42.824977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:42.824977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:42.824977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:42.824977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:42.824977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:42.824977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:42.824977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:42.824977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:42.824977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 213/438] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:54:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:42.830385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659628e-d842-4b3a-8c5b-c34b8e7ff3cf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:42.874707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39420f6c-6ff2-43bd-9346-d4abfcd33d28 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:42.884359 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:42.914752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165acfce-8fb3-4a36-b8d5-aa8a48d2f192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:42.915429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165acfce-8fb3-4a36-b8d5-aa8a48d2f192 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:42.915713 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165acfce-8fb3-4a36-b8d5-aa8a48d2f192 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:42.915988 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165acfce-8fb3-4a36-b8d5-aa8a48d2f192 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:42.936446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:42.950815 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659628e-d842-4b3a-8c5b-c34b8e7ff3cf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:42.988778 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b9064-33b9-4474-bf43-2748f7da7ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:42.989579 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b9064-33b9-4474-bf43-2748f7da7ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:42.989890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b9064-33b9-4474-bf43-2748f7da7ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:42.990333 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b9064-33b9-4474-bf43-2748f7da7ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:42.990966 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b9064-33b9-4474-bf43-2748f7da7ab5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:42.991248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b9064-33b9-4474-bf43-2748f7da7ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:42.992625 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b9064-33b9-4474-bf43-2748f7da7ab5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:43.000230 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165acfce-8fb3-4a36-b8d5-aa8a48d2f192 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:43.001615 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 214/439] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:54:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:43.001836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165acfce-8fb3-4a36-b8d5-aa8a48d2f192 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:43.006927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b9064-33b9-4474-bf43-2748f7da7ab5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:43.111523 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 226/440] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 20:54:43.112760 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010239c-b67f-4dc9-a0ed-ee1002d7a38f None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:43.113045 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010239c-b67f-4dc9-a0ed-ee1002d7a38f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:43.113315 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010239c-b67f-4dc9-a0ed-ee1002d7a38f None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:43.114595 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 227/441] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:43.116812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010239c-b67f-4dc9-a0ed-ee1002d7a38f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:43.118481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b9064-33b9-4474-bf43-2748f7da7ab5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:43.132958 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:43.157170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdd767-8b5d-4965-8969-349d613e38d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:43.157816 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdd767-8b5d-4965-8969-349d613e38d9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:43.158119 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdd767-8b5d-4965-8969-349d613e38d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:43.158432 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdd767-8b5d-4965-8969-349d613e38d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:43.164501 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:43.220267 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010239c-b67f-4dc9-a0ed-ee1002d7a38f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:43.226383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bdd767-8b5d-4965-8969-349d613e38d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:43.227927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bdd767-8b5d-4965-8969-349d613e38d9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:43.253273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06d42b-6c4e-4294-9d37-2b48d22acf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:43.254170 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06d42b-6c4e-4294-9d37-2b48d22acf85 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:43.254696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06d42b-6c4e-4294-9d37-2b48d22acf85 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:43.254696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06d42b-6c4e-4294-9d37-2b48d22acf85 None admin] PATH_INFO: `/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:43.255877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06d42b-6c4e-4294-9d37-2b48d22acf85 None admin] RBAC: Authorizing `identity:get_project(project_id=bae39b4f40ce46c7af4ffe6265f259ef)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:43.257357 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06d42b-6c4e-4294-9d37-2b48d22acf85 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:43.259252 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 228/442] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:43 2022] GET /identity/v3/projects/bae39b4f40ce46c7af4ffe6265f259ef => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:43.260359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec663b76-018a-4908-88d5-7d4f305e4bc8 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:43.260648 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec663b76-018a-4908-88d5-7d4f305e4bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:43.261121 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec663b76-018a-4908-88d5-7d4f305e4bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:43.276786 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ec663b76-018a-4908-88d5-7d4f305e4bc8 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:43.278028 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ec663b76-018a-4908-88d5-7d4f305e4bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:43.333737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 215/443] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 20:54:43.335165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdd767-8b5d-4965-8969-349d613e38d9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:43.347706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 229/444] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:43.348386 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec663b76-018a-4908-88d5-7d4f305e4bc8 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:43.350726 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:43.395912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:43.438561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdd767-8b5d-4965-8969-349d613e38d9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:43.447779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec663b76-018a-4908-88d5-7d4f305e4bc8 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:43.472315 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba174a-7a62-4475-96da-9835fbee446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:43.473177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba174a-7a62-4475-96da-9835fbee446a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:43.473454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba174a-7a62-4475-96da-9835fbee446a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:43.473722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba174a-7a62-4475-96da-9835fbee446a None admin] PATH_INFO: `/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:43.474921 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba174a-7a62-4475-96da-9835fbee446a None admin] RBAC: Authorizing `identity:get_group(group_id=9fdf21fe474b46c2a7f5888244d8a1a4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:43.476381 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba174a-7a62-4475-96da-9835fbee446a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:43.478056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 216/445] 10.222.0.61 () {56 vars in 1180 bytes} [Thu May 26 20:54:43 2022] GET /identity/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:43.478808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba174a-7a62-4475-96da-9835fbee446a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:43.485826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6ddce-1100-4302-89e0-61bd18f1b892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:43.486708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6ddce-1100-4302-89e0-61bd18f1b892 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:43.486999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6ddce-1100-4302-89e0-61bd18f1b892 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:43.487265 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6ddce-1100-4302-89e0-61bd18f1b892 None admin] PATH_INFO: `/v3/projects/839fd844cfbb442e8202597c69e6bbee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:43.488476 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6ddce-1100-4302-89e0-61bd18f1b892 None admin] RBAC: Authorizing `identity:get_project(project_id=839fd844cfbb442e8202597c69e6bbee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:43.489963 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6ddce-1100-4302-89e0-61bd18f1b892 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:43.491659 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 230/446] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:43 2022] GET /identity/v3/projects/839fd844cfbb442e8202597c69e6bbee => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:43.492398 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6ddce-1100-4302-89e0-61bd18f1b892 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:43.562679 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:43.583208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba174a-7a62-4475-96da-9835fbee446a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:43.593465 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6ddce-1100-4302-89e0-61bd18f1b892 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:43.607632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:43.619566 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055b6b5-a25f-4e44-900d-8c0140f07926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:43.620378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055b6b5-a25f-4e44-900d-8c0140f07926 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:43.620655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055b6b5-a25f-4e44-900d-8c0140f07926 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:43.620922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055b6b5-a25f-4e44-900d-8c0140f07926 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:43.629696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f609cb6-40f1-4a34-8537-56b64bdcc165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:43.630382 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f609cb6-40f1-4a34-8537-56b64bdcc165 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:43.630667 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f609cb6-40f1-4a34-8537-56b64bdcc165 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:43.630939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f609cb6-40f1-4a34-8537-56b64bdcc165 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:43.631308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055b6b5-a25f-4e44-900d-8c0140f07926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:43.631764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f609cb6-40f1-4a34-8537-56b64bdcc165 None admin] RBAC: Adding query filter params (group.id=9fdf21fe474b46c2a7f5888244d8a1a4, role.id=3695c157587346198902d1f6ec05153a, scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:43.632070 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f609cb6-40f1-4a34-8537-56b64bdcc165 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:43.633534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f609cb6-40f1-4a34-8537-56b64bdcc165 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:43.638828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-2055b6b5-a25f-4e44-900d-8c0140f07926 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:54:43.638828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:43.638828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:43.638828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:43.638828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:43.638828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:43.638828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:43.638828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:43.638828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:43.638828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:43.638828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:43.638828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:43.638828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:43.638828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:43.638828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:43.638828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:43.650754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:43.650754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:43.650754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:43.650754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:43.650754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:43.650754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:43.650754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:43.650754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:43.650754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:43.650754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:43.650754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:43.650754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:43.650754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:43.650754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:43.650754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:43.650754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:43.651754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:43.651754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:43.651754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:43.651754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:43.651754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:43.651754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:43.651754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:43.651754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:43.651754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:43.651754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:43.651754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:54:43.651754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:43.652490 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 231/447] 10.222.0.61 () {56 vars in 1376 bytes} [Thu May 26 20:54:43 2022] GET /identity/v3/role_assignments?group.id=9fdf21fe474b46c2a7f5888244d8a1a4&scope.project.id=bae39b4f40ce46c7af4ffe6265f259ef&role.id=3695c157587346198902d1f6ec05153a => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:43.652583 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 217/448] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:54:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:43.652670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f609cb6-40f1-4a34-8537-56b64bdcc165 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:43.652749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055b6b5-a25f-4e44-900d-8c0140f07926 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:43.756373 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f609cb6-40f1-4a34-8537-56b64bdcc165 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:43.779199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055b6b5-a25f-4e44-900d-8c0140f07926 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:43.802835 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40053cf2-71ec-4bef-9f6b-1f9ea0597a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:43.803997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40053cf2-71ec-4bef-9f6b-1f9ea0597a45 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:43.804467 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40053cf2-71ec-4bef-9f6b-1f9ea0597a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:43.804740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40053cf2-71ec-4bef-9f6b-1f9ea0597a45 None admin] PATH_INFO: `/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:43.806011 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40053cf2-71ec-4bef-9f6b-1f9ea0597a45 None admin] RBAC: Authorizing `identity:get_group(group_id=9fdf21fe474b46c2a7f5888244d8a1a4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:43.807507 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40053cf2-71ec-4bef-9f6b-1f9ea0597a45 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:43.813986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 232/449] 10.222.0.61 () {56 vars in 1180 bytes} [Thu May 26 20:54:43 2022] GET /identity/v3/groups/9fdf21fe474b46c2a7f5888244d8a1a4 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:43.816367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40053cf2-71ec-4bef-9f6b-1f9ea0597a45 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:43.818362 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c486e-f6ca-4325-adae-22d05bd4bdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:43.819057 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c486e-f6ca-4325-adae-22d05bd4bdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:43.819524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c486e-f6ca-4325-adae-22d05bd4bdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:43.819626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c486e-f6ca-4325-adae-22d05bd4bdf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:43.821131 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c486e-f6ca-4325-adae-22d05bd4bdf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:43.821131 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c486e-f6ca-4325-adae-22d05bd4bdf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:43.822142 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c486e-f6ca-4325-adae-22d05bd4bdf4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:43.836435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 218/450] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:43.837994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c486e-f6ca-4325-adae-22d05bd4bdf4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:43.841161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:43.873198 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:43.931346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40053cf2-71ec-4bef-9f6b-1f9ea0597a45 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:43.951728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c486e-f6ca-4325-adae-22d05bd4bdf4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:43.964509 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90333d-0f30-43bb-856a-1e5f632bcded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:43.965172 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90333d-0f30-43bb-856a-1e5f632bcded None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:43.965450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90333d-0f30-43bb-856a-1e5f632bcded None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:43.965719 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90333d-0f30-43bb-856a-1e5f632bcded None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:43.966612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90333d-0f30-43bb-856a-1e5f632bcded None admin] RBAC: Adding query filter params (group.id=9fdf21fe474b46c2a7f5888244d8a1a4, role.id=3695c157587346198902d1f6ec05153a, scope.project.id=839fd844cfbb442e8202597c69e6bbee) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:43.966884 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90333d-0f30-43bb-856a-1e5f632bcded None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:43.968334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90333d-0f30-43bb-856a-1e5f632bcded None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:43.974118 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 233/451] 10.222.0.61 () {56 vars in 1376 bytes} [Thu May 26 20:54:43 2022] GET /identity/v3/role_assignments?group.id=9fdf21fe474b46c2a7f5888244d8a1a4&scope.project.id=839fd844cfbb442e8202597c69e6bbee&role.id=3695c157587346198902d1f6ec05153a => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:43.988051 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6c3f4-6603-47e3-a1b2-a5a070c56df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:43.988732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6c3f4-6603-47e3-a1b2-a5a070c56df4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:43.989014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6c3f4-6603-47e3-a1b2-a5a070c56df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:43.989289 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6c3f4-6603-47e3-a1b2-a5a070c56df4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:44.062243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6c3f4-6603-47e3-a1b2-a5a070c56df4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:44.063890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6c3f4-6603-47e3-a1b2-a5a070c56df4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:44.066116 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:44.171785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 219/452] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:44.177534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90333d-0f30-43bb-856a-1e5f632bcded None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:44.285049 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90333d-0f30-43bb-856a-1e5f632bcded None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:44.294155 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:44.319986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74c551-d18e-4436-90ce-15c018f8cbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:44.320910 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74c551-d18e-4436-90ce-15c018f8cbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:44.321188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74c551-d18e-4436-90ce-15c018f8cbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:44.321462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74c551-d18e-4436-90ce-15c018f8cbf6 None admin] PATH_INFO: `/v3/projects/b75eb758e320488d94c4fcec41d7e80a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:44.322750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74c551-d18e-4436-90ce-15c018f8cbf6 None admin] RBAC: Authorizing `identity:get_project(project_id=b75eb758e320488d94c4fcec41d7e80a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:44.324235 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74c551-d18e-4436-90ce-15c018f8cbf6 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:44.325946 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 234/453] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:54:44 2022] GET /identity/v3/projects/b75eb758e320488d94c4fcec41d7e80a => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:44.332408 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6c3f4-6603-47e3-a1b2-a5a070c56df4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:44.436297 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6c3f4-6603-47e3-a1b2-a5a070c56df4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:44.437986 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:44.473501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b71bd2-4a37-47f0-96cd-0db5b42103e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:44.474416 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b71bd2-4a37-47f0-96cd-0db5b42103e5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:44.474696 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b71bd2-4a37-47f0-96cd-0db5b42103e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:44.474963 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b71bd2-4a37-47f0-96cd-0db5b42103e5 None admin] PATH_INFO: `/v3/groups/b9715982cd3846dd85dd88cae259e963` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:44.476287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b71bd2-4a37-47f0-96cd-0db5b42103e5 None admin] RBAC: Authorizing `identity:get_group(group_id=b9715982cd3846dd85dd88cae259e963)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:44.477762 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b71bd2-4a37-47f0-96cd-0db5b42103e5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:44.479428 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 220/454] 10.222.0.61 () {56 vars in 1180 bytes} [Thu May 26 20:54:44 2022] GET /identity/v3/groups/b9715982cd3846dd85dd88cae259e963 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:44.485464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74c551-d18e-4436-90ce-15c018f8cbf6 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:44.590231 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74c551-d18e-4436-90ce-15c018f8cbf6 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:44.624507 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8aafc-85f3-44ef-a91c-17f14cec8379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:44.625243 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8aafc-85f3-44ef-a91c-17f14cec8379 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:44.625628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8aafc-85f3-44ef-a91c-17f14cec8379 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:44.626012 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8aafc-85f3-44ef-a91c-17f14cec8379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:44.626866 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8aafc-85f3-44ef-a91c-17f14cec8379 None admin] RBAC: Adding query filter params (group.id=b9715982cd3846dd85dd88cae259e963, role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=b75eb758e320488d94c4fcec41d7e80a) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:44.627179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8aafc-85f3-44ef-a91c-17f14cec8379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:44.628650 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8aafc-85f3-44ef-a91c-17f14cec8379 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:44.635074 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 235/455] 10.222.0.61 () {56 vars in 1376 bytes} [Thu May 26 20:54:44 2022] GET /identity/v3/role_assignments?group.id=b9715982cd3846dd85dd88cae259e963&scope.project.id=b75eb758e320488d94c4fcec41d7e80a&role.id=aefba81d87bf47258c17064af7d9a05f => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:47.243309 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d340ccd-a0e8-465e-a833-72a5745be533 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:47.244358 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d340ccd-a0e8-465e-a833-72a5745be533 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:47.244845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d340ccd-a0e8-465e-a833-72a5745be533 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:47.246693 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 221/456] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:47.252792 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf1046-b506-43b3-886d-4f16b8294c63 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:47.253570 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf1046-b506-43b3-886d-4f16b8294c63 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:47.254042 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf1046-b506-43b3-886d-4f16b8294c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:47.277612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0aaf1046-b506-43b3-886d-4f16b8294c63 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:47.279040 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0aaf1046-b506-43b3-886d-4f16b8294c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:47.325325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:47.372508 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 236/457] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:47.409082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d340ccd-a0e8-465e-a833-72a5745be533 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:47.555834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d340ccd-a0e8-465e-a833-72a5745be533 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:47.576540 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734e54d-8290-4689-9e41-c3b3e5942dda None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:47.577188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734e54d-8290-4689-9e41-c3b3e5942dda None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:47.577555 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734e54d-8290-4689-9e41-c3b3e5942dda None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:47.579600 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 237/458] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:47.587174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05a431-33a4-4ad1-9551-5797f1cb4ba6 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:47.587695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05a431-33a4-4ad1-9551-5797f1cb4ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:47.588179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05a431-33a4-4ad1-9551-5797f1cb4ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:47.591528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80397780-4cf2-47d6-82f1-5b703a4eb322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:47.592497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80397780-4cf2-47d6-82f1-5b703a4eb322 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:47.592937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80397780-4cf2-47d6-82f1-5b703a4eb322 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:47.593342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80397780-4cf2-47d6-82f1-5b703a4eb322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:47.604896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80397780-4cf2-47d6-82f1-5b703a4eb322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:47.606605 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80397780-4cf2-47d6-82f1-5b703a4eb322 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:47.625110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-80397780-4cf2-47d6-82f1-5b703a4eb322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:47.625110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:47.625110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:47.625110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:47.625110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:47.625110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:47.625110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:47.625110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:47.625110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:47.625110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:47.625110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:47.625110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:47.625110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:54:47.625110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:54:47.625110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:54:47.626339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:54:47.626339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:47.626339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:47.626339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:47.626339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:47.626339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:47.626339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:47.626339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:47.626339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:47.626339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:47.626339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:47.626339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:47.626339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:47.626339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:47.626339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:47.626339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:47.626339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:47.627178 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:54:47.627178 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:54:47.627178 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:47.627178 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:47.627389 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6b05a431-33a4-4ad1-9551-5797f1cb4ba6 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:47.628631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6b05a431-33a4-4ad1-9551-5797f1cb4ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:47.629611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 222/459] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:47.638397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80397780-4cf2-47d6-82f1-5b703a4eb322 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:47.683752 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:47.770031 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 238/460] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:47.793661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05a431-33a4-4ad1-9551-5797f1cb4ba6 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:47.880029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80397780-4cf2-47d6-82f1-5b703a4eb322 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:47.893189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:47.897690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05a431-33a4-4ad1-9551-5797f1cb4ba6 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:47.930765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124750dd-9b30-4436-90d9-64f75db970be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:47.931966 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124750dd-9b30-4436-90d9-64f75db970be None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:47.932645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124750dd-9b30-4436-90d9-64f75db970be None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:47.933099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124750dd-9b30-4436-90d9-64f75db970be None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:47.934803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124750dd-9b30-4436-90d9-64f75db970be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:47.935279 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124750dd-9b30-4436-90d9-64f75db970be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:47.937967 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124750dd-9b30-4436-90d9-64f75db970be None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:47.946703 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73532bb5-e69e-40f6-b149-a9cff4c6c710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:47.947843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73532bb5-e69e-40f6-b149-a9cff4c6c710 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:47.948264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73532bb5-e69e-40f6-b149-a9cff4c6c710 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:47.948676 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73532bb5-e69e-40f6-b149-a9cff4c6c710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:47.957502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 223/461] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:47.959416 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271c83d-7a9d-43bd-868f-ed7c15b6e5e6 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:47.959918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271c83d-7a9d-43bd-868f-ed7c15b6e5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:47.960368 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271c83d-7a9d-43bd-868f-ed7c15b6e5e6 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:47.962014 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73532bb5-e69e-40f6-b149-a9cff4c6c710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:47.962760 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 224/462] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:47.963604 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271c83d-7a9d-43bd-868f-ed7c15b6e5e6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:47.964170 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73532bb5-e69e-40f6-b149-a9cff4c6c710 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:47.984234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-73532bb5-e69e-40f6-b149-a9cff4c6c710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:47.984234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:47.984234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:47.984234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:47.984234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:47.984234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:47.984234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:47.984234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:47.984234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:47.984234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:47.984234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:47.984234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:47.984234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:54:47.984234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:54:47.984234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:54:47.985847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:54:47.985847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:47.985847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:47.985847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:47.985847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:47.985847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:47.985847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:47.985847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:47.985847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:47.985847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:47.985847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:47.985847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:47.985847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:47.985847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:47.985847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:47.985847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:47.985847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:47.986775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:54:47.986775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:54:47.986775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:47.986775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:47.993317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 239/463] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:47.994885 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9938c-5e88-4330-bf8c-b1e80aae4e9c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:47.995368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9938c-5e88-4330-bf8c-b1e80aae4e9c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:47.995819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9938c-5e88-4330-bf8c-b1e80aae4e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:48.014135 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d4a9938c-5e88-4330-bf8c-b1e80aae4e9c None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:48.015601 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d4a9938c-5e88-4330-bf8c-b1e80aae4e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:48.060062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:48.082525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271c83d-7a9d-43bd-868f-ed7c15b6e5e6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:48.087087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 240/464] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:48.088142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9938c-5e88-4330-bf8c-b1e80aae4e9c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:48.127353 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2286d8-95e3-4525-94cc-bb55c695e866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:48.128045 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2286d8-95e3-4525-94cc-bb55c695e866 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:48.128325 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2286d8-95e3-4525-94cc-bb55c695e866 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:48.128599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2286d8-95e3-4525-94cc-bb55c695e866 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:48.129323 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2286d8-95e3-4525-94cc-bb55c695e866 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:48.130852 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2286d8-95e3-4525-94cc-bb55c695e866 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:48.158330 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 225/465] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:54:47 2022] POST /identity/v3/users => generated 246 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:54:48.159229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2286d8-95e3-4525-94cc-bb55c695e866 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:48.178032 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:48.200599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9938c-5e88-4330-bf8c-b1e80aae4e9c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:48.240599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368be85-7ca9-40e6-8a7a-a35b714aa9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:48.241827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368be85-7ca9-40e6-8a7a-a35b714aa9ac None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:48.242320 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368be85-7ca9-40e6-8a7a-a35b714aa9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:48.242773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368be85-7ca9-40e6-8a7a-a35b714aa9ac None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:48.243723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368be85-7ca9-40e6-8a7a-a35b714aa9ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:48.244231 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368be85-7ca9-40e6-8a7a-a35b714aa9ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:48.246053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368be85-7ca9-40e6-8a7a-a35b714aa9ac None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:48.264218 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 241/466] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:48.266679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba00f30-1dca-4aca-9e41-004f4345e383 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:48.267191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba00f30-1dca-4aca-9e41-004f4345e383 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:48.267661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba00f30-1dca-4aca-9e41-004f4345e383 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:48.270085 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 242/467] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:48.271275 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba00f30-1dca-4aca-9e41-004f4345e383 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:48.296618 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2286d8-95e3-4525-94cc-bb55c695e866 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:48.337064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77178030-8a6a-4b3b-a926-32f577581e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:48.338251 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77178030-8a6a-4b3b-a926-32f577581e97 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:48.338684 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77178030-8a6a-4b3b-a926-32f577581e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:48.339210 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77178030-8a6a-4b3b-a926-32f577581e97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:48.348012 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:48.354804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77178030-8a6a-4b3b-a926-32f577581e97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:48.356688 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77178030-8a6a-4b3b-a926-32f577581e97 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:48.377641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-77178030-8a6a-4b3b-a926-32f577581e97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:48.377641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:48.377641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:48.377641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:48.377641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:48.377641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:48.377641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:48.377641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:48.377641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:48.377641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:48.377641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:48.377641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:48.377641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:54:48.377641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:54:48.377641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:54:48.378603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:54:48.378603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:48.378603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:48.378603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:48.378603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:48.378603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:48.378603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:48.378603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:48.378603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:48.378603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:48.378603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:48.378603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:48.378603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:48.378603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:48.378603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:48.378603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:48.378603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:48.379422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:54:48.379422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:54:48.379422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:48.379422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:48.380623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 226/468] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:48.387092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c3a57-1713-4e79-8653-10609bfd730c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:48.387092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c3a57-1713-4e79-8653-10609bfd730c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:48.387305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c3a57-1713-4e79-8653-10609bfd730c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:48.390753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba00f30-1dca-4aca-9e41-004f4345e383 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:48.411392 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7a1c3a57-1713-4e79-8653-10609bfd730c None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:48.412597 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7a1c3a57-1713-4e79-8653-10609bfd730c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:48.435464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb8174-21f5-4094-8e87-53dc08521645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:48.436168 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb8174-21f5-4094-8e87-53dc08521645 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:48.436447 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb8174-21f5-4094-8e87-53dc08521645 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:48.436718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb8174-21f5-4094-8e87-53dc08521645 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:48.437435 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb8174-21f5-4094-8e87-53dc08521645 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:48.440468 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb8174-21f5-4094-8e87-53dc08521645 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:48.458774 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:48.471884 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 243/469] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:54:48 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:54:48.472708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb8174-21f5-4094-8e87-53dc08521645 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:48.506260 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 227/470] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:48.534048 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c3a57-1713-4e79-8653-10609bfd730c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:48.623226 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb8174-21f5-4094-8e87-53dc08521645 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:48.654680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c3a57-1713-4e79-8653-10609bfd730c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:48.661040 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf9943-57ca-4309-8c19-628a8803304a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:48.662096 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9943-57ca-4309-8c19-628a8803304a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:48.662590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9943-57ca-4309-8c19-628a8803304a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:48.663062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9943-57ca-4309-8c19-628a8803304a None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:48.664019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf9943-57ca-4309-8c19-628a8803304a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:48.664527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf9943-57ca-4309-8c19-628a8803304a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:48.666197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf9943-57ca-4309-8c19-628a8803304a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:48.676938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:48.681236 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 244/471] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:48.694928 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf9943-57ca-4309-8c19-628a8803304a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:48.707848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a4969-3015-4002-8084-a0d8211ffd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:48.708678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a4969-3015-4002-8084-a0d8211ffd75 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:48.708957 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a4969-3015-4002-8084-a0d8211ffd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:48.709227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a4969-3015-4002-8084-a0d8211ffd75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:48.727785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a4969-3015-4002-8084-a0d8211ffd75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:48.729281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a4969-3015-4002-8084-a0d8211ffd75 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:48.769002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c05a4969-3015-4002-8084-a0d8211ffd75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:48.769002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:48.769002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:48.769002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:48.769002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:48.769002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:48.769002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:48.769002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:48.769002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:48.769002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:48.769002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:48.769002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:48.769002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:54:48.769002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:54:48.769002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:54:48.770002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:54:48.770002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:48.770002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:48.770002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:48.770002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:48.770002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:48.770002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:48.770002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:48.770002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:48.770002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:48.770002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:48.770002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:48.770002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:48.770002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:48.770002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:48.770002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:48.770002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:48.770837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:54:48.770837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:54:48.770837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:48.770837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:48.770837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 228/472] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:48.770837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a539db-a411-4449-88ac-8e151ce85342 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:48.770837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a539db-a411-4449-88ac-8e151ce85342 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:48.770837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a539db-a411-4449-88ac-8e151ce85342 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:48.771487 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 229/473] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:48.777705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a539db-a411-4449-88ac-8e151ce85342 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:48.803255 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:48.867486 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf9943-57ca-4309-8c19-628a8803304a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:48.909033 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96120f31-40fe-40bf-9542-f7e77f2a082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:48.909737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120f31-40fe-40bf-9542-f7e77f2a082d None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:48.910121 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120f31-40fe-40bf-9542-f7e77f2a082d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:48.910454 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120f31-40fe-40bf-9542-f7e77f2a082d None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:48.911231 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96120f31-40fe-40bf-9542-f7e77f2a082d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:48.912505 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a539db-a411-4449-88ac-8e151ce85342 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:48.912714 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96120f31-40fe-40bf-9542-f7e77f2a082d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:48.945331 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 245/474] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:54:48 2022] POST /identity/v3/users => generated 248 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:54:48.945331 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2bb73-7cc3-48ed-8c56-433d2a842554 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:48.945331 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2bb73-7cc3-48ed-8c56-433d2a842554 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:48.945331 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2bb73-7cc3-48ed-8c56-433d2a842554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:48.966604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d2f2bb73-7cc3-48ed-8c56-433d2a842554 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:48.967862 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d2f2bb73-7cc3-48ed-8c56-433d2a842554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:48.989981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0a9f6-1a65-434e-ba4f-5eaec1a125c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:48.991031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0a9f6-1a65-434e-ba4f-5eaec1a125c8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:48.991526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0a9f6-1a65-434e-ba4f-5eaec1a125c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:48.992014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0a9f6-1a65-434e-ba4f-5eaec1a125c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:48.993065 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0a9f6-1a65-434e-ba4f-5eaec1a125c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:48.993570 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0a9f6-1a65-434e-ba4f-5eaec1a125c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:48.995208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0a9f6-1a65-434e-ba4f-5eaec1a125c8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:49.025902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 230/475] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:49.030915 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0a9f6-1a65-434e-ba4f-5eaec1a125c8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:49.044868 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 246/476] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:49.067821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2bb73-7cc3-48ed-8c56-433d2a842554 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:49.089719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:49.136104 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:49.197371 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2bb73-7cc3-48ed-8c56-433d2a842554 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:49.214197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0a9f6-1a65-434e-ba4f-5eaec1a125c8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:49.237092 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689be89-1e43-4bd5-bb38-8f1a75258e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:49.237691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689be89-1e43-4bd5-bb38-8f1a75258e52 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:49.238021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689be89-1e43-4bd5-bb38-8f1a75258e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:49.238297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689be89-1e43-4bd5-bb38-8f1a75258e52 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:49.239067 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689be89-1e43-4bd5-bb38-8f1a75258e52 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:49.240512 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689be89-1e43-4bd5-bb38-8f1a75258e52 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:49.248850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.sql.core [None req-7689be89-1e43-4bd5-bb38-8f1a75258e52 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 20:54:49.248850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 20:54:49.248850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [parameters: {'id': 'a7cd5b23fcd24c989087a620a096a22d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 20:54:49.248850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80324) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 20:54:49.268478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d3261-499b-499f-a8fe-8f552bdfc96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:49.268690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-7689be89-1e43-4bd5-bb38-8f1a75258e52 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 20:54:49.268690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:49.268690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 20:54:49.268690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 20:54:49.268690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 20:54:49.268690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 20:54:49.268690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 20:54:49.268690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application result = self._query(query) May 26 20:54:49.268690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 20:54:49.268690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application conn.query(q) May 26 20:54:49.268690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 20:54:49.268690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 20:54:49.268690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 20:54:49.268690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application result.read() May 26 20:54:49.268690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return ref.to_dict() May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 20:54:49.269820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application next(self.gen) May 26 20:54:49.270734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 20:54:49.270734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application yield resource May 26 20:54:49.270734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 20:54:49.270734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application next(self.gen) May 26 20:54:49.270734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 20:54:49.270734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.session.rollback() May 26 20:54:49.270734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 20:54:49.270734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.force_reraise() May 26 20:54:49.270734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 20:54:49.270734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise self.value May 26 20:54:49.270734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 20:54:49.270734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 20:54:49.270734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 20:54:49.270734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application session.commit() May 26 20:54:49.270734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 20:54:49.270734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 20:54:49.270734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 20:54:49.271572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._prepare_impl() May 26 20:54:49.271572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 20:54:49.271572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.session.flush() May 26 20:54:49.271572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 20:54:49.271572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._flush(objects) May 26 20:54:49.271572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 20:54:49.271572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 20:54:49.271572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 20:54:49.271572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application compat.raise_( May 26 20:54:49.271572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 20:54:49.271572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception May 26 20:54:49.271572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 20:54:49.271572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application flush_context.execute() May 26 20:54:49.271572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 20:54:49.271572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rec.execute(self) May 26 20:54:49.271572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 20:54:49.271572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 20:54:49.272464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 20:54:49.272464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 20:54:49.272464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 20:54:49.272464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 20:54:49.272464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 20:54:49.272464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 20:54:49.272464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 20:54:49.272464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 20:54:49.272464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 20:54:49.272464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 20:54:49.272464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 20:54:49.272464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 20:54:49.272464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 20:54:49.272464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 20:54:49.272464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 20:54:49.272464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception May 26 20:54:49.273284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 20:54:49.273284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 20:54:49.273284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 20:54:49.273284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 20:54:49.273284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 20:54:49.273284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application result = self._query(query) May 26 20:54:49.273284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 20:54:49.273284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application conn.query(q) May 26 20:54:49.273284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 20:54:49.273284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 20:54:49.273284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 20:54:49.273284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application result.read() May 26 20:54:49.273284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 20:54:49.273284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 20:54:49.273284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 20:54:49.273284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 20:54:49.275196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 20:54:49.275196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 20:54:49.275196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 20:54:49.275196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 20:54:49.275196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 20:54:49.275196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 20:54:49.275196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [parameters: {'id': 'a7cd5b23fcd24c989087a620a096a22d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 20:54:49.275196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 20:54:49.275196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:49.275196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:54:49.275196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:49.275196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:49.275196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:49.275196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:49.275196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:49.275196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:49.276161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:49.276161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:49.276161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:49.276161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:49.276161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:49.276161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:49.276161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 20:54:49.276161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 20:54:49.276161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:49.276161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:49.276161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 20:54:49.276161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 20:54:49.276161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 20:54:49.276161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 20:54:49.276161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 20:54:49.276161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:49.277158 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d3261-499b-499f-a8fe-8f552bdfc96d None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:49.277158 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d3261-499b-499f-a8fe-8f552bdfc96d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:49.277158 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d3261-499b-499f-a8fe-8f552bdfc96d None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:49.277158 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d3261-499b-499f-a8fe-8f552bdfc96d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:49.277158 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d3261-499b-499f-a8fe-8f552bdfc96d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:49.277496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 247/477] 10.222.0.61 () {60 vars in 1131 bytes} [Thu May 26 20:54:49 2022] POST /identity/v3/roles => generated 144 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:49.277496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689be89-1e43-4bd5-bb38-8f1a75258e52 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:49.309362 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 231/478] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:54:49 2022] POST /identity/v3/users => generated 249 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:54:49.407459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689be89-1e43-4bd5-bb38-8f1a75258e52 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:49.417983 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:49.447931 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcbd49-dc36-48f0-8f3b-f6942f2719ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:49.448692 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcbd49-dc36-48f0-8f3b-f6942f2719ba None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:49.449034 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcbd49-dc36-48f0-8f3b-f6942f2719ba None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:49.449311 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcbd49-dc36-48f0-8f3b-f6942f2719ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:49.462997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcbd49-dc36-48f0-8f3b-f6942f2719ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:49.471336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-57dcbd49-dc36-48f0-8f3b-f6942f2719ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:49.471336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:49.471336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:49.471336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:49.471336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:49.471336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:49.471336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:49.471336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:49.471336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:49.471336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:49.471336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:49.471336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:49.471336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:49.471336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:49.471336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:49.471336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:49.473416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:49.473416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:49.473416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:49.473416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:49.473416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:49.473416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:49.473416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:49.473416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:49.473416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:49.473416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:49.473416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:49.473416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:49.473416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:49.473416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:49.473416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:49.473416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:49.474530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:49.474530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:49.474530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:49.474530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:49.474530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:49.474530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:49.474530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:49.474530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:49.474530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:49.474530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:49.474530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 20:54:49.474530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:49.474530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 248/479] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:54:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:49.478497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d3261-499b-499f-a8fe-8f552bdfc96d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:49.586904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:49.602106 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d3261-499b-499f-a8fe-8f552bdfc96d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:49.638565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8c6ce-5075-4a15-b3bd-22fa6f26558d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:49.639434 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8c6ce-5075-4a15-b3bd-22fa6f26558d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:49.639719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8c6ce-5075-4a15-b3bd-22fa6f26558d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:49.640044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8c6ce-5075-4a15-b3bd-22fa6f26558d None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:49.641518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8c6ce-5075-4a15-b3bd-22fa6f26558d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:49.642335 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8c6ce-5075-4a15-b3bd-22fa6f26558d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:49.643872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8c6ce-5075-4a15-b3bd-22fa6f26558d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:49.653558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 232/480] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:54:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:50.932776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab7e48-d332-4cef-98f2-e0b8c885c6f6 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:50.933660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab7e48-d332-4cef-98f2-e0b8c885c6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:50.934098 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab7e48-d332-4cef-98f2-e0b8c885c6f6 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:50.935836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 249/481] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:50.942508 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b161a0-4f9f-4b90-9e96-dfe953ce49a4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:50.943765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b161a0-4f9f-4b90-9e96-dfe953ce49a4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:50.944468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b161a0-4f9f-4b90-9e96-dfe953ce49a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:50.967949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-70b161a0-4f9f-4b90-9e96-dfe953ce49a4 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:50.969397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-70b161a0-4f9f-4b90-9e96-dfe953ce49a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:51.066829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 233/482] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:51.089945 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab7e48-d332-4cef-98f2-e0b8c885c6f6 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:51.237635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab7e48-d332-4cef-98f2-e0b8c885c6f6 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:51.288888 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e89383-d18f-4c00-9aac-fe135b888693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:51.289715 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e89383-d18f-4c00-9aac-fe135b888693 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:51.290030 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e89383-d18f-4c00-9aac-fe135b888693 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:51.290310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e89383-d18f-4c00-9aac-fe135b888693 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:51.303692 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e89383-d18f-4c00-9aac-fe135b888693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:51.311380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-02e89383-d18f-4c00-9aac-fe135b888693 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:54:51.311380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:51.311380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:51.311380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:51.311380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:51.311380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:51.311380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:51.311380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:51.311380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:51.311380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:51.311380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:51.311380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:51.311380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:51.311380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:51.311380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:51.311380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:51.312249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:51.312249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:51.312249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:51.312249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:51.312249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:51.312249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:51.312249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:51.312249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:51.312249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:51.312249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:51.312249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:51.312249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:51.312249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:51.312249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:51.312249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:51.312249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:51.313338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:51.313338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:51.313338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:51.313338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:51.313338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:51.313338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:51.313338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:51.313338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:51.313338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:51.313338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:51.313338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:54:51.313338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:51.313338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 250/483] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:54:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:51.320364 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b161a0-4f9f-4b90-9e96-dfe953ce49a4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:51.402607 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:51.416144 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba32ab-cf5a-4e85-92f5-90ac96d97e03 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:51.416569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba32ab-cf5a-4e85-92f5-90ac96d97e03 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:51.416856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba32ab-cf5a-4e85-92f5-90ac96d97e03 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:51.418538 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 251/484] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:51.426478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb516bfc-c93c-4979-a559-0aba6531d234 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:51.426765 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb516bfc-c93c-4979-a559-0aba6531d234 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:51.427043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb516bfc-c93c-4979-a559-0aba6531d234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:51.442797 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b161a0-4f9f-4b90-9e96-dfe953ce49a4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:51.449187 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-eb516bfc-c93c-4979-a559-0aba6531d234 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:51.450405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-eb516bfc-c93c-4979-a559-0aba6531d234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:51.488917 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:51.504948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f9a02-3a7b-48f6-97ce-edaaa0ec9f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:51.505652 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f9a02-3a7b-48f6-97ce-edaaa0ec9f33 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:51.505971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f9a02-3a7b-48f6-97ce-edaaa0ec9f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:51.506241 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f9a02-3a7b-48f6-97ce-edaaa0ec9f33 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:51.506997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f9a02-3a7b-48f6-97ce-edaaa0ec9f33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:51.507310 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f9a02-3a7b-48f6-97ce-edaaa0ec9f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:51.508727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f9a02-3a7b-48f6-97ce-edaaa0ec9f33 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:51.534446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 234/485] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:54:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:51.542711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f9a02-3a7b-48f6-97ce-edaaa0ec9f33 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:51.557302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 252/486] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:51.583831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb516bfc-c93c-4979-a559-0aba6531d234 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:51.692277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb516bfc-c93c-4979-a559-0aba6531d234 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:51.730350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c30876-8416-457b-aedf-9e69fbfe79e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:51.731543 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c30876-8416-457b-aedf-9e69fbfe79e6 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:51.732039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c30876-8416-457b-aedf-9e69fbfe79e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:51.732500 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c30876-8416-457b-aedf-9e69fbfe79e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:51.745550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c30876-8416-457b-aedf-9e69fbfe79e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:51.754637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-81c30876-8416-457b-aedf-9e69fbfe79e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:54:51.754637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:51.754637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:51.754637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:51.754637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:51.754637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:51.754637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:51.754637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:51.754637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:51.754637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:51.754637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:51.754637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:51.754637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:51.754637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:51.754637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:51.754637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:51.755522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:51.755522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:51.755522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:51.755522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:51.755522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:51.755522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:51.755522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:51.755522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:51.755522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:51.755522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:51.755522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:51.755522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:51.755522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:51.755522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:51.755522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:51.755522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:51.756296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:51.756296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:51.756296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:51.756296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:51.756296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:51.756296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:51.756296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:51.756296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:51.756296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:51.756296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:51.756296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:54:51.756296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:51.765156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 253/487] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:54:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:51.773967 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c30876-8416-457b-aedf-9e69fbfe79e6 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:51.810768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:51.832006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f9a02-3a7b-48f6-97ce-edaaa0ec9f33 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:51.883247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c30876-8416-457b-aedf-9e69fbfe79e6 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:51.918297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9db672-8d7b-497e-ae0e-bdf95f90a31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:51.919363 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9db672-8d7b-497e-ae0e-bdf95f90a31c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:51.919838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9db672-8d7b-497e-ae0e-bdf95f90a31c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:51.920402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9db672-8d7b-497e-ae0e-bdf95f90a31c None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:51.921436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9db672-8d7b-497e-ae0e-bdf95f90a31c None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:51.922023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9db672-8d7b-497e-ae0e-bdf95f90a31c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:51.923647 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9db672-8d7b-497e-ae0e-bdf95f90a31c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:51.929780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c2be1-2319-4fbf-943e-f5aed9417a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:51.930859 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c2be1-2319-4fbf-943e-f5aed9417a09 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:51.931275 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c2be1-2319-4fbf-943e-f5aed9417a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:51.931691 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c2be1-2319-4fbf-943e-f5aed9417a09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:51.933658 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 254/488] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:54:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:51.940214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9db672-8d7b-497e-ae0e-bdf95f90a31c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:51.957550 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c2be1-2319-4fbf-943e-f5aed9417a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:51.958804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c2be1-2319-4fbf-943e-f5aed9417a09 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:51.963497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:52.002305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-320c2be1-2319-4fbf-943e-f5aed9417a09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:52.002305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:52.002305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:52.002305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:52.002305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:52.002305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:52.002305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:52.002305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:52.002305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:52.002305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:52.002305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:52.002305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:52.002305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:54:52.002305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:54:52.002305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:54:52.003227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:54:52.003227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:52.003227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:52.003227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:52.003227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:52.003227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:52.003227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:52.003227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:52.003227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:52.003227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:52.003227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:52.003227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:52.003227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:52.003227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:52.003227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:52.003227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:52.003227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:52.004062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:54:52.004062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:54:52.004062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:52.004062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:52.004062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 235/489] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 462 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:52.020248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c2be1-2319-4fbf-943e-f5aed9417a09 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:52.038320 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:52.057596 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9db672-8d7b-497e-ae0e-bdf95f90a31c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:52.094083 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfe61c-c571-4de2-aaac-8e8ff14534ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:52.094881 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfe61c-c571-4de2-aaac-8e8ff14534ea None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:52.095162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfe61c-c571-4de2-aaac-8e8ff14534ea None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:52.095432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfe61c-c571-4de2-aaac-8e8ff14534ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:52.107481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfe61c-c571-4de2-aaac-8e8ff14534ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:52.108994 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfe61c-c571-4de2-aaac-8e8ff14534ea None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:52.128169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-a9bfe61c-c571-4de2-aaac-8e8ff14534ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:52.128169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:52.128169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:52.128169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:52.128169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:52.128169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:52.128169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:52.128169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:52.128169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:52.128169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:52.128169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:52.128169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:52.128169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:54:52.128169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:54:52.128169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:54:52.129086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:54:52.129086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:52.129086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:52.129086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:52.129086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:52.129086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:52.129086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:52.129086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:52.129086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:52.129086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:52.129086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:52.129086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:52.129086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:52.129086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:52.129086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:52.129086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:52.129086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:52.129936 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:54:52.129936 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:54:52.129936 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:52.129936 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:52.129936 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 255/490] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:52.135501 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213888b7-bfa1-41ef-9e48-ca7d3d337780 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:52.135680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213888b7-bfa1-41ef-9e48-ca7d3d337780 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:52.135964 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213888b7-bfa1-41ef-9e48-ca7d3d337780 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:52.138481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 256/491] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:52.139411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213888b7-bfa1-41ef-9e48-ca7d3d337780 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:52.176507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c2be1-2319-4fbf-943e-f5aed9417a09 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:52.226695 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0807bf1-6e70-490a-9163-3dbf3d01d829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:52.227915 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0807bf1-6e70-490a-9163-3dbf3d01d829 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:52.228213 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0807bf1-6e70-490a-9163-3dbf3d01d829 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:52.228501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0807bf1-6e70-490a-9163-3dbf3d01d829 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:52.229688 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0807bf1-6e70-490a-9163-3dbf3d01d829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:52.230038 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0807bf1-6e70-490a-9163-3dbf3d01d829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:52.232017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0807bf1-6e70-490a-9163-3dbf3d01d829 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:52.249632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 236/492] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:52.251358 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09359b-87b0-4e2d-81f5-481bf75f4fcd None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:52.251664 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09359b-87b0-4e2d-81f5-481bf75f4fcd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:52.251954 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09359b-87b0-4e2d-81f5-481bf75f4fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:52.259328 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213888b7-bfa1-41ef-9e48-ca7d3d337780 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:52.273366 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5f09359b-87b0-4e2d-81f5-481bf75f4fcd None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:52.274910 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5f09359b-87b0-4e2d-81f5-481bf75f4fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:52.299934 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:52.308152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ce14f-3c77-4976-8f0f-653060a328fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:52.309838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ce14f-3c77-4976-8f0f-653060a328fc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:52.310128 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ce14f-3c77-4976-8f0f-653060a328fc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:52.310481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ce14f-3c77-4976-8f0f-653060a328fc None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:52.311232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ce14f-3c77-4976-8f0f-653060a328fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:52.311541 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ce14f-3c77-4976-8f0f-653060a328fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:52.313205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ce14f-3c77-4976-8f0f-653060a328fc None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:52.325931 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 257/493] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:52.326564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ce14f-3c77-4976-8f0f-653060a328fc None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:52.340874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:52.362267 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 237/494] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:52.363574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1294e4-aa16-4676-8c09-3462bfe79f7d None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:52.363862 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1294e4-aa16-4676-8c09-3462bfe79f7d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:52.364141 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1294e4-aa16-4676-8c09-3462bfe79f7d None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:52.365525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 238/495] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:52.373823 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1294e4-aa16-4676-8c09-3462bfe79f7d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:52.439107 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ce14f-3c77-4976-8f0f-653060a328fc None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:52.476851 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1294e4-aa16-4676-8c09-3462bfe79f7d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:52.477035 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5ff44-4d70-4a2e-b5ba-0d5f57aa59c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:52.477664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5ff44-4d70-4a2e-b5ba-0d5f57aa59c4 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:52.477987 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5ff44-4d70-4a2e-b5ba-0d5f57aa59c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:52.478272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5ff44-4d70-4a2e-b5ba-0d5f57aa59c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:52.486104 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5ff44-4d70-4a2e-b5ba-0d5f57aa59c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:52.487586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5ff44-4d70-4a2e-b5ba-0d5f57aa59c4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:52.503573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-90a5ff44-4d70-4a2e-b5ba-0d5f57aa59c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 20:54:52.503573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:52.503573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:52.503573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:52.503573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:52.503573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:52.503573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:52.503573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:52.503573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:52.503573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:52.503573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:52.503573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:52.503573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:54:52.503573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:54:52.503573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:54:52.503573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:52.504569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:52.505437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:52.505437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:52.505437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:54:52.505437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:54:52.505437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:54:52.505437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:54:52.505437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:54:52.505437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:54:52.505437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 20:54:52.505437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:52.510056 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 258/496] 10.222.0.61 () {56 vars in 1093 bytes} [Thu May 26 20:54:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:52.511666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15480277-fb3c-4ce9-bfbf-3ef62a7f34da None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:52.511886 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b6d87-9849-48ee-be1f-df3b501d79a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:52.511996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15480277-fb3c-4ce9-bfbf-3ef62a7f34da None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:52.512213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15480277-fb3c-4ce9-bfbf-3ef62a7f34da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:52.512699 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b6d87-9849-48ee-be1f-df3b501d79a1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:52.512983 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b6d87-9849-48ee-be1f-df3b501d79a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:52.513256 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b6d87-9849-48ee-be1f-df3b501d79a1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:52.521200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b6d87-9849-48ee-be1f-df3b501d79a1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:52.522670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b6d87-9849-48ee-be1f-df3b501d79a1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:52.529636 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-15480277-fb3c-4ce9-bfbf-3ef62a7f34da None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:52.530864 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-15480277-fb3c-4ce9-bfbf-3ef62a7f34da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:52.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-bd5b6d87-9849-48ee-be1f-df3b501d79a1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 20:54:52.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:52.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:52.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:52.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:52.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:52.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:52.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:52.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:52.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:52.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:52.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:52.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:54:52.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:54:52.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:54:52.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:52.539518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:52.540438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:52.540438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:52.540438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:54:52.540438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:54:52.540438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:54:52.540438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:54:52.540438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:54:52.540438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:54:52.540438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 20:54:52.540438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:52.540438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 239/497] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:52.540438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b6d87-9849-48ee-be1f-df3b501d79a1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:52.580350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:52.587490 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:52.601384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 259/498] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:52.602827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796d2cd-c50b-4cc9-9efb-8eddec6e2d30 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:52.603122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796d2cd-c50b-4cc9-9efb-8eddec6e2d30 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:52.603399 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796d2cd-c50b-4cc9-9efb-8eddec6e2d30 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:52.604655 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 260/499] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:52.605337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796d2cd-c50b-4cc9-9efb-8eddec6e2d30 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:52.650660 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b6d87-9849-48ee-be1f-df3b501d79a1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:52.685070 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036df153-2688-4a85-bf56-e85dcf0d174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:52.685901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036df153-2688-4a85-bf56-e85dcf0d174a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:52.686184 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036df153-2688-4a85-bf56-e85dcf0d174a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:52.686460 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036df153-2688-4a85-bf56-e85dcf0d174a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:52.697891 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036df153-2688-4a85-bf56-e85dcf0d174a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:52.705839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-036df153-2688-4a85-bf56-e85dcf0d174a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:54:52.705839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:52.705839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:52.705839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:52.705839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:52.705839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:52.705839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:52.705839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:52.705839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:52.705839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:52.705839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:52.705839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:52.705839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:52.705839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:52.705839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:52.705839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:52.706706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:52.706706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:52.706706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:52.706706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:52.706706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:52.706706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:52.706706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:52.706706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:52.706706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:52.706706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:52.706706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:52.706706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:52.706706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:52.706706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:52.706706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:52.706706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:52.707507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:52.707507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:52.707507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:52.707507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:52.707507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:52.707507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:52.707507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:52.707507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:52.707507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:52.707507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:52.707507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:54:52.707507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:52.707507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 240/500] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:54:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:52.708417 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036df153-2688-4a85-bf56-e85dcf0d174a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:52.719919 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796d2cd-c50b-4cc9-9efb-8eddec6e2d30 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:52.757072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7622ab-668e-403f-be26-004a3519543f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:52.757768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7622ab-668e-403f-be26-004a3519543f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:52.758100 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7622ab-668e-403f-be26-004a3519543f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:52.758359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7622ab-668e-403f-be26-004a3519543f None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:52.759218 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7622ab-668e-403f-be26-004a3519543f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:52.759554 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7622ab-668e-403f-be26-004a3519543f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:52.761018 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7622ab-668e-403f-be26-004a3519543f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:52.798223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 261/501] 10.222.0.61 () {56 vars in 1133 bytes} [Thu May 26 20:54:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:52.799545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4e98a-c160-46a3-a4ca-26cd2defbd30 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:52.799839 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4e98a-c160-46a3-a4ca-26cd2defbd30 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:52.800117 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4e98a-c160-46a3-a4ca-26cd2defbd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:52.817090 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-54e4e98a-c160-46a3-a4ca-26cd2defbd30 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:52.818304 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-54e4e98a-c160-46a3-a4ca-26cd2defbd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:52.819164 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036df153-2688-4a85-bf56-e85dcf0d174a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:52.821523 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:52.853161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:52.854068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad29dcf-907e-42df-afc2-f305243fcf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:52.854828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad29dcf-907e-42df-afc2-f305243fcf8b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:52.855129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad29dcf-907e-42df-afc2-f305243fcf8b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:52.855413 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad29dcf-907e-42df-afc2-f305243fcf8b None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:52.856225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad29dcf-907e-42df-afc2-f305243fcf8b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:52.856532 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad29dcf-907e-42df-afc2-f305243fcf8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:52.858019 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad29dcf-907e-42df-afc2-f305243fcf8b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:52.886368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 262/502] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:52.887205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4e98a-c160-46a3-a4ca-26cd2defbd30 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:52.904010 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 241/503] 10.222.0.61 () {56 vars in 1137 bytes} [Thu May 26 20:54:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:52.904010 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad29dcf-907e-42df-afc2-f305243fcf8b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:52.995904 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4e98a-c160-46a3-a4ca-26cd2defbd30 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:53.006046 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad29dcf-907e-42df-afc2-f305243fcf8b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:53.030715 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c868a-9262-4263-818a-b644cc7176bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:53.031861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c868a-9262-4263-818a-b644cc7176bc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:53.032159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c868a-9262-4263-818a-b644cc7176bc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:53.032433 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c868a-9262-4263-818a-b644cc7176bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:53.039734 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c924c2-ae61-4432-b09d-b42c0fe9f6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:53.040410 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c924c2-ae61-4432-b09d-b42c0fe9f6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:53.040693 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c924c2-ae61-4432-b09d-b42c0fe9f6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:53.040971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c924c2-ae61-4432-b09d-b42c0fe9f6d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:53.041724 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c924c2-ae61-4432-b09d-b42c0fe9f6d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:53.042066 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c924c2-ae61-4432-b09d-b42c0fe9f6d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:53.042385 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c868a-9262-4263-818a-b644cc7176bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:53.043471 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c924c2-ae61-4432-b09d-b42c0fe9f6d4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:53.050763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-289c868a-9262-4263-818a-b644cc7176bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:54:53.050763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:53.050763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:53.050763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:53.050763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:53.050763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:53.050763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:53.050763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:53.050763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:53.050763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:53.050763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:53.050763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:53.050763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:53.050763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:53.050763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:53.050763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:53.051633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:53.051633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:53.051633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:53.051633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:53.051633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:53.051633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:53.051633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:53.051633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:53.051633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:53.051633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:53.051633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:53.051633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:53.051633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:53.051633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:53.051633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:53.051633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:53.052432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:53.052432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:53.052432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:53.052432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:53.052432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:53.052432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:53.052432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:53.052432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:53.052432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:53.052432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:53.052432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:54:53.052432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:53.053014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 242/504] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:54:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:53.053014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c924c2-ae61-4432-b09d-b42c0fe9f6d4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:53.054109 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 263/505] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:54:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:53.055123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c868a-9262-4263-818a-b644cc7176bc None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:53.081982 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:53.090836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:53.159376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c924c2-ae61-4432-b09d-b42c0fe9f6d4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:53.161994 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c868a-9262-4263-818a-b644cc7176bc None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:53.193356 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f944f-8a43-47c6-995d-12f3b2faadbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:53.194029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f944f-8a43-47c6-995d-12f3b2faadbd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:53.194311 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f944f-8a43-47c6-995d-12f3b2faadbd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:53.194585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f944f-8a43-47c6-995d-12f3b2faadbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:53.195485 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123d1c7-a912-463d-92bc-1b1933b101a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:53.196144 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123d1c7-a912-463d-92bc-1b1933b101a7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:53.196429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123d1c7-a912-463d-92bc-1b1933b101a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:53.196749 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123d1c7-a912-463d-92bc-1b1933b101a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:53.262850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f944f-8a43-47c6-995d-12f3b2faadbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:53.264260 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f944f-8a43-47c6-995d-12f3b2faadbd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:53.266628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123d1c7-a912-463d-92bc-1b1933b101a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:53.268082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123d1c7-a912-463d-92bc-1b1933b101a7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:53.288849 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:53.297933 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:53.366816 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 264/506] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:53.367359 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 243/507] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:53.367671 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123d1c7-a912-463d-92bc-1b1933b101a7 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:53.368246 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f944f-8a43-47c6-995d-12f3b2faadbd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:53.469970 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f944f-8a43-47c6-995d-12f3b2faadbd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:53.473857 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123d1c7-a912-463d-92bc-1b1933b101a7 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:53.493926 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:53.503803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:53.505718 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b16c8-245f-46ac-8427-d9ba20cdb83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:53.506731 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b16c8-245f-46ac-8427-d9ba20cdb83a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:53.506840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b16c8-245f-46ac-8427-d9ba20cdb83a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:53.507112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b16c8-245f-46ac-8427-d9ba20cdb83a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:53.510851 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a42154-1950-481f-a763-7fb77e836b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:53.511667 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a42154-1950-481f-a763-7fb77e836b21 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:53.511950 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a42154-1950-481f-a763-7fb77e836b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:53.512225 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a42154-1950-481f-a763-7fb77e836b21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:53.518070 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b16c8-245f-46ac-8427-d9ba20cdb83a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:53.519479 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b16c8-245f-46ac-8427-d9ba20cdb83a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:53.522524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a42154-1950-481f-a763-7fb77e836b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:53.524004 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a42154-1950-481f-a763-7fb77e836b21 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:53.537587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-717b16c8-245f-46ac-8427-d9ba20cdb83a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:53.537587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:53.537587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:53.537587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:53.537587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:53.537587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:53.537587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:53.537587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:53.537587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:53.537587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:53.537587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:53.537587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:53.537587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:54:53.537587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:54:53.537587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:54:53.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:54:53.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:53.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:53.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:53.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:53.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:53.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:53.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:53.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:53.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:53.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:53.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:53.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:53.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:53.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:53.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:53.538454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:53.539290 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:54:53.539290 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:54:53.539290 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:53.539290 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:53.539290 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 244/508] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:53.539550 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b16c8-245f-46ac-8427-d9ba20cdb83a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:53.541943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-e3a42154-1950-481f-a763-7fb77e836b21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:53.541943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:53.541943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:53.541943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:53.541943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:53.541943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:53.541943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:53.541943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:53.541943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:53.541943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:53.541943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:53.541943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:53.541943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:54:53.541943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:54:53.541943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:54:53.542808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:54:53.542808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:53.542808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:53.542808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:53.542808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:53.542808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:53.542808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:53.542808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:53.542808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:53.542808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:53.542808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:53.542808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:53.542808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:53.542808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:53.542808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:53.542808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:53.542808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:53.544801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:54:53.544801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:54:53.544801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:53.544801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:53.544801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 265/509] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:53.544801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a42154-1950-481f-a763-7fb77e836b21 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:53.642825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a42154-1950-481f-a763-7fb77e836b21 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:53.644026 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b16c8-245f-46ac-8427-d9ba20cdb83a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:53.678561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5aee4-7f5c-4e26-8b96-281cb5786190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:53.679369 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5aee4-7f5c-4e26-8b96-281cb5786190 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:53.679502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2135e8-b46c-4db6-8953-d520cdf819ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:53.679681 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5aee4-7f5c-4e26-8b96-281cb5786190 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:53.679955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5aee4-7f5c-4e26-8b96-281cb5786190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:53.680205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2135e8-b46c-4db6-8953-d520cdf819ea None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:53.680467 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2135e8-b46c-4db6-8953-d520cdf819ea None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:53.680738 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2135e8-b46c-4db6-8953-d520cdf819ea None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:53.681495 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2135e8-b46c-4db6-8953-d520cdf819ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:53.681936 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2135e8-b46c-4db6-8953-d520cdf819ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:53.683236 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2135e8-b46c-4db6-8953-d520cdf819ea None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:53.691692 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 245/510] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:54:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:53.691815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5aee4-7f5c-4e26-8b96-281cb5786190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:53.692494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2135e8-b46c-4db6-8953-d520cdf819ea None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:53.693223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5aee4-7f5c-4e26-8b96-281cb5786190 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:53.711496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-21a5aee4-7f5c-4e26-8b96-281cb5786190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:53.711496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:53.711496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:53.711496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:53.711496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:53.711496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:53.711496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:53.711496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:53.711496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:53.711496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:53.711496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:53.711496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:53.711496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:54:53.711496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:54:53.711496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:54:53.712560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:54:53.712560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:53.712560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:53.712560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:53.712560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:53.712560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:53.712560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:53.712560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:53.712560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:53.712560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:53.712560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:53.712560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:53.712560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:53.712560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:53.712560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:53.712560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:53.712560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:53.713434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:54:53.713434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:54:53.713434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:53.713434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:53.713434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 266/511] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:53.713690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5aee4-7f5c-4e26-8b96-281cb5786190 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:53.736785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:53.752992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:53.804780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2135e8-b46c-4db6-8953-d520cdf819ea None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:53.830663 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5aee4-7f5c-4e26-8b96-281cb5786190 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:53.839056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c139049-4717-4f3d-8e45-dfedb129e89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:53.839860 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c139049-4717-4f3d-8e45-dfedb129e89b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:53.840137 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c139049-4717-4f3d-8e45-dfedb129e89b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:53.840407 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c139049-4717-4f3d-8e45-dfedb129e89b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:53.851742 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c139049-4717-4f3d-8e45-dfedb129e89b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:53.853209 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c139049-4717-4f3d-8e45-dfedb129e89b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:53.864024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396b9c9-3661-4a3d-8a9c-5eee6f44061e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:53.864700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396b9c9-3661-4a3d-8a9c-5eee6f44061e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:53.864986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396b9c9-3661-4a3d-8a9c-5eee6f44061e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:53.865264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396b9c9-3661-4a3d-8a9c-5eee6f44061e None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:53.866027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396b9c9-3661-4a3d-8a9c-5eee6f44061e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:53.866335 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396b9c9-3661-4a3d-8a9c-5eee6f44061e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:53.867735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396b9c9-3661-4a3d-8a9c-5eee6f44061e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:53.870929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0c139049-4717-4f3d-8e45-dfedb129e89b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:53.870929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:53.870929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:53.870929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:53.870929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:53.870929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:53.870929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:53.870929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:53.870929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:53.870929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:53.870929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:53.870929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:53.870929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:54:53.870929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:54:53.870929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:54:53.871705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:54:53.871705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:53.871705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:53.871705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:53.871705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:53.871705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:53.871705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:53.871705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:53.871705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:53.871705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:53.871705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:53.871705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:53.871705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:53.871705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:53.871705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:53.871705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:53.871705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:53.872519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:54:53.872519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:54:53.872519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:53.872519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:53.872519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 246/512] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:53.873029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c139049-4717-4f3d-8e45-dfedb129e89b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:53.882586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 267/513] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:53.883417 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396b9c9-3661-4a3d-8a9c-5eee6f44061e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:53.968786 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:53.975709 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:53.979335 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c139049-4717-4f3d-8e45-dfedb129e89b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:53.982997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396b9c9-3661-4a3d-8a9c-5eee6f44061e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:54.014432 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455ab76-1065-45a6-beda-2746ac7c4375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:54.015102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455ab76-1065-45a6-beda-2746ac7c4375 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:54.015454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455ab76-1065-45a6-beda-2746ac7c4375 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:54.015804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455ab76-1065-45a6-beda-2746ac7c4375 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:54.016206 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac86d4-8b81-4415-bcf4-cb2e29c671ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:54.016653 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455ab76-1065-45a6-beda-2746ac7c4375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:54.016955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455ab76-1065-45a6-beda-2746ac7c4375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:54.017049 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac86d4-8b81-4415-bcf4-cb2e29c671ab None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:54.017275 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac86d4-8b81-4415-bcf4-cb2e29c671ab None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:54.017548 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac86d4-8b81-4415-bcf4-cb2e29c671ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:54.018432 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455ab76-1065-45a6-beda-2746ac7c4375 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:54.027696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac86d4-8b81-4415-bcf4-cb2e29c671ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:54.029145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac86d4-8b81-4415-bcf4-cb2e29c671ab None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:54.030293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 247/514] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:54.031133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455ab76-1065-45a6-beda-2746ac7c4375 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:54.047393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-72ac86d4-8b81-4415-bcf4-cb2e29c671ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:54.047393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:54.047393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:54.047393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:54.047393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:54.047393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:54.047393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:54.047393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:54.047393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:54.047393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:54.047393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:54.047393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:54.047393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:54:54.047393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:54:54.047393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:54:54.048403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:54:54.048403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:54.048403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:54.048403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:54.048403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:54.048403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:54.048403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:54.048403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:54.048403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:54.048403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:54.048403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:54.048403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:54.048403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:54.048403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:54.048403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:54.048403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:54.048403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:54.049259 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:54:54.049259 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:54:54.049259 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:54.049259 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:54.049259 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 268/515] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:54.049524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac86d4-8b81-4415-bcf4-cb2e29c671ab None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:54.137143 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455ab76-1065-45a6-beda-2746ac7c4375 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:54.151740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac86d4-8b81-4415-bcf4-cb2e29c671ab None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:54.171582 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1ec0e-0cf6-4b85-a9ed-f45495027b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:54.172896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1ec0e-0cf6-4b85-a9ed-f45495027b45 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:54.173180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1ec0e-0cf6-4b85-a9ed-f45495027b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:54.173455 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1ec0e-0cf6-4b85-a9ed-f45495027b45 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:54.174217 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1ec0e-0cf6-4b85-a9ed-f45495027b45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:54.174521 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1ec0e-0cf6-4b85-a9ed-f45495027b45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:54.175948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1ec0e-0cf6-4b85-a9ed-f45495027b45 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:54.186939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa08a2-e3de-407a-8c32-c0eb80d20b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:54.188084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 248/516] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:54.188191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa08a2-e3de-407a-8c32-c0eb80d20b76 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:54.188398 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa08a2-e3de-407a-8c32-c0eb80d20b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:54.188677 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa08a2-e3de-407a-8c32-c0eb80d20b76 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:54.188887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1ec0e-0cf6-4b85-a9ed-f45495027b45 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:54.189400 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa08a2-e3de-407a-8c32-c0eb80d20b76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:54.189694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa08a2-e3de-407a-8c32-c0eb80d20b76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:54.191113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa08a2-e3de-407a-8c32-c0eb80d20b76 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:54.201501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:54.203480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 269/517] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:54.204626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa08a2-e3de-407a-8c32-c0eb80d20b76 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:54.214054 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:54.293727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1ec0e-0cf6-4b85-a9ed-f45495027b45 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:54.303840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa08a2-e3de-407a-8c32-c0eb80d20b76 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:54.328276 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a2da3-33e8-4655-bbc5-294abc0df8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:54.329077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a2da3-33e8-4655-bbc5-294abc0df8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:54.329357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a2da3-33e8-4655-bbc5-294abc0df8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:54.329630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a2da3-33e8-4655-bbc5-294abc0df8a0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:54.338064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a2da3-33e8-4655-bbc5-294abc0df8a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:54.338911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59304914-08d9-4646-abef-f88c6431c01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:54.339519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a2da3-33e8-4655-bbc5-294abc0df8a0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:54.339624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59304914-08d9-4646-abef-f88c6431c01c None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:54.339856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59304914-08d9-4646-abef-f88c6431c01c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:54.340130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59304914-08d9-4646-abef-f88c6431c01c None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:54.340825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59304914-08d9-4646-abef-f88c6431c01c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:54.342281 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59304914-08d9-4646-abef-f88c6431c01c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:54.353637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-666a2da3-33e8-4655-bbc5-294abc0df8a0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 20:54:54.353637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:54.353637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:54.353637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:54.353637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:54.353637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:54.353637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:54.353637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:54.353637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:54.353637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:54.353637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:54.353637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:54.353637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:54:54.353637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:54:54.353637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:54:54.353637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:54.360098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:54.361223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:54.361223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:54.361223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:54:54.361223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:54:54.361223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:54:54.361223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:54:54.361223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:54:54.361223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:54:54.361223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 20:54:54.361223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:54.361223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 249/518] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:54.361223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a2da3-33e8-4655-bbc5-294abc0df8a0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:54.364625 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 270/519] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:54:54 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:54:54.365445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59304914-08d9-4646-abef-f88c6431c01c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:54.438522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:54.453873 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:54.480484 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a2da3-33e8-4655-bbc5-294abc0df8a0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:54.498629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59304914-08d9-4646-abef-f88c6431c01c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:54.520498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b981d8-345a-4c29-9f77-ff0dac86e0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:54.521361 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b981d8-345a-4c29-9f77-ff0dac86e0de None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:54.521748 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b981d8-345a-4c29-9f77-ff0dac86e0de None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:54.522674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b981d8-345a-4c29-9f77-ff0dac86e0de None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:54.523436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b981d8-345a-4c29-9f77-ff0dac86e0de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:54.523752 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b981d8-345a-4c29-9f77-ff0dac86e0de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:54.525198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b981d8-345a-4c29-9f77-ff0dac86e0de None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:54.537370 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08737f9b-540c-4a9e-8bfb-45e2a3d849d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:54.538495 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08737f9b-540c-4a9e-8bfb-45e2a3d849d4 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:54.538626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 250/520] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:54.539021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08737f9b-540c-4a9e-8bfb-45e2a3d849d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:54.539415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08737f9b-540c-4a9e-8bfb-45e2a3d849d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:54.539508 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b981d8-345a-4c29-9f77-ff0dac86e0de None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:54.551844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08737f9b-540c-4a9e-8bfb-45e2a3d849d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:54.553472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08737f9b-540c-4a9e-8bfb-45e2a3d849d4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:54.570274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-08737f9b-540c-4a9e-8bfb-45e2a3d849d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:54:54.570274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:54.570274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:54.570274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:54.570274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:54.570274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:54.570274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:54.570274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:54.570274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:54.570274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:54.570274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:54.570274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:54.570274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:54:54.570274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:54:54.570274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:54:54.571123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:54:54.571123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:54.571123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:54.571123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:54.571123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:54.571123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:54.571123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:54.571123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:54.571123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:54.571123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:54.571123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:54.571123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:54.571123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:54.571123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:54.571123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:54.571123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:54.571123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:54.571965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:54:54.571965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:54:54.571965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:54:54.571965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:54:54.571965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:54:54.571965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:54:54.571965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:54:54.571965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:54.571965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 271/521] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:54:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:54.572422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08737f9b-540c-4a9e-8bfb-45e2a3d849d4 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:54.661698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b981d8-345a-4c29-9f77-ff0dac86e0de None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:54.687844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08737f9b-540c-4a9e-8bfb-45e2a3d849d4 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:54.693312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:54.700488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb733e88-8236-48e4-a5dc-db89afb05520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:54.701357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733e88-8236-48e4-a5dc-db89afb05520 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:54.701678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733e88-8236-48e4-a5dc-db89afb05520 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:54.701941 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733e88-8236-48e4-a5dc-db89afb05520 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:54.709698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb733e88-8236-48e4-a5dc-db89afb05520 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:54.711540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb733e88-8236-48e4-a5dc-db89afb05520 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:54.712399 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:54.724548 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab66fc3-c1a6-4b96-ba1b-78f2b959bacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:54.725237 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab66fc3-c1a6-4b96-ba1b-78f2b959bacb None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:54.725521 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab66fc3-c1a6-4b96-ba1b-78f2b959bacb None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:54.725816 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab66fc3-c1a6-4b96-ba1b-78f2b959bacb None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:54.726741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab66fc3-c1a6-4b96-ba1b-78f2b959bacb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:54.727018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-eb733e88-8236-48e4-a5dc-db89afb05520 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:54:54.727018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:54.727018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:54.727018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:54.727018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:54.727018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:54.727018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:54.727018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:54.727018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:54.727018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:54.727018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:54.727018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:54.727018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:54:54.727018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:54:54.727018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:54:54.727789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:54:54.727789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:54.727789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:54.727789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:54.727789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:54.727789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:54.727789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:54.727789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:54.727789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:54.727789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:54.727789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:54.727789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:54.727789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:54.727789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:54.727789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:54.727789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:54.727789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:54.733526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:54:54.733526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:54:54.733526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:54:54.733526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:54:54.733526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:54:54.733526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:54:54.733526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:54:54.733526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:54.734038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab66fc3-c1a6-4b96-ba1b-78f2b959bacb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:54.734145 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 251/522] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:54:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:54.734297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab66fc3-c1a6-4b96-ba1b-78f2b959bacb None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:54.734415 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb733e88-8236-48e4-a5dc-db89afb05520 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:54.752077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 272/523] 10.222.0.61 () {56 vars in 1137 bytes} [Thu May 26 20:54:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:54.752077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab66fc3-c1a6-4b96-ba1b-78f2b959bacb None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:54.848607 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb733e88-8236-48e4-a5dc-db89afb05520 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:54.865699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab66fc3-c1a6-4b96-ba1b-78f2b959bacb None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:54.885294 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9221fa-edd1-4da3-8523-b2dbba3e67fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:54.886141 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9221fa-edd1-4da3-8523-b2dbba3e67fb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:54.886402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9221fa-edd1-4da3-8523-b2dbba3e67fb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:54.887118 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9221fa-edd1-4da3-8523-b2dbba3e67fb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:54.898915 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9221fa-edd1-4da3-8523-b2dbba3e67fb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:54.900511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9221fa-edd1-4da3-8523-b2dbba3e67fb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:54.901376 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6fe26-650e-4926-8924-742a4f126cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:54.902088 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6fe26-650e-4926-8924-742a4f126cbc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:54.902375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6fe26-650e-4926-8924-742a4f126cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:54.902647 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6fe26-650e-4926-8924-742a4f126cbc None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:54.903450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6fe26-650e-4926-8924-742a4f126cbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:54.903755 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6fe26-650e-4926-8924-742a4f126cbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:54.905194 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6fe26-650e-4926-8924-742a4f126cbc None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:54.915985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-2d9221fa-edd1-4da3-8523-b2dbba3e67fb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 20:54:54.915985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:54.915985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:54.915985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:54.915985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:54.915985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:54.915985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:54.915985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:54.915985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:54.915985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:54.915985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:54.915985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:54.915985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:54:54.915985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:54:54.915985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:54:54.915985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:54.917005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:54.918062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:54.918062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:54.918062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:54:54.918062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:54:54.918062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:54:54.918062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:54:54.918062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:54:54.918062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:54:54.918062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 20:54:54.918062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:54.922168 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 252/524] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:54:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:54.922972 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9221fa-edd1-4da3-8523-b2dbba3e67fb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:54.930139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 273/525] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:54:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:54.930139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6fe26-650e-4926-8924-742a4f126cbc None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:54.970872 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:54.980923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:55.033064 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6fe26-650e-4926-8924-742a4f126cbc None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:55.035809 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9221fa-edd1-4da3-8523-b2dbba3e67fb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:55.069858 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d67a4-15e3-4ed8-b1d5-a712a5f5e5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:55.070822 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d67a4-15e3-4ed8-b1d5-a712a5f5e5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:55.070935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e679fc-665c-475c-8212-24c8038fe790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:55.071380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d67a4-15e3-4ed8-b1d5-a712a5f5e5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:55.071554 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e679fc-665c-475c-8212-24c8038fe790 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:55.071835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e679fc-665c-475c-8212-24c8038fe790 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:55.072083 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d67a4-15e3-4ed8-b1d5-a712a5f5e5b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:55.072188 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e679fc-665c-475c-8212-24c8038fe790 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:55.072883 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e679fc-665c-475c-8212-24c8038fe790 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:55.073188 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e679fc-665c-475c-8212-24c8038fe790 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:55.074660 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e679fc-665c-475c-8212-24c8038fe790 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:55.098960 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 253/526] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:54:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:55.098960 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e679fc-665c-475c-8212-24c8038fe790 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:55.149316 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d67a4-15e3-4ed8-b1d5-a712a5f5e5b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:55.151283 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d67a4-15e3-4ed8-b1d5-a712a5f5e5b8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:55.195645 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:55.206050 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e679fc-665c-475c-8212-24c8038fe790 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:55.218950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:55.244675 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfd6cf-a315-4269-b406-8beeb8f1dd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:55.245602 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfd6cf-a315-4269-b406-8beeb8f1dd6f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:55.245909 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfd6cf-a315-4269-b406-8beeb8f1dd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:55.246179 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfd6cf-a315-4269-b406-8beeb8f1dd6f None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:55.247058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfd6cf-a315-4269-b406-8beeb8f1dd6f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:55.247331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfd6cf-a315-4269-b406-8beeb8f1dd6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:55.248793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfd6cf-a315-4269-b406-8beeb8f1dd6f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:55.263185 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 274/527] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:55.263185 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d67a4-15e3-4ed8-b1d5-a712a5f5e5b8 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:55.271865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 254/528] 10.222.0.61 () {56 vars in 1139 bytes} [Thu May 26 20:54:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:55.271865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfd6cf-a315-4269-b406-8beeb8f1dd6f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:55.364791 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d67a4-15e3-4ed8-b1d5-a712a5f5e5b8 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:55.378077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfd6cf-a315-4269-b406-8beeb8f1dd6f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:55.401191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46ab59-1b1b-4adf-ac4d-6cf3c90825df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:55.401876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46ab59-1b1b-4adf-ac4d-6cf3c90825df None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:55.402160 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46ab59-1b1b-4adf-ac4d-6cf3c90825df None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:55.402432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46ab59-1b1b-4adf-ac4d-6cf3c90825df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:55.403262 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46ab59-1b1b-4adf-ac4d-6cf3c90825df None admin] RBAC: Adding query filter params (role.id=6046421464dd48ea8977d7d1481bde10, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=e877e97dae064fe9ad3d378296b78ff9) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:55.403569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46ab59-1b1b-4adf-ac4d-6cf3c90825df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:55.405039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46ab59-1b1b-4adf-ac4d-6cf3c90825df None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:55.411011 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 275/529] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:55 2022] GET /identity/v3/role_assignments?user.id=e877e97dae064fe9ad3d378296b78ff9&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=6046421464dd48ea8977d7d1481bde10 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:55.411803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46ab59-1b1b-4adf-ac4d-6cf3c90825df None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:55.419223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:55.424315 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05cf05-1432-4b4e-af56-b6104ac848fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:55.425267 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05cf05-1432-4b4e-af56-b6104ac848fa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:55.425707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05cf05-1432-4b4e-af56-b6104ac848fa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:55.426095 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05cf05-1432-4b4e-af56-b6104ac848fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:55.427771 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05cf05-1432-4b4e-af56-b6104ac848fa None admin] RBAC: Adding query filter params (role.id=6046421464dd48ea8977d7d1481bde10, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=a99b767501244338bc48fb5428a589a1) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:55.428088 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05cf05-1432-4b4e-af56-b6104ac848fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:55.429733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05cf05-1432-4b4e-af56-b6104ac848fa None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:55.444153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 255/530] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:55 2022] GET /identity/v3/role_assignments?user.id=a99b767501244338bc48fb5428a589a1&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=6046421464dd48ea8977d7d1481bde10 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:55.445371 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05cf05-1432-4b4e-af56-b6104ac848fa None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:55.521564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:55.617044 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46ab59-1b1b-4adf-ac4d-6cf3c90825df None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:55.661264 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05cf05-1432-4b4e-af56-b6104ac848fa None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:55.693038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c3d06-25ac-44bd-a2f2-be0f68346dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:55.693903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3d06-25ac-44bd-a2f2-be0f68346dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:55.694190 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3d06-25ac-44bd-a2f2-be0f68346dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:55.694465 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3d06-25ac-44bd-a2f2-be0f68346dd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:55.708734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c3d06-25ac-44bd-a2f2-be0f68346dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:55.712730 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c3d06-25ac-44bd-a2f2-be0f68346dd4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:55.723528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ffef5-61c2-4639-8d33-2101a4eacfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:55.724598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ffef5-61c2-4639-8d33-2101a4eacfff None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:55.725070 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ffef5-61c2-4639-8d33-2101a4eacfff None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:55.725530 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ffef5-61c2-4639-8d33-2101a4eacfff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:55.734672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-4e9c3d06-25ac-44bd-a2f2-be0f68346dd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:55.734672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:55.734672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:55.734672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:55.734672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:55.734672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:55.734672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:55.734672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:55.734672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:55.734672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:55.734672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:55.734672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:55.734672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:54:55.734672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:54:55.734672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:54:55.735550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:54:55.735550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:55.735550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:55.735550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:55.735550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:55.735550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:55.735550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:55.735550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:55.735550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:55.735550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:55.735550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:55.735550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:55.735550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:55.735550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:55.735550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:55.735550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:55.735550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:55.736383 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:54:55.736383 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:54:55.736383 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:55.736383 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:55.736383 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 276/531] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:55.745619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c3d06-25ac-44bd-a2f2-be0f68346dd4 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:55.816679 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ffef5-61c2-4639-8d33-2101a4eacfff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:55.818291 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ffef5-61c2-4639-8d33-2101a4eacfff None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:55.874145 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:55.885029 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:55.948039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c3d06-25ac-44bd-a2f2-be0f68346dd4 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:55.969439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 256/532] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:55.974724 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ffef5-61c2-4639-8d33-2101a4eacfff None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:56.023699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912131a-645b-4e6b-8f5c-e70271ec5cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:56.024392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912131a-645b-4e6b-8f5c-e70271ec5cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:56.024684 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912131a-645b-4e6b-8f5c-e70271ec5cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:56.024963 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912131a-645b-4e6b-8f5c-e70271ec5cb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:56.025703 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912131a-645b-4e6b-8f5c-e70271ec5cb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:56.026035 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912131a-645b-4e6b-8f5c-e70271ec5cb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:56.027455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912131a-645b-4e6b-8f5c-e70271ec5cb0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:56.048480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 277/533] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:56.055465 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912131a-645b-4e6b-8f5c-e70271ec5cb0 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:56.141106 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ffef5-61c2-4639-8d33-2101a4eacfff None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:56.182150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:56.184501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0b184-67d4-4990-ad6b-7b8fe6d6394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:56.185363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0b184-67d4-4990-ad6b-7b8fe6d6394d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:56.185631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0b184-67d4-4990-ad6b-7b8fe6d6394d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:56.186080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0b184-67d4-4990-ad6b-7b8fe6d6394d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:56.199109 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0b184-67d4-4990-ad6b-7b8fe6d6394d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:56.200612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0b184-67d4-4990-ad6b-7b8fe6d6394d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:56.221286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-12b0b184-67d4-4990-ad6b-7b8fe6d6394d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:56.221286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:56.221286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:56.221286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:56.221286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:56.221286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:56.221286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:56.221286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:56.221286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:56.221286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:56.221286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:56.221286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:56.221286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:54:56.221286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:54:56.221286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:54:56.222215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:54:56.222215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:56.222215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:56.222215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:56.222215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:56.222215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:56.222215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:56.222215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:56.222215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:56.222215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:56.222215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:56.222215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:56.222215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:56.222215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:56.222215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:56.222215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:56.222215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:56.223031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:54:56.223031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:54:56.223031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:56.223031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:56.223233 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 257/534] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:56.230792 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0b184-67d4-4990-ad6b-7b8fe6d6394d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:56.263058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912131a-645b-4e6b-8f5c-e70271ec5cb0 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:56.295501 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:56.331286 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074031f-3fc5-4b37-afed-62690a8755b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:56.332166 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074031f-3fc5-4b37-afed-62690a8755b0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:56.332454 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074031f-3fc5-4b37-afed-62690a8755b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:56.332731 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074031f-3fc5-4b37-afed-62690a8755b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:56.342970 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074031f-3fc5-4b37-afed-62690a8755b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:56.344634 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074031f-3fc5-4b37-afed-62690a8755b0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:56.368811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-a074031f-3fc5-4b37-afed-62690a8755b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:54:56.368811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:56.368811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:56.368811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:56.368811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:56.368811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:56.368811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:56.368811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:56.368811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:56.368811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:56.368811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:56.368811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:56.368811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:54:56.368811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:54:56.368811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:54:56.369685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:54:56.369685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:56.369685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:56.369685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:56.369685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:56.369685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:56.369685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:56.369685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:56.369685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:56.369685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:56.369685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:56.369685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:56.369685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:56.369685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:56.369685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:56.369685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:56.369685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:56.370537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:54:56.370537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:54:56.370537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:54:56.370537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:54:56.370537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:54:56.370537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:54:56.370537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:54:56.370537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:56.372743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 278/535] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:54:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:56.380798 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074031f-3fc5-4b37-afed-62690a8755b0 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:56.421977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0b184-67d4-4990-ad6b-7b8fe6d6394d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:56.486295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612f940-f650-43f1-9fd9-aafacc0841ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:56.486989 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612f940-f650-43f1-9fd9-aafacc0841ce None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:56.487319 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612f940-f650-43f1-9fd9-aafacc0841ce None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:56.487601 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612f940-f650-43f1-9fd9-aafacc0841ce None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:56.488348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612f940-f650-43f1-9fd9-aafacc0841ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:56.488656 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612f940-f650-43f1-9fd9-aafacc0841ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:56.490138 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612f940-f650-43f1-9fd9-aafacc0841ce None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:56.515069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 258/536] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:56.520829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612f940-f650-43f1-9fd9-aafacc0841ce None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:56.573744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074031f-3fc5-4b37-afed-62690a8755b0 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:56.614659 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76bd34-a068-45dd-a78d-6491fe932031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:56.615341 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76bd34-a068-45dd-a78d-6491fe932031 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:56.616104 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76bd34-a068-45dd-a78d-6491fe932031 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:56.616444 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76bd34-a068-45dd-a78d-6491fe932031 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:56.617677 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76bd34-a068-45dd-a78d-6491fe932031 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:56.618024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76bd34-a068-45dd-a78d-6491fe932031 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:56.619507 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76bd34-a068-45dd-a78d-6491fe932031 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:56.624623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:56.637885 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 279/537] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:54:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:56.642814 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76bd34-a068-45dd-a78d-6491fe932031 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:56.710354 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:56.725313 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612f940-f650-43f1-9fd9-aafacc0841ce None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:56.767803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd2eba-f2fb-436e-b136-b359b6dd07f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:56.768631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd2eba-f2fb-436e-b136-b359b6dd07f1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:56.769335 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd2eba-f2fb-436e-b136-b359b6dd07f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:56.769335 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd2eba-f2fb-436e-b136-b359b6dd07f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:56.779099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd2eba-f2fb-436e-b136-b359b6dd07f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:56.780657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd2eba-f2fb-436e-b136-b359b6dd07f1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:56.794856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76bd34-a068-45dd-a78d-6491fe932031 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:56.796626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-fdcd2eba-f2fb-436e-b136-b359b6dd07f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:54:56.796626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:56.796626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:56.796626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:56.796626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:56.796626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:56.796626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:56.796626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:56.796626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:56.796626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:56.796626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:56.796626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:56.796626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:54:56.796626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:54:56.796626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:54:56.797836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:54:56.797836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:56.797836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:56.797836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:56.797836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:56.797836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:56.797836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:56.797836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:56.797836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:56.797836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:56.797836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:56.797836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:56.797836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:56.797836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:56.797836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:56.797836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:56.797836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:56.798803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:54:56.798803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:54:56.798803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:54:56.798803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:54:56.798803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:54:56.798803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:54:56.798803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:54:56.798803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:56.803007 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 259/538] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:54:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:56.804661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a530624-b3da-49f9-ba7e-28cf111d4ef3 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:56.804959 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a530624-b3da-49f9-ba7e-28cf111d4ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:56.805234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a530624-b3da-49f9-ba7e-28cf111d4ef3 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:56.806941 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 260/539] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:56.807847 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a530624-b3da-49f9-ba7e-28cf111d4ef3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:56.841425 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d93161-a1bf-458c-bbd0-b8918116153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:56.842594 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d93161-a1bf-458c-bbd0-b8918116153a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:56.843033 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d93161-a1bf-458c-bbd0-b8918116153a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:56.843768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d93161-a1bf-458c-bbd0-b8918116153a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:56.845034 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d93161-a1bf-458c-bbd0-b8918116153a None admin] RBAC: Adding query filter params (role.id=6046421464dd48ea8977d7d1481bde10, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=7d7e1c8c42cd4f6dab8b27829e5fc5ed) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:56.845663 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d93161-a1bf-458c-bbd0-b8918116153a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:56.847934 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d93161-a1bf-458c-bbd0-b8918116153a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:56.855570 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 280/540] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:56 2022] GET /identity/v3/role_assignments?user.id=7d7e1c8c42cd4f6dab8b27829e5fc5ed&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=6046421464dd48ea8977d7d1481bde10 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:56.856546 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d2132-b59e-4c20-8745-abfa1d894d7b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:56.859442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d2132-b59e-4c20-8745-abfa1d894d7b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:56.859442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d2132-b59e-4c20-8745-abfa1d894d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:56.880377 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6b9d2132-b59e-4c20-8745-abfa1d894d7b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:56.881741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6b9d2132-b59e-4c20-8745-abfa1d894d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:56.963391 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 281/541] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:56.987150 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d2132-b59e-4c20-8745-abfa1d894d7b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:57.013533 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a530624-b3da-49f9-ba7e-28cf111d4ef3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:57.019275 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:57.025298 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:57.101771 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e42be-cd62-497b-9960-3634ee8db2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:57.102497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e42be-cd62-497b-9960-3634ee8db2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:57.102776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e42be-cd62-497b-9960-3634ee8db2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:57.103048 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e42be-cd62-497b-9960-3634ee8db2e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:57.103649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d2132-b59e-4c20-8745-abfa1d894d7b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:57.104091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e42be-cd62-497b-9960-3634ee8db2e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:57.104173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e42be-cd62-497b-9960-3634ee8db2e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:57.105747 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e42be-cd62-497b-9960-3634ee8db2e6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:57.133224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 261/542] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:54:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:57.139444 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e42be-cd62-497b-9960-3634ee8db2e6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:57.146297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d182c0-0f4e-42d6-8952-b2fe022355b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:57.147133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d182c0-0f4e-42d6-8952-b2fe022355b0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:57.147414 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d182c0-0f4e-42d6-8952-b2fe022355b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:57.147683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d182c0-0f4e-42d6-8952-b2fe022355b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:57.165378 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d182c0-0f4e-42d6-8952-b2fe022355b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:57.174568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-65d182c0-0f4e-42d6-8952-b2fe022355b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:54:57.174568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:57.174568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:57.174568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:57.174568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:57.174568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:57.174568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:57.174568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:57.174568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:57.174568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:57.174568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:57.174568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:57.174568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:57.174568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:57.174568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:57.174568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:57.175462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:57.175462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:57.175462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:57.175462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:57.175462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:57.175462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:57.175462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:57.175462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:57.175462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:57.175462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:57.175462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:57.175462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:57.175462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:57.175462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:57.175462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:57.175462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:57.176229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:57.176229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:57.176229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:57.176229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:57.176229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:57.176229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:57.176229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:57.176229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:57.176229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:57.176229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:57.176229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:54:57.176229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:57.176229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 282/543] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:54:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:57.181581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d182c0-0f4e-42d6-8952-b2fe022355b0 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:57.279134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:57.289722 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d182c0-0f4e-42d6-8952-b2fe022355b0 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:57.327309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e06cb-8652-48b8-9318-510b86410f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:57.328055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e06cb-8652-48b8-9318-510b86410f75 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:57.328343 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e06cb-8652-48b8-9318-510b86410f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:57.328620 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e06cb-8652-48b8-9318-510b86410f75 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:57.329386 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e06cb-8652-48b8-9318-510b86410f75 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:57.329698 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e06cb-8652-48b8-9318-510b86410f75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:57.331144 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e06cb-8652-48b8-9318-510b86410f75 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:57.340981 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 283/544] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:54:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:57.346888 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e06cb-8652-48b8-9318-510b86410f75 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:57.362955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e42be-cd62-497b-9960-3634ee8db2e6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:57.402985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d41563-352a-4b93-b0b8-6af0e16c88ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:57.403661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d41563-352a-4b93-b0b8-6af0e16c88ed None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:57.403943 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d41563-352a-4b93-b0b8-6af0e16c88ed None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:57.404221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d41563-352a-4b93-b0b8-6af0e16c88ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:57.405062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d41563-352a-4b93-b0b8-6af0e16c88ed None admin] RBAC: Adding query filter params (role.id=6046421464dd48ea8977d7d1481bde10, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=e3514a1833104114894abe6c41ea30a6) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:57.405375 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d41563-352a-4b93-b0b8-6af0e16c88ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:57.407699 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d41563-352a-4b93-b0b8-6af0e16c88ed None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:57.415137 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 262/545] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:57 2022] GET /identity/v3/role_assignments?user.id=e3514a1833104114894abe6c41ea30a6&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=6046421464dd48ea8977d7d1481bde10 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:57.532941 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e06cb-8652-48b8-9318-510b86410f75 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:57.585055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49ccb8-ac77-4cec-a371-1ed0371b614c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:57.586275 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49ccb8-ac77-4cec-a371-1ed0371b614c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:57.586561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49ccb8-ac77-4cec-a371-1ed0371b614c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:57.586839 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49ccb8-ac77-4cec-a371-1ed0371b614c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:57.599381 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49ccb8-ac77-4cec-a371-1ed0371b614c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:57.600895 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49ccb8-ac77-4cec-a371-1ed0371b614c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:57.619907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-2a49ccb8-ac77-4cec-a371-1ed0371b614c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:57.619907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:57.619907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:57.619907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:57.619907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:57.619907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:57.619907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:57.619907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:57.619907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:57.619907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:57.619907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:57.619907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:57.619907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:54:57.619907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:54:57.619907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:54:57.620805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:54:57.620805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:57.620805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:57.620805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:57.620805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:57.620805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:57.620805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:57.620805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:57.620805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:57.620805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:57.620805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:57.620805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:57.620805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:57.620805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:57.620805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:57.620805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:57.620805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:57.623020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:54:57.623020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:54:57.623020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:57.623020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:57.623020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 284/546] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:57.629772 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d41563-352a-4b93-b0b8-6af0e16c88ed None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:57.690862 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:57.795483 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d41563-352a-4b93-b0b8-6af0e16c88ed None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:57.843255 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb50347-dc9b-4cb8-9d46-2a466fb69683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:57.844407 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb50347-dc9b-4cb8-9d46-2a466fb69683 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:57.844878 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb50347-dc9b-4cb8-9d46-2a466fb69683 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:57.845341 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb50347-dc9b-4cb8-9d46-2a466fb69683 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:57.846285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb50347-dc9b-4cb8-9d46-2a466fb69683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:57.846808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb50347-dc9b-4cb8-9d46-2a466fb69683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:57.848395 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb50347-dc9b-4cb8-9d46-2a466fb69683 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:57.867107 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 263/547] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:57.873056 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49ccb8-ac77-4cec-a371-1ed0371b614c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:57.887074 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:57.990171 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daf40f-9747-401b-a2d9-29f2f12125bb None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:57.990506 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daf40f-9747-401b-a2d9-29f2f12125bb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:57.990735 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daf40f-9747-401b-a2d9-29f2f12125bb None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:57.992381 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 264/548] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:58.003268 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d900-2d17-41ec-ac0b-3b428ca39947 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:58.003544 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d900-2d17-41ec-ac0b-3b428ca39947 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:58.003817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d900-2d17-41ec-ac0b-3b428ca39947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:58.013625 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49ccb8-ac77-4cec-a371-1ed0371b614c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:58.050941 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0610d900-2d17-41ec-ac0b-3b428ca39947 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:58.052079 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0610d900-2d17-41ec-ac0b-3b428ca39947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:58.052401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959915d6-b4a3-425c-b2bd-0240d0596f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:58.053228 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959915d6-b4a3-425c-b2bd-0240d0596f4b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:58.053514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959915d6-b4a3-425c-b2bd-0240d0596f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:58.053810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959915d6-b4a3-425c-b2bd-0240d0596f4b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:58.064968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959915d6-b4a3-425c-b2bd-0240d0596f4b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:58.066558 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959915d6-b4a3-425c-b2bd-0240d0596f4b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:58.082628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-959915d6-b4a3-425c-b2bd-0240d0596f4b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 20:54:58.082628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:58.082628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:58.082628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:58.082628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:58.082628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:58.082628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:58.082628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:58.082628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:58.082628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:58.082628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:58.082628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:58.082628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:54:58.082628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:54:58.082628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:54:58.082628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:58.084068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:58.085350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:58.085350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:58.085350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:54:58.085350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:54:58.085350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:54:58.085350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:54:58.085350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:54:58.085350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:54:58.085350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 20:54:58.085350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:58.085350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 285/549] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:54:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:58.092076 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959915d6-b4a3-425c-b2bd-0240d0596f4b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:58.190883 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 265/550] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:54:58.197458 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:58.218195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610d900-2d17-41ec-ac0b-3b428ca39947 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:58.240450 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:58.262439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959915d6-b4a3-425c-b2bd-0240d0596f4b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:58.307417 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85597b3c-8887-433b-905a-185d0746a851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:58.308326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85597b3c-8887-433b-905a-185d0746a851 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:58.308617 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85597b3c-8887-433b-905a-185d0746a851 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:58.308900 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85597b3c-8887-433b-905a-185d0746a851 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:58.310096 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85597b3c-8887-433b-905a-185d0746a851 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:58.310435 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85597b3c-8887-433b-905a-185d0746a851 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:58.312988 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85597b3c-8887-433b-905a-185d0746a851 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:58.340097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 286/551] 10.222.0.61 () {56 vars in 1135 bytes} [Thu May 26 20:54:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:58.342333 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b9192-867e-4b95-af83-e58fa81b8487 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:58.342626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b9192-867e-4b95-af83-e58fa81b8487 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:58.343174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b9192-867e-4b95-af83-e58fa81b8487 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:58.345372 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 287/552] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:58.346397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b9192-867e-4b95-af83-e58fa81b8487 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:58.348062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610d900-2d17-41ec-ac0b-3b428ca39947 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:58.393777 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46ffe7-4531-47c0-9fe2-ff1d9c331334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:58.394626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46ffe7-4531-47c0-9fe2-ff1d9c331334 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:58.394912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46ffe7-4531-47c0-9fe2-ff1d9c331334 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:58.395187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46ffe7-4531-47c0-9fe2-ff1d9c331334 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:58.406999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46ffe7-4531-47c0-9fe2-ff1d9c331334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:58.415153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-bd46ffe7-4531-47c0-9fe2-ff1d9c331334 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:54:58.415153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:58.415153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:58.415153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:58.415153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:58.415153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:58.415153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:58.415153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:58.415153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:58.415153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:58.415153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:58.415153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:58.415153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:58.415153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:58.415153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:58.415153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:58.417472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:58.417472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:58.417472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:58.417472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:58.417472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:58.417472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:58.417472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:58.417472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:58.417472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:58.417472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:58.417472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:58.417472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:58.417472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:58.417472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:58.417472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:58.417472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:58.419402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:58.419402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:58.419402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:58.419402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:58.419402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:58.419402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:58.419402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:58.419402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:58.419402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:58.419402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:58.419402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:54:58.419402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:58.419402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 266/553] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:54:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:58.419402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340940e-faf2-4796-abd9-ec3467faa05a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:58.422405 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340940e-faf2-4796-abd9-ec3467faa05a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:58.422405 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340940e-faf2-4796-abd9-ec3467faa05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:58.439028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e340940e-faf2-4796-abd9-ec3467faa05a None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:58.440701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e340940e-faf2-4796-abd9-ec3467faa05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:58.461023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b9192-867e-4b95-af83-e58fa81b8487 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:58.485651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:58.498378 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af30ca-62e1-4bdd-8c51-7371060f3b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:58.498885 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af30ca-62e1-4bdd-8c51-7371060f3b6a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:58.499499 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af30ca-62e1-4bdd-8c51-7371060f3b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:58.500009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af30ca-62e1-4bdd-8c51-7371060f3b6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:58.517754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 267/554] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:58.518904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340940e-faf2-4796-abd9-ec3467faa05a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:58.530142 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:58.573054 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af30ca-62e1-4bdd-8c51-7371060f3b6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:58.574526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af30ca-62e1-4bdd-8c51-7371060f3b6a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:58.631062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340940e-faf2-4796-abd9-ec3467faa05a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:58.667924 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e53b14-21aa-47e0-a0a7-05fb22958343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:58.668706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e53b14-21aa-47e0-a0a7-05fb22958343 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:58.668989 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e53b14-21aa-47e0-a0a7-05fb22958343 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:58.669259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e53b14-21aa-47e0-a0a7-05fb22958343 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:58.670039 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e53b14-21aa-47e0-a0a7-05fb22958343 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:58.670342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e53b14-21aa-47e0-a0a7-05fb22958343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:58.672199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e53b14-21aa-47e0-a0a7-05fb22958343 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:58.681709 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 288/555] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:54:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:54:58.682593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af30ca-62e1-4bdd-8c51-7371060f3b6a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:58.685410 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 268/556] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:54:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:58.686929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e53b14-21aa-47e0-a0a7-05fb22958343 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:58.709035 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:58.770564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:58.805830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e53b14-21aa-47e0-a0a7-05fb22958343 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:58.819098 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af30ca-62e1-4bdd-8c51-7371060f3b6a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:58.841847 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aaf86-5754-4207-baaf-2e579d2f1f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:58.842595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aaf86-5754-4207-baaf-2e579d2f1f50 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:58.842873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aaf86-5754-4207-baaf-2e579d2f1f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:58.843142 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aaf86-5754-4207-baaf-2e579d2f1f50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:58.854993 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85aaf86-5754-4207-baaf-2e579d2f1f50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:58.856578 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85aaf86-5754-4207-baaf-2e579d2f1f50 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:58.856816 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe1075-4195-4468-a56f-eed41d2ea4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:58.857710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe1075-4195-4468-a56f-eed41d2ea4bb None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:58.858086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe1075-4195-4468-a56f-eed41d2ea4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:58.858512 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe1075-4195-4468-a56f-eed41d2ea4bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:58.869746 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe1075-4195-4468-a56f-eed41d2ea4bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:54:58.874307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c85aaf86-5754-4207-baaf-2e579d2f1f50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:58.874307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:58.874307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:58.874307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:58.874307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:58.874307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:58.874307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:58.874307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:58.874307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:58.874307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:58.874307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:58.874307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:58.874307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:54:58.874307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:54:58.874307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:54:58.875177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:54:58.875177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:58.875177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:58.875177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:58.875177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:58.875177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:58.875177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:58.875177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:58.875177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:58.875177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:58.875177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:58.875177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:58.875177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:58.875177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:58.875177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:58.875177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:58.875177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:58.876286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:54:58.876286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:54:58.876286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:58.876286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:58.876286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 269/557] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:54:58.877558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aaf86-5754-4207-baaf-2e579d2f1f50 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:58.878359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-9bbe1075-4195-4468-a56f-eed41d2ea4bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:54:58.878359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:58.878359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:58.878359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:58.878359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:58.878359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:58.878359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:58.878359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:58.878359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:58.878359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:58.878359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:58.878359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:58.878359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:54:58.878359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:54:58.878359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:54:58.878359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:54:58.879922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:54:58.879922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:54:58.879922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:54:58.879922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:54:58.879922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:58.879922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:58.879922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:58.879922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:58.879922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:58.879922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:58.879922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:58.879922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:54:58.879922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:58.879922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:58.879922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:58.879922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:58.880929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:58.880929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:58.880929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:58.880929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:58.880929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:54:58.880929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:54:58.880929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:54:58.880929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:54:58.880929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:54:58.880929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:54:58.880929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:54:58.880929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:54:58.884640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 289/558] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:54:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:58.886049 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe1075-4195-4468-a56f-eed41d2ea4bb None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:58.978326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:58.993834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aaf86-5754-4207-baaf-2e579d2f1f50 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:58.998519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe1075-4195-4468-a56f-eed41d2ea4bb None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:59.018349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:59.032757 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbc315-612c-4a11-815c-dae93eca0d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:59.034048 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbc315-612c-4a11-815c-dae93eca0d7c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:59.034489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbc315-612c-4a11-815c-dae93eca0d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:59.034959 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbc315-612c-4a11-815c-dae93eca0d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:59.036393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa54e28-b5f7-4d33-a625-20547be1835e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:59.037072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa54e28-b5f7-4d33-a625-20547be1835e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:59.037409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa54e28-b5f7-4d33-a625-20547be1835e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:59.037689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa54e28-b5f7-4d33-a625-20547be1835e None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:59.038454 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa54e28-b5f7-4d33-a625-20547be1835e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:59.038758 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa54e28-b5f7-4d33-a625-20547be1835e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:59.040219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa54e28-b5f7-4d33-a625-20547be1835e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:59.048511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbc315-612c-4a11-815c-dae93eca0d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:59.050342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbc315-612c-4a11-815c-dae93eca0d7c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:59.054139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 290/559] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:54:59.055093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa54e28-b5f7-4d33-a625-20547be1835e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:59.069912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-64bbc315-612c-4a11-815c-dae93eca0d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:59.069912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:59.069912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:59.069912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:59.069912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:59.069912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:59.069912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:59.069912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:59.069912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:59.069912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:59.069912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:59.069912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:59.069912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:54:59.069912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:54:59.069912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:54:59.070905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:54:59.070905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:59.070905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:59.070905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:59.070905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:59.070905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:59.070905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:59.070905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:59.070905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:59.070905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:59.070905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:59.070905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:59.070905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:59.070905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:59.070905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:59.070905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:59.070905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:59.071748 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:54:59.071748 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:54:59.071748 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:59.071748 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:59.073912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 270/560] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:59.079692 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbc315-612c-4a11-815c-dae93eca0d7c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:59.158577 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa54e28-b5f7-4d33-a625-20547be1835e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:59.190205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbc315-612c-4a11-815c-dae93eca0d7c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:59.194643 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69da7e-cdb1-49c0-a392-3924ce763abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:59.195336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69da7e-cdb1-49c0-a392-3924ce763abc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:59.195619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69da7e-cdb1-49c0-a392-3924ce763abc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:59.195896 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69da7e-cdb1-49c0-a392-3924ce763abc None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:59.196653 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69da7e-cdb1-49c0-a392-3924ce763abc None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:59.197018 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69da7e-cdb1-49c0-a392-3924ce763abc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:59.198514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69da7e-cdb1-49c0-a392-3924ce763abc None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:59.212580 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 291/561] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:54:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:59.213491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69da7e-cdb1-49c0-a392-3924ce763abc None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:59.217200 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:59.232344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e038de-a505-4de1-a0b8-422493c8348f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:59.233559 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e038de-a505-4de1-a0b8-422493c8348f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:59.234076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e038de-a505-4de1-a0b8-422493c8348f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:59.234611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e038de-a505-4de1-a0b8-422493c8348f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:59.242313 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e038de-a505-4de1-a0b8-422493c8348f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:59.244013 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e038de-a505-4de1-a0b8-422493c8348f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:59.260031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-01e038de-a505-4de1-a0b8-422493c8348f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:54:59.260031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:59.260031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:59.260031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:59.260031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:59.260031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:59.260031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:59.260031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:59.260031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:59.260031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:59.260031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:59.260031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:59.260031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:54:59.260031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:54:59.260031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:54:59.261004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:54:59.261004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:59.261004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:59.261004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:59.261004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:59.261004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:59.261004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:59.261004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:59.261004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:59.261004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:59.261004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:59.261004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:59.261004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:59.261004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:59.261004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:59.261004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:59.261004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:59.261889 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:54:59.261889 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:54:59.261889 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:54:59.261889 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:54:59.261889 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:54:59.261889 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:54:59.261889 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:54:59.261889 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:59.264582 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 271/562] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:54:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:59.265576 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e038de-a505-4de1-a0b8-422493c8348f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:59.307397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:59.322715 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69da7e-cdb1-49c0-a392-3924ce763abc None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:59.359527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a066b-ccf9-48bc-9b77-09c2a56c99f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:59.359998 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a066b-ccf9-48bc-9b77-09c2a56c99f9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:59.360290 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a066b-ccf9-48bc-9b77-09c2a56c99f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:59.360568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a066b-ccf9-48bc-9b77-09c2a56c99f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:59.361300 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a066b-ccf9-48bc-9b77-09c2a56c99f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:59.361605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a066b-ccf9-48bc-9b77-09c2a56c99f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:59.363102 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a066b-ccf9-48bc-9b77-09c2a56c99f9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:59.379913 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 292/563] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:59.379913 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a066b-ccf9-48bc-9b77-09c2a56c99f9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:59.399264 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e038de-a505-4de1-a0b8-422493c8348f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:59.444097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:59.447893 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de87c5-aece-4433-bb94-c19b05194ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:59.449092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de87c5-aece-4433-bb94-c19b05194ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:59.450131 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de87c5-aece-4433-bb94-c19b05194ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:59.450593 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de87c5-aece-4433-bb94-c19b05194ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:59.464946 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de87c5-aece-4433-bb94-c19b05194ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:59.466927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de87c5-aece-4433-bb94-c19b05194ae0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:59.486922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a066b-ccf9-48bc-9b77-09c2a56c99f9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:59.490837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-88de87c5-aece-4433-bb94-c19b05194ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:59.490837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:59.490837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:59.490837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:59.490837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:59.490837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:59.490837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:59.490837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:59.490837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:59.490837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:59.490837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:59.490837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:59.490837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:54:59.490837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:54:59.490837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:54:59.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:54:59.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:59.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:59.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:59.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:59.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:59.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:59.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:59.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:59.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:59.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:59.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:59.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:59.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:59.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:59.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:59.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:59.492536 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:54:59.492536 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:54:59.492536 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:54:59.492536 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:59.494814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 272/564] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:54:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:59.495819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de87c5-aece-4433-bb94-c19b05194ae0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:59.523912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94643d98-bbec-423f-8d61-52742b6e7fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:59.524591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94643d98-bbec-423f-8d61-52742b6e7fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:59.524869 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94643d98-bbec-423f-8d61-52742b6e7fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:59.525139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94643d98-bbec-423f-8d61-52742b6e7fa0 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:59.526115 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94643d98-bbec-423f-8d61-52742b6e7fa0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:59.526555 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94643d98-bbec-423f-8d61-52742b6e7fa0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:59.528011 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94643d98-bbec-423f-8d61-52742b6e7fa0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:59.546197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 293/565] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:54:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:59.547651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443b479-34de-4dd7-9db5-b4fac098b22d None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:59.547946 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443b479-34de-4dd7-9db5-b4fac098b22d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:59.548222 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443b479-34de-4dd7-9db5-b4fac098b22d None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:59.551169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 294/566] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:54:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:54:59.551935 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443b479-34de-4dd7-9db5-b4fac098b22d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:59.587831 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:59.604521 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de87c5-aece-4433-bb94-c19b05194ae0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:59.643625 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ad943-e511-4bbd-a541-825f18d39bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:59.644468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ad943-e511-4bbd-a541-825f18d39bab None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:59.644780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ad943-e511-4bbd-a541-825f18d39bab None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:59.645057 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ad943-e511-4bbd-a541-825f18d39bab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:59.654023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ad943-e511-4bbd-a541-825f18d39bab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:59.655515 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ad943-e511-4bbd-a541-825f18d39bab None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:59.663368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443b479-34de-4dd7-9db5-b4fac098b22d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:59.672190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-9f7ad943-e511-4bbd-a541-825f18d39bab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 20:54:59.672190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:54:59.672190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:54:59.672190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:54:59.672190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:54:59.672190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:54:59.672190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:54:59.672190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:54:59.672190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:54:59.672190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:54:59.672190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:54:59.672190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:54:59.672190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:54:59.672190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:54:59.672190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:54:59.672190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:54:59.673153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:54:59.674125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:54:59.674125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:54:59.674125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:54:59.674125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:54:59.674125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:54:59.674125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:54:59.674125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:54:59.674125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:54:59.674125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 20:54:59.674125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:54:59.674125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 273/567] 10.222.0.61 () {56 vars in 1093 bytes} [Thu May 26 20:54:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:54:59.674737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ad943-e511-4bbd-a541-825f18d39bab None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:59.691615 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:59.704572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623012b4-4642-4020-9402-0b63017bcf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:59.705176 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623012b4-4642-4020-9402-0b63017bcf33 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:59.705455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623012b4-4642-4020-9402-0b63017bcf33 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:59.705724 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623012b4-4642-4020-9402-0b63017bcf33 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:59.706480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623012b4-4642-4020-9402-0b63017bcf33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:59.706796 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623012b4-4642-4020-9402-0b63017bcf33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:59.708182 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623012b4-4642-4020-9402-0b63017bcf33 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:59.722852 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 295/568] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:59.724152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b518e8-1711-489c-905b-4d7b1136490b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:59.724444 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b518e8-1711-489c-905b-4d7b1136490b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:59.724718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b518e8-1711-489c-905b-4d7b1136490b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:59.742196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b1b518e8-1711-489c-905b-4d7b1136490b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:54:59.743386 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b1b518e8-1711-489c-905b-4d7b1136490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:54:59.789727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ad943-e511-4bbd-a541-825f18d39bab None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:59.823808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e223a27-c28b-486f-b29d-fead7dd4d388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:59.824472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e223a27-c28b-486f-b29d-fead7dd4d388 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:59.824750 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e223a27-c28b-486f-b29d-fead7dd4d388 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:59.824997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 296/569] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:54:59.825269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e223a27-c28b-486f-b29d-fead7dd4d388 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:54:59.825927 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b518e8-1711-489c-905b-4d7b1136490b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:59.826177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e223a27-c28b-486f-b29d-fead7dd4d388 None admin] RBAC: Adding query filter params (role.id=6046421464dd48ea8977d7d1481bde10, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=57a63879ec1242d08bba1ccad6212788) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:54:59.826439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e223a27-c28b-486f-b29d-fead7dd4d388 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:54:59.827934 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e223a27-c28b-486f-b29d-fead7dd4d388 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:54:59.833770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 274/570] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:54:59 2022] GET /identity/v3/role_assignments?user.id=57a63879ec1242d08bba1ccad6212788&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=6046421464dd48ea8977d7d1481bde10 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:54:59.834606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e223a27-c28b-486f-b29d-fead7dd4d388 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:54:59.849975 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:59.958145 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e223a27-c28b-486f-b29d-fead7dd4d388 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:59.963457 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b518e8-1711-489c-905b-4d7b1136490b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:54:59.981139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:54:59.998475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0f54a-df54-426b-af0e-716abbc0ac2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:54:59.999287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0f54a-df54-426b-af0e-716abbc0ac2e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:54:59.999658 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0f54a-df54-426b-af0e-716abbc0ac2e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:54:59.999963 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0f54a-df54-426b-af0e-716abbc0ac2e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:00.004128 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1620f-fe92-416a-9a0d-506a3a1ebe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:00.004830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1620f-fe92-416a-9a0d-506a3a1ebe13 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:00.005115 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1620f-fe92-416a-9a0d-506a3a1ebe13 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:00.005392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1620f-fe92-416a-9a0d-506a3a1ebe13 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:00.006294 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1620f-fe92-416a-9a0d-506a3a1ebe13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:00.006610 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1620f-fe92-416a-9a0d-506a3a1ebe13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:00.008118 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1620f-fe92-416a-9a0d-506a3a1ebe13 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:00.008224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0f54a-df54-426b-af0e-716abbc0ac2e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:00.009732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0f54a-df54-426b-af0e-716abbc0ac2e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:00.029874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d3c0f54a-df54-426b-af0e-716abbc0ac2e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 20:55:00.029874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:00.029874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:00.029874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:00.029874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:00.029874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:00.029874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:00.029874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:00.029874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:00.029874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:00.029874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:00.029874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:00.029874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:00.029874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:00.029874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:00.029874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:00.034206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:00.035245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:00.035245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:00.035245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:00.035245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:00.035245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:00.035245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:00.035245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:00.035245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:00.035245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 20:55:00.035245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:00.035784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 297/571] 10.222.0.61 () {56 vars in 1133 bytes} [Thu May 26 20:54:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:00.035859 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 275/572] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:54:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:00.035925 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670622d-890c-4dbf-a489-313d0fec05db None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:00.035925 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670622d-890c-4dbf-a489-313d0fec05db None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:00.036054 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0f54a-df54-426b-af0e-716abbc0ac2e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:00.036120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670622d-890c-4dbf-a489-313d0fec05db None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:00.036120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 298/573] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:00.036120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670622d-890c-4dbf-a489-313d0fec05db None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:00.112653 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:00.147071 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670622d-890c-4dbf-a489-313d0fec05db None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:00.155283 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0f54a-df54-426b-af0e-716abbc0ac2e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:00.182839 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc9f7c-8146-4d95-8baf-931d159e3487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:00.183655 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc9f7c-8146-4d95-8baf-931d159e3487 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:00.183935 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc9f7c-8146-4d95-8baf-931d159e3487 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:00.184216 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc9f7c-8146-4d95-8baf-931d159e3487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:00.194931 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc9f7c-8146-4d95-8baf-931d159e3487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:00.195349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635ad19-a373-4258-9022-cac97208bdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:00.196163 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635ad19-a373-4258-9022-cac97208bdac None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:00.196401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc9f7c-8146-4d95-8baf-931d159e3487 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:00.196499 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635ad19-a373-4258-9022-cac97208bdac None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:00.196705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635ad19-a373-4258-9022-cac97208bdac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:00.209073 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635ad19-a373-4258-9022-cac97208bdac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:00.214563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-00dc9f7c-8146-4d95-8baf-931d159e3487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:00.214563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:00.214563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:00.214563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:00.214563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:00.214563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:00.214563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:00.214563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:00.214563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:00.214563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:00.214563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:00.214563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:00.214563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:00.214563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:00.214563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:00.215744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:00.215744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:00.215744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:00.215744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:00.215744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:00.215744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:00.215744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:00.215744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:00.215744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:00.215744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:00.215744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:00.215744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:00.215744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:00.215744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:00.215744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:00.215744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:00.215744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:00.216611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:00.216611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:00.216611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:00.216611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:00.216611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 299/574] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:00.217434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc9f7c-8146-4d95-8baf-931d159e3487 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:00.219144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a635ad19-a373-4258-9022-cac97208bdac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:00.219144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:00.219144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:00.219144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:00.219144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:00.219144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:00.219144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:00.219144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:00.219144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:00.219144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:00.219144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:00.219144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:00.219144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:00.219144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:00.219144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:00.219144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:00.220091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:00.220091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:00.220091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:00.220091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:00.220091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:00.220091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:00.220091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:00.220091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:00.220091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:00.220091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:00.220091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:00.220091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:00.220091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:00.220091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:00.220091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:00.220091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:00.220918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:00.220918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:00.220918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:00.220918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:00.220918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:00.220918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:00.220918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:00.220918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:00.220918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:00.220918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:00.220918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:00.220918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:00.222486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 276/575] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:55:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:00.225073 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb417b6a-8dd6-4258-be65-909c19fde88b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:00.225596 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb417b6a-8dd6-4258-be65-909c19fde88b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:00.225941 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb417b6a-8dd6-4258-be65-909c19fde88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:00.244283 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-eb417b6a-8dd6-4258-be65-909c19fde88b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:00.245547 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-eb417b6a-8dd6-4258-be65-909c19fde88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:00.245898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:00.320471 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 277/576] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:55:00.322072 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb417b6a-8dd6-4258-be65-909c19fde88b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:00.329819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc9f7c-8146-4d95-8baf-931d159e3487 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:00.371792 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09049187-f196-4985-a5d0-67d57dfa8621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:00.372477 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09049187-f196-4985-a5d0-67d57dfa8621 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:00.372781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09049187-f196-4985-a5d0-67d57dfa8621 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:00.373057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09049187-f196-4985-a5d0-67d57dfa8621 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:00.373942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09049187-f196-4985-a5d0-67d57dfa8621 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:00.374254 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09049187-f196-4985-a5d0-67d57dfa8621 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:00.375776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09049187-f196-4985-a5d0-67d57dfa8621 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:00.389666 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:00.398898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 300/577] 10.222.0.61 () {56 vars in 1137 bytes} [Thu May 26 20:55:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:00.398898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09049187-f196-4985-a5d0-67d57dfa8621 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:00.435964 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb417b6a-8dd6-4258-be65-909c19fde88b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:00.475369 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9a49a-b47c-4f92-97f3-189242ba3733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:00.476110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9a49a-b47c-4f92-97f3-189242ba3733 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:00.476392 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9a49a-b47c-4f92-97f3-189242ba3733 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:00.476669 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9a49a-b47c-4f92-97f3-189242ba3733 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:00.477393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9a49a-b47c-4f92-97f3-189242ba3733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:00.477875 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9a49a-b47c-4f92-97f3-189242ba3733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:00.479357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9a49a-b47c-4f92-97f3-189242ba3733 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:00.482467 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:00.492525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 278/578] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:00.493375 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9a49a-b47c-4f92-97f3-189242ba3733 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:00.507367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09049187-f196-4985-a5d0-67d57dfa8621 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:00.543312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef79c42-2de6-481b-8879-261789c59d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:00.543999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef79c42-2de6-481b-8879-261789c59d30 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:00.544290 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef79c42-2de6-481b-8879-261789c59d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:00.544568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef79c42-2de6-481b-8879-261789c59d30 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:00.545345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef79c42-2de6-481b-8879-261789c59d30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:00.545653 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef79c42-2de6-481b-8879-261789c59d30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:00.547243 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef79c42-2de6-481b-8879-261789c59d30 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:00.555776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 301/579] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:55:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:00.556485 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef79c42-2de6-481b-8879-261789c59d30 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:00.615338 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9a49a-b47c-4f92-97f3-189242ba3733 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:00.641753 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:00.661114 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ab178-6965-4d87-bf3e-453b3c3e1895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:00.661963 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ab178-6965-4d87-bf3e-453b3c3e1895 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:00.662248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ab178-6965-4d87-bf3e-453b3c3e1895 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:00.662431 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef79c42-2de6-481b-8879-261789c59d30 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:00.662529 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ab178-6965-4d87-bf3e-453b3c3e1895 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:00.676037 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ab178-6965-4d87-bf3e-453b3c3e1895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:00.685981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ce0ab178-6965-4d87-bf3e-453b3c3e1895 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:00.685981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:00.685981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:00.685981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:00.685981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:00.685981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:00.685981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:00.685981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:00.685981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:00.685981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:00.685981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:00.685981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:00.685981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:00.685981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:00.685981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:00.685981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:00.686892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:00.686892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:00.686892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:00.686892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:00.686892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:00.686892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:00.686892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:00.686892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:00.686892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:00.686892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:00.686892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:00.686892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:00.686892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:00.686892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:00.686892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:00.686892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:00.687803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:00.687803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:00.687803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:00.687803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:00.687803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:00.687803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:00.687803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:00.687803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:00.687803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:00.687803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:00.687803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:00.687803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:00.688427 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 279/580] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:55:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:00.688979 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ab178-6965-4d87-bf3e-453b3c3e1895 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:00.699740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b8bcc-b77a-4b7c-9f32-bbdf863b8c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:00.700780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b8bcc-b77a-4b7c-9f32-bbdf863b8c8b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:00.701322 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b8bcc-b77a-4b7c-9f32-bbdf863b8c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:00.701601 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b8bcc-b77a-4b7c-9f32-bbdf863b8c8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:00.714398 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b8bcc-b77a-4b7c-9f32-bbdf863b8c8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:00.716212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b8bcc-b77a-4b7c-9f32-bbdf863b8c8b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:00.719426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:00.735914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-572b8bcc-b77a-4b7c-9f32-bbdf863b8c8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:00.735914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:00.735914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:00.735914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:00.735914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:00.735914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:00.735914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:00.735914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:00.735914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:00.735914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:00.735914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:00.735914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:00.735914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:00.735914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:00.735914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:00.736985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:00.736985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:00.736985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:00.736985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:00.736985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:00.736985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:00.736985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:00.736985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:00.736985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:00.736985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:00.736985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:00.736985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:00.736985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:00.736985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:00.736985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:00.736985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:00.736985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:00.738181 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:00.738181 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:00.738181 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:00.738181 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:00.743072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 302/581] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:00.743072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b8bcc-b77a-4b7c-9f32-bbdf863b8c8b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:00.802996 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ab178-6965-4d87-bf3e-453b3c3e1895 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:00.842800 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129989a-dca0-4778-990c-b860b075e645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:00.843729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129989a-dca0-4778-990c-b860b075e645 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:00.844032 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129989a-dca0-4778-990c-b860b075e645 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:00.844312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129989a-dca0-4778-990c-b860b075e645 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:00.850685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b8bcc-b77a-4b7c-9f32-bbdf863b8c8b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:00.852645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129989a-dca0-4778-990c-b860b075e645 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:00.854908 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129989a-dca0-4778-990c-b860b075e645 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:00.869603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0129989a-dca0-4778-990c-b860b075e645 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:00.869603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:00.869603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:00.869603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:00.869603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:00.869603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:00.869603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:00.869603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:00.869603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:00.869603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:00.869603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:00.869603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:00.869603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:00.869603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:00.869603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:00.870680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:00.870680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:00.870680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:00.870680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:00.870680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:00.870680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:00.870680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:00.870680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:00.870680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:00.870680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:00.870680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:00.870680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:00.870680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:00.870680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:00.870680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:00.870680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:00.870680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:00.871527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:00.871527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:00.871527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:00.871527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:00.871527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:00.871527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:00.871527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:00.871527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:00.871527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 280/582] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:00.872014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129989a-dca0-4778-990c-b860b075e645 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:00.890039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd353db8-4841-421e-ae7b-7fc10d2bbbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:00.891146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd353db8-4841-421e-ae7b-7fc10d2bbbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:00.891582 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd353db8-4841-421e-ae7b-7fc10d2bbbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:00.891855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd353db8-4841-421e-ae7b-7fc10d2bbbe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:00.902580 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd353db8-4841-421e-ae7b-7fc10d2bbbe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:00.904047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd353db8-4841-421e-ae7b-7fc10d2bbbe8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:00.916345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:00.921545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-dd353db8-4841-421e-ae7b-7fc10d2bbbe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:00.921545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:00.921545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:00.921545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:00.921545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:00.921545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:00.921545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:00.921545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:00.921545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:00.921545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:00.921545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:00.921545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:00.921545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:00.921545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:00.921545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:00.922907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:00.922907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:00.922907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:00.922907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:00.922907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:00.922907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:00.922907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:00.922907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:00.922907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:00.922907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:00.922907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:00.922907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:00.922907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:00.922907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:00.922907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:00.922907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:00.922907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:00.923777 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:00.923777 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:00.923777 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:00.923777 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:00.927817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 303/583] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:00.928640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd353db8-4841-421e-ae7b-7fc10d2bbbe8 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:00.981465 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129989a-dca0-4778-990c-b860b075e645 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:00.983659 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:01.019572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab6fa6-4c5e-48a2-be0b-3913b567949a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:01.020172 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab6fa6-4c5e-48a2-be0b-3913b567949a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:01.020451 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab6fa6-4c5e-48a2-be0b-3913b567949a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:01.020724 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab6fa6-4c5e-48a2-be0b-3913b567949a None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:01.021472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab6fa6-4c5e-48a2-be0b-3913b567949a None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:01.021774 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab6fa6-4c5e-48a2-be0b-3913b567949a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:01.023176 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab6fa6-4c5e-48a2-be0b-3913b567949a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:01.036256 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 281/584] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:55:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:01.036256 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab6fa6-4c5e-48a2-be0b-3913b567949a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:01.049737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd353db8-4841-421e-ae7b-7fc10d2bbbe8 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:01.083495 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee20ca-fdbd-4d74-a444-c1781e5285d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:01.084173 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee20ca-fdbd-4d74-a444-c1781e5285d9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:01.084453 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee20ca-fdbd-4d74-a444-c1781e5285d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:01.084722 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee20ca-fdbd-4d74-a444-c1781e5285d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:01.085823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee20ca-fdbd-4d74-a444-c1781e5285d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:01.086116 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee20ca-fdbd-4d74-a444-c1781e5285d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:01.087499 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee20ca-fdbd-4d74-a444-c1781e5285d9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:01.103707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 304/585] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:01.103707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee20ca-fdbd-4d74-a444-c1781e5285d9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:01.146772 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab6fa6-4c5e-48a2-be0b-3913b567949a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:01.148712 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:01.186505 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4b621-1da4-4791-a7d5-bd6c712a403a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:01.187298 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4b621-1da4-4791-a7d5-bd6c712a403a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:01.187586 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4b621-1da4-4791-a7d5-bd6c712a403a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:01.187870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4b621-1da4-4791-a7d5-bd6c712a403a None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:01.188659 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4b621-1da4-4791-a7d5-bd6c712a403a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:01.188975 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4b621-1da4-4791-a7d5-bd6c712a403a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:01.190459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4b621-1da4-4791-a7d5-bd6c712a403a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:01.203577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 282/586] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:01.204396 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4b621-1da4-4791-a7d5-bd6c712a403a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:01.211185 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee20ca-fdbd-4d74-a444-c1781e5285d9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:01.222327 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:01.252038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3ba29-942f-408f-96a1-68b4b22e86dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:01.253060 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3ba29-942f-408f-96a1-68b4b22e86dc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:01.253346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3ba29-942f-408f-96a1-68b4b22e86dc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:01.253624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3ba29-942f-408f-96a1-68b4b22e86dc None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:01.254384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3ba29-942f-408f-96a1-68b4b22e86dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:01.254692 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3ba29-942f-408f-96a1-68b4b22e86dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:01.256149 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3ba29-942f-408f-96a1-68b4b22e86dc None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:01.268617 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 305/587] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:01.269411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3ba29-942f-408f-96a1-68b4b22e86dc None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:01.316178 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4b621-1da4-4791-a7d5-bd6c712a403a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:01.352633 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2fae9-a8cf-44bb-b1ca-240e04a992ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:01.353527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2fae9-a8cf-44bb-b1ca-240e04a992ce None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:01.353823 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2fae9-a8cf-44bb-b1ca-240e04a992ce None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:01.354111 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2fae9-a8cf-44bb-b1ca-240e04a992ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:01.365481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2fae9-a8cf-44bb-b1ca-240e04a992ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:01.366976 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2fae9-a8cf-44bb-b1ca-240e04a992ce None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:01.372823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3ba29-942f-408f-96a1-68b4b22e86dc None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:01.385475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-41b2fae9-a8cf-44bb-b1ca-240e04a992ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:01.385475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:01.385475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:01.385475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:01.385475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:01.385475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:01.385475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:01.385475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:01.385475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:01.385475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:01.385475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:01.385475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:01.385475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:01.385475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:01.385475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:01.386527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:01.386527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:01.386527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:01.386527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:01.386527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:01.386527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:01.386527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:01.386527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:01.386527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:01.386527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:01.386527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:01.386527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:01.386527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:01.386527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:01.386527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:01.386527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:01.386527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:01.387590 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:01.387590 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:01.387590 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:01.387590 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:01.391486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 283/588] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:01.392187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2fae9-a8cf-44bb-b1ca-240e04a992ce None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:01.407757 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:01.414161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f394243-8a5b-469a-8aa0-9747dce9cb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:01.415011 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f394243-8a5b-469a-8aa0-9747dce9cb18 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:01.415295 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f394243-8a5b-469a-8aa0-9747dce9cb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:01.415572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f394243-8a5b-469a-8aa0-9747dce9cb18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:01.423247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f394243-8a5b-469a-8aa0-9747dce9cb18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:01.425082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f394243-8a5b-469a-8aa0-9747dce9cb18 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:01.439604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-6f394243-8a5b-469a-8aa0-9747dce9cb18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:01.439604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:01.439604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:01.439604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:01.439604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:01.439604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:01.439604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:01.439604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:01.439604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:01.439604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:01.439604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:01.439604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:01.439604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:01.439604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:01.439604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:01.440605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:01.440605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:01.440605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:01.440605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:01.440605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:01.440605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:01.440605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:01.440605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:01.440605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:01.440605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:01.440605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:01.440605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:01.440605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:01.440605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:01.440605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:01.440605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:01.440605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:01.441563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:01.441563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:01.441563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:01.441563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:01.441563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:01.441563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:01.441563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:01.441563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:01.445626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 306/589] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:01.446541 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f394243-8a5b-469a-8aa0-9747dce9cb18 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:01.480985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:01.501713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2fae9-a8cf-44bb-b1ca-240e04a992ce None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:01.539493 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1df15-5290-46c0-9e87-e82f889ffbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:01.540757 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1df15-5290-46c0-9e87-e82f889ffbee None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:01.541036 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1df15-5290-46c0-9e87-e82f889ffbee None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:01.541327 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1df15-5290-46c0-9e87-e82f889ffbee None admin] PATH_INFO: `/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/a99b767501244338bc48fb5428a589a1/roles/6046421464dd48ea8977d7d1481bde10` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:01.556806 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1df15-5290-46c0-9e87-e82f889ffbee None admin] RBAC: Authorizing `identity:create_grant(project_id=2c23678abd4f4dacaf35d73c5184e72e, user_id=a99b767501244338bc48fb5428a589a1, role_id=6046421464dd48ea8977d7d1481bde10)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:01.558318 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1df15-5290-46c0-9e87-e82f889ffbee None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:01.566409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f394243-8a5b-469a-8aa0-9747dce9cb18 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:01.572705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 284/590] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:55:01 2022] PUT /identity/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/a99b767501244338bc48fb5428a589a1/roles/6046421464dd48ea8977d7d1481bde10 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:55:01.573612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1df15-5290-46c0-9e87-e82f889ffbee None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:01.623890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953232a7-8422-466f-83b9-c1f1b10443cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:01.625240 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953232a7-8422-466f-83b9-c1f1b10443cb None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:01.625948 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953232a7-8422-466f-83b9-c1f1b10443cb None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:01.626453 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953232a7-8422-466f-83b9-c1f1b10443cb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:01.638079 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953232a7-8422-466f-83b9-c1f1b10443cb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:01.640934 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953232a7-8422-466f-83b9-c1f1b10443cb None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:01.658904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:01.665536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-953232a7-8422-466f-83b9-c1f1b10443cb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 20:55:01.665536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:01.665536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:01.665536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:01.665536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:01.665536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:01.665536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:01.665536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:01.665536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:01.665536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:01.665536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:01.665536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:01.665536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:01.665536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:01.665536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:01.665536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:01.667167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:01.668087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:01.668087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:01.668087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:01.668087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:01.668087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:01.668087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:01.668087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:01.668087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:01.668087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 20:55:01.668087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:01.672463 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 307/591] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:55:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:01.673755 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953232a7-8422-466f-83b9-c1f1b10443cb None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:01.714665 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1df15-5290-46c0-9e87-e82f889ffbee None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:01.766198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0920c-d9eb-4f08-b1b6-4a7ee0af4d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:01.767184 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0920c-d9eb-4f08-b1b6-4a7ee0af4d52 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:01.767671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0920c-d9eb-4f08-b1b6-4a7ee0af4d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:01.768137 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0920c-d9eb-4f08-b1b6-4a7ee0af4d52 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:01.770256 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0920c-d9eb-4f08-b1b6-4a7ee0af4d52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:01.770788 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0920c-d9eb-4f08-b1b6-4a7ee0af4d52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:01.772419 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0920c-d9eb-4f08-b1b6-4a7ee0af4d52 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:01.787569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:01.790409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 285/592] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:01.794114 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0920c-d9eb-4f08-b1b6-4a7ee0af4d52 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:01.806434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953232a7-8422-466f-83b9-c1f1b10443cb None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:01.847600 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13851619-1f52-4161-aab5-ca616bf96780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:01.848374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13851619-1f52-4161-aab5-ca616bf96780 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:01.848786 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13851619-1f52-4161-aab5-ca616bf96780 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:01.849163 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13851619-1f52-4161-aab5-ca616bf96780 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:01.850140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13851619-1f52-4161-aab5-ca616bf96780 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:01.850558 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13851619-1f52-4161-aab5-ca616bf96780 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:01.852196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13851619-1f52-4161-aab5-ca616bf96780 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:01.871339 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 308/593] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:01.871339 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13851619-1f52-4161-aab5-ca616bf96780 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:01.926200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0920c-d9eb-4f08-b1b6-4a7ee0af4d52 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:01.950779 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:01.969565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc61cd-2ca3-4143-87af-e8d1075e62a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:01.970810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc61cd-2ca3-4143-87af-e8d1075e62a9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:01.971236 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc61cd-2ca3-4143-87af-e8d1075e62a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:01.971648 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc61cd-2ca3-4143-87af-e8d1075e62a9 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:01.972900 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc61cd-2ca3-4143-87af-e8d1075e62a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:01.973806 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc61cd-2ca3-4143-87af-e8d1075e62a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:01.975924 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc61cd-2ca3-4143-87af-e8d1075e62a9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:01.982264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13851619-1f52-4161-aab5-ca616bf96780 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:02.000941 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 286/594] 10.222.0.61 () {56 vars in 1137 bytes} [Thu May 26 20:55:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:02.002229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc61cd-2ca3-4143-87af-e8d1075e62a9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:02.026991 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ade44-2e22-4982-aaad-21b407543376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:02.027805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ade44-2e22-4982-aaad-21b407543376 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:02.028185 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ade44-2e22-4982-aaad-21b407543376 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:02.028559 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ade44-2e22-4982-aaad-21b407543376 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:02.036826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ade44-2e22-4982-aaad-21b407543376 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:02.038505 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ade44-2e22-4982-aaad-21b407543376 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:02.054122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-eb3ade44-2e22-4982-aaad-21b407543376 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 20:55:02.054122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:02.054122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:02.054122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:02.054122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:02.054122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:02.054122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:02.054122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:02.054122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:02.054122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:02.054122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:02.054122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:02.054122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:02.054122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:02.054122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:02.054122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:02.055112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:02.056009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:02.056009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:02.056009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:02.056009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:02.056009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:02.056009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:02.056009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:02.056009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:02.056009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 20:55:02.056009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:02.056009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 309/595] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:55:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:02.056574 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ade44-2e22-4982-aaad-21b407543376 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:02.071734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:02.120210 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc61cd-2ca3-4143-87af-e8d1075e62a9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:02.158530 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c740a-29bc-476b-bf69-3dd70860c2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:02.159445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c740a-29bc-476b-bf69-3dd70860c2d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:02.159731 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c740a-29bc-476b-bf69-3dd70860c2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:02.160012 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c740a-29bc-476b-bf69-3dd70860c2d8 None admin] PATH_INFO: `/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/e877e97dae064fe9ad3d378296b78ff9/roles/6046421464dd48ea8977d7d1481bde10` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:02.169880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ade44-2e22-4982-aaad-21b407543376 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:02.175873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c740a-29bc-476b-bf69-3dd70860c2d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c23678abd4f4dacaf35d73c5184e72e, user_id=e877e97dae064fe9ad3d378296b78ff9, role_id=6046421464dd48ea8977d7d1481bde10)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:02.177343 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c740a-29bc-476b-bf69-3dd70860c2d8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:02.193381 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 287/596] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:55:02 2022] PUT /identity/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/e877e97dae064fe9ad3d378296b78ff9/roles/6046421464dd48ea8977d7d1481bde10 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:55:02.195239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c24119-f07d-4145-8d19-ead126e65563 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:02.195531 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c24119-f07d-4145-8d19-ead126e65563 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:02.195830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c24119-f07d-4145-8d19-ead126e65563 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:02.197422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 288/597] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:02.202318 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c24119-f07d-4145-8d19-ead126e65563 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:02.228053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71d358-d3e2-42e5-9f93-fd063d303e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:02.230392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71d358-d3e2-42e5-9f93-fd063d303e78 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:02.231319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71d358-d3e2-42e5-9f93-fd063d303e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:02.231830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71d358-d3e2-42e5-9f93-fd063d303e78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:02.248060 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71d358-d3e2-42e5-9f93-fd063d303e78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:02.249564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71d358-d3e2-42e5-9f93-fd063d303e78 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:02.258949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:02.269855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-db71d358-d3e2-42e5-9f93-fd063d303e78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:02.269855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:02.269855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:02.269855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:02.269855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:02.269855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:02.269855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:02.269855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:02.269855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:02.269855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:02.269855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:02.269855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:02.269855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:02.269855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:02.269855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:02.270825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:02.270825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:02.270825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:02.270825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:02.270825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:02.270825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:02.270825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:02.270825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:02.270825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:02.270825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:02.270825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:02.270825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:02.270825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:02.270825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:02.270825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:02.270825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:02.270825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:02.271914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:02.271914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:02.271914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:02.271914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:02.271914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 310/598] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:02.273729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eda93e-d4c7-49e5-bfcd-7aa066b128eb None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:02.274044 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eda93e-d4c7-49e5-bfcd-7aa066b128eb None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:02.274411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eda93e-d4c7-49e5-bfcd-7aa066b128eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:02.294897 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b8eda93e-d4c7-49e5-bfcd-7aa066b128eb None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:02.295677 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b8eda93e-d4c7-49e5-bfcd-7aa066b128eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:02.331505 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c24119-f07d-4145-8d19-ead126e65563 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:02.371304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed37341-6589-43af-9316-5021b76064c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:02.372245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed37341-6589-43af-9316-5021b76064c3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:02.372678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed37341-6589-43af-9316-5021b76064c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:02.373184 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed37341-6589-43af-9316-5021b76064c3 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:02.374274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed37341-6589-43af-9316-5021b76064c3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:02.374610 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:02.375175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed37341-6589-43af-9316-5021b76064c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:02.376969 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed37341-6589-43af-9316-5021b76064c3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:02.393955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 311/599] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:55:02.395149 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eda93e-d4c7-49e5-bfcd-7aa066b128eb None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:02.404957 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 289/600] 10.222.0.61 () {56 vars in 1139 bytes} [Thu May 26 20:55:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:02.410271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed37341-6589-43af-9316-5021b76064c3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:02.519142 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:02.528434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eda93e-d4c7-49e5-bfcd-7aa066b128eb None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:02.528592 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed37341-6589-43af-9316-5021b76064c3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:02.569555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e72b4-d540-4f64-a7c2-f25d826bf4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:02.570592 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e72b4-d540-4f64-a7c2-f25d826bf4ac None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:02.570950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e72b4-d540-4f64-a7c2-f25d826bf4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:02.571285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e72b4-d540-4f64-a7c2-f25d826bf4ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:02.575165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28f97e-561e-423a-b703-99e205d32981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:02.576004 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28f97e-561e-423a-b703-99e205d32981 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:02.576430 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28f97e-561e-423a-b703-99e205d32981 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:02.576841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28f97e-561e-423a-b703-99e205d32981 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:02.577843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28f97e-561e-423a-b703-99e205d32981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:02.578308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28f97e-561e-423a-b703-99e205d32981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:02.580431 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28f97e-561e-423a-b703-99e205d32981 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:02.583383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e72b4-d540-4f64-a7c2-f25d826bf4ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:02.585345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e72b4-d540-4f64-a7c2-f25d826bf4ac None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:02.595565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 312/601] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:02.597159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28f97e-561e-423a-b703-99e205d32981 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:02.607462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-441e72b4-d540-4f64-a7c2-f25d826bf4ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:02.607462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:02.607462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:02.607462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:02.607462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:02.607462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:02.607462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:02.607462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:02.607462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:02.607462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:02.607462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:02.607462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:02.607462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:02.607462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:02.607462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:02.608520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:02.608520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:02.608520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:02.608520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:02.608520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:02.608520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:02.608520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:02.608520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:02.608520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:02.608520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:02.608520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:02.608520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:02.608520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:02.608520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:02.608520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:02.608520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:02.608520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:02.609639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:02.609639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:02.609639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:02.609639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:02.610737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 290/602] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:02.615430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e72b4-d540-4f64-a7c2-f25d826bf4ac None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:02.654522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:02.706633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28f97e-561e-423a-b703-99e205d32981 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:02.727078 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e72b4-d540-4f64-a7c2-f25d826bf4ac None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:02.741685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139cfa3-0d31-4818-af01-41cbebf24dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:02.742621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139cfa3-0d31-4818-af01-41cbebf24dfe None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:02.742967 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139cfa3-0d31-4818-af01-41cbebf24dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:02.743299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139cfa3-0d31-4818-af01-41cbebf24dfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:02.754281 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139cfa3-0d31-4818-af01-41cbebf24dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:02.761940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-7139cfa3-0d31-4818-af01-41cbebf24dfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:02.761940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:02.761940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:02.761940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:02.761940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:02.761940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:02.761940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:02.761940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:02.761940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:02.761940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:02.761940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:02.761940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:02.761940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:02.761940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:02.761940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:02.761940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:02.763046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:02.763046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:02.763046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:02.763046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:02.763046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:02.763046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:02.763046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:02.763046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:02.763046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:02.763046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:02.763046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:02.763046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:02.763046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:02.763046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:02.763046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:02.763046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:02.764047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:02.764047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:02.764047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:02.764047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:02.764047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:02.764047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:02.764047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:02.764047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:02.764047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:02.764047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:02.764047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:02.764047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:02.770346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 313/603] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:55:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:02.770683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da230e-dd34-4e37-baa3-33872efbe088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:02.771466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139cfa3-0d31-4818-af01-41cbebf24dfe None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:02.771986 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da230e-dd34-4e37-baa3-33872efbe088 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:02.772425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da230e-dd34-4e37-baa3-33872efbe088 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:02.772837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da230e-dd34-4e37-baa3-33872efbe088 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:02.781761 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da230e-dd34-4e37-baa3-33872efbe088 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:02.783672 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da230e-dd34-4e37-baa3-33872efbe088 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:02.800024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-10da230e-dd34-4e37-baa3-33872efbe088 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:02.800024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:02.800024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:02.800024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:02.800024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:02.800024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:02.800024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:02.800024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:02.800024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:02.800024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:02.800024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:02.800024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:02.800024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:02.800024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:02.800024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:02.801161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:02.801161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:02.801161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:02.801161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:02.801161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:02.801161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:02.801161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:02.801161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:02.801161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:02.801161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:02.801161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:02.801161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:02.801161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:02.801161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:02.801161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:02.801161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:02.801161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:02.802244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:02.802244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:02.802244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:02.802244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:02.802244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:02.802244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:02.802244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:02.802244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:02.805092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 291/604] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:02.806409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da230e-dd34-4e37-baa3-33872efbe088 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:02.809619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:02.881677 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139cfa3-0d31-4818-af01-41cbebf24dfe None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:02.893183 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:02.918024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91657bcf-2d94-4b31-8458-a91ed54a9dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:02.918601 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91657bcf-2d94-4b31-8458-a91ed54a9dee None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:02.918958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91657bcf-2d94-4b31-8458-a91ed54a9dee None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:02.919299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91657bcf-2d94-4b31-8458-a91ed54a9dee None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:02.920102 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91657bcf-2d94-4b31-8458-a91ed54a9dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:02.920479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91657bcf-2d94-4b31-8458-a91ed54a9dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:02.922065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91657bcf-2d94-4b31-8458-a91ed54a9dee None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:02.925037 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da230e-dd34-4e37-baa3-33872efbe088 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:02.939207 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 314/605] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:02.939207 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91657bcf-2d94-4b31-8458-a91ed54a9dee None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:02.971285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7d329-2b14-480c-9bb8-615b7e715cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:02.972225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7d329-2b14-480c-9bb8-615b7e715cab None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:02.972684 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7d329-2b14-480c-9bb8-615b7e715cab None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:02.973105 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7d329-2b14-480c-9bb8-615b7e715cab None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:02.974031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7d329-2b14-480c-9bb8-615b7e715cab None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:02.974568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7d329-2b14-480c-9bb8-615b7e715cab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:02.976299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7d329-2b14-480c-9bb8-615b7e715cab None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:02.985707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 292/606] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:55:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:02.986873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7d329-2b14-480c-9bb8-615b7e715cab None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:03.045629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91657bcf-2d94-4b31-8458-a91ed54a9dee None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:03.054291 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:03.083166 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18793089-90ba-4fc8-9458-eb3e6538e2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:03.083944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18793089-90ba-4fc8-9458-eb3e6538e2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:03.084296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18793089-90ba-4fc8-9458-eb3e6538e2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:03.084625 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18793089-90ba-4fc8-9458-eb3e6538e2d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:03.085858 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18793089-90ba-4fc8-9458-eb3e6538e2d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:03.086239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18793089-90ba-4fc8-9458-eb3e6538e2d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:03.087753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18793089-90ba-4fc8-9458-eb3e6538e2d4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:03.097920 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7d329-2b14-480c-9bb8-615b7e715cab None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:03.100202 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 315/607] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:03.101296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18793089-90ba-4fc8-9458-eb3e6538e2d4 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:03.131814 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:03.136414 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0e509-8118-4ec7-8612-fd3d36ab226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:03.137468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0e509-8118-4ec7-8612-fd3d36ab226d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:03.137975 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0e509-8118-4ec7-8612-fd3d36ab226d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:03.138384 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0e509-8118-4ec7-8612-fd3d36ab226d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:03.147456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0e509-8118-4ec7-8612-fd3d36ab226d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:03.149313 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0e509-8118-4ec7-8612-fd3d36ab226d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:03.164830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3bb0e509-8118-4ec7-8612-fd3d36ab226d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:03.164830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:03.164830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:03.164830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:03.164830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:03.164830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:03.164830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:03.164830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:03.164830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:03.164830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:03.164830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:03.164830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:03.164830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:03.164830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:03.164830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:03.165711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:03.165711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:03.165711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:03.165711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:03.165711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:03.165711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:03.165711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:03.165711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:03.165711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:03.165711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:03.165711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:03.165711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:03.165711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:03.165711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:03.165711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:03.165711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:03.165711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:03.166698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:03.166698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:03.166698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:03.166698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:03.166698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:03.166698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:03.166698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:03.166698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:03.173767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 293/608] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:03.174927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0e509-8118-4ec7-8612-fd3d36ab226d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:03.204492 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18793089-90ba-4fc8-9458-eb3e6538e2d4 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:03.239202 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b3fa8-10a3-4e20-8b0c-89da3888767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:03.240022 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b3fa8-10a3-4e20-8b0c-89da3888767c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:03.240292 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b3fa8-10a3-4e20-8b0c-89da3888767c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:03.240561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b3fa8-10a3-4e20-8b0c-89da3888767c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:03.252451 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b3fa8-10a3-4e20-8b0c-89da3888767c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:03.253963 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b3fa8-10a3-4e20-8b0c-89da3888767c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:03.271968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-446b3fa8-10a3-4e20-8b0c-89da3888767c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:03.271968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:03.271968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:03.271968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:03.271968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:03.271968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:03.271968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:03.271968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:03.271968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:03.271968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:03.271968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:03.271968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:03.271968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:03.271968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:03.271968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:03.273082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:03.273082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:03.273082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:03.273082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:03.273082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:03.273082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:03.273082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:03.273082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:03.273082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:03.273082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:03.273082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:03.273082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:03.273082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:03.273082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:03.273082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:03.273082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:03.273082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:03.274143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:03.274143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:03.274143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:03.274143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:03.277971 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 316/609] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:03.278746 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b3fa8-10a3-4e20-8b0c-89da3888767c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:03.293752 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0e509-8118-4ec7-8612-fd3d36ab226d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:03.326170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:03.331534 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f79ce-9f9c-4b6d-8239-94b6fa81d038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:03.332623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f79ce-9f9c-4b6d-8239-94b6fa81d038 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:03.333177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f79ce-9f9c-4b6d-8239-94b6fa81d038 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:03.333588 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f79ce-9f9c-4b6d-8239-94b6fa81d038 None admin] PATH_INFO: `/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/7d7e1c8c42cd4f6dab8b27829e5fc5ed/roles/6046421464dd48ea8977d7d1481bde10` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:03.350923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f79ce-9f9c-4b6d-8239-94b6fa81d038 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c23678abd4f4dacaf35d73c5184e72e, user_id=7d7e1c8c42cd4f6dab8b27829e5fc5ed, role_id=6046421464dd48ea8977d7d1481bde10)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:03.352748 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f79ce-9f9c-4b6d-8239-94b6fa81d038 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:03.371735 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 294/610] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:55:03 2022] PUT /identity/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/7d7e1c8c42cd4f6dab8b27829e5fc5ed/roles/6046421464dd48ea8977d7d1481bde10 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:55:03.372654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:03.373955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f79ce-9f9c-4b6d-8239-94b6fa81d038 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:03.394938 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b3fa8-10a3-4e20-8b0c-89da3888767c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:03.435128 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03602cb6-5fda-43c9-bf04-259136a1d7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:03.435785 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03602cb6-5fda-43c9-bf04-259136a1d7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:03.436073 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03602cb6-5fda-43c9-bf04-259136a1d7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:03.436355 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03602cb6-5fda-43c9-bf04-259136a1d7e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:03.437257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03602cb6-5fda-43c9-bf04-259136a1d7e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:03.437572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03602cb6-5fda-43c9-bf04-259136a1d7e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:03.439103 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03602cb6-5fda-43c9-bf04-259136a1d7e0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:03.454025 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 317/611] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:03.459897 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03602cb6-5fda-43c9-bf04-259136a1d7e0 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:03.495796 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f79ce-9f9c-4b6d-8239-94b6fa81d038 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:03.538438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ef36b-9ce6-4511-b03d-995340831ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:03.539914 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ef36b-9ce6-4511-b03d-995340831ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:03.540391 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ef36b-9ce6-4511-b03d-995340831ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:03.540818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ef36b-9ce6-4511-b03d-995340831ef1 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:03.541855 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ef36b-9ce6-4511-b03d-995340831ef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:03.542307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ef36b-9ce6-4511-b03d-995340831ef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:03.543904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ef36b-9ce6-4511-b03d-995340831ef1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:03.558103 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 295/612] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:03.563954 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ef36b-9ce6-4511-b03d-995340831ef1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:03.604042 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03602cb6-5fda-43c9-bf04-259136a1d7e0 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:03.640252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:03.685733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefb041-c65f-4a78-a77e-8288ff6a28f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:03.686624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefb041-c65f-4a78-a77e-8288ff6a28f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:03.686933 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefb041-c65f-4a78-a77e-8288ff6a28f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:03.687424 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefb041-c65f-4a78-a77e-8288ff6a28f5 None admin] PATH_INFO: `/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/e3514a1833104114894abe6c41ea30a6/roles/6046421464dd48ea8977d7d1481bde10` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:03.700727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:03.706658 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefb041-c65f-4a78-a77e-8288ff6a28f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c23678abd4f4dacaf35d73c5184e72e, user_id=e3514a1833104114894abe6c41ea30a6, role_id=6046421464dd48ea8977d7d1481bde10)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:03.708140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefb041-c65f-4a78-a77e-8288ff6a28f5 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:03.726434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 318/613] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:55:03 2022] PUT /identity/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/e3514a1833104114894abe6c41ea30a6/roles/6046421464dd48ea8977d7d1481bde10 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:55:03.740170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ef36b-9ce6-4511-b03d-995340831ef1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:03.797685 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ea213-ece1-4c06-9abd-f5c38836f1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:03.798564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ea213-ece1-4c06-9abd-f5c38836f1fd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:03.798844 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ea213-ece1-4c06-9abd-f5c38836f1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:03.799115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ea213-ece1-4c06-9abd-f5c38836f1fd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:03.808312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ea213-ece1-4c06-9abd-f5c38836f1fd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:03.809782 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ea213-ece1-4c06-9abd-f5c38836f1fd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:03.829577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b19ea213-ece1-4c06-9abd-f5c38836f1fd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 20:55:03.829577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:03.829577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:03.829577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:03.829577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:03.829577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:03.829577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:03.829577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:03.829577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:03.829577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:03.829577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:03.829577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:03.829577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:03.829577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:03.829577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:03.829577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:03.830857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:03.832029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:03.832029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:03.832029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:03.832029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:03.832029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:03.832029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:03.832029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:03.832029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:03.832029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 20:55:03.832029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:03.832029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 296/614] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:55:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:03.837561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefb041-c65f-4a78-a77e-8288ff6a28f5 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:04.003713 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefb041-c65f-4a78-a77e-8288ff6a28f5 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:04.056596 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d161a15-52a3-4be5-adc8-b17a1e47155a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:04.057296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d161a15-52a3-4be5-adc8-b17a1e47155a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:04.057582 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d161a15-52a3-4be5-adc8-b17a1e47155a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:04.057883 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d161a15-52a3-4be5-adc8-b17a1e47155a None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:04.058742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d161a15-52a3-4be5-adc8-b17a1e47155a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:04.059055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d161a15-52a3-4be5-adc8-b17a1e47155a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:04.059302 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b15de-65c0-4839-847e-954d4ad711dc None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:04.059701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b15de-65c0-4839-847e-954d4ad711dc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:04.060072 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b15de-65c0-4839-847e-954d4ad711dc None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:04.060541 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d161a15-52a3-4be5-adc8-b17a1e47155a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:04.061863 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 297/615] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:04.067614 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8ee94-ef8a-4f88-8031-d3198e05406b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:04.067997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8ee94-ef8a-4f88-8031-d3198e05406b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:04.068367 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8ee94-ef8a-4f88-8031-d3198e05406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:04.086788 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9bc8ee94-ef8a-4f88-8031-d3198e05406b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:04.088148 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9bc8ee94-ef8a-4f88-8031-d3198e05406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:04.093016 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 319/616] 10.222.0.61 () {56 vars in 1135 bytes} [Thu May 26 20:55:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:04.094867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d161a15-52a3-4be5-adc8-b17a1e47155a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:04.153029 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:04.161386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 298/617] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:55:04.184270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8ee94-ef8a-4f88-8031-d3198e05406b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:04.212344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:04.212563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d161a15-52a3-4be5-adc8-b17a1e47155a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:04.248782 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27c260-009f-4add-88b1-7eb1ba167343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:04.250005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27c260-009f-4add-88b1-7eb1ba167343 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:04.250296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27c260-009f-4add-88b1-7eb1ba167343 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:04.250581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27c260-009f-4add-88b1-7eb1ba167343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:04.261516 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27c260-009f-4add-88b1-7eb1ba167343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:04.263034 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27c260-009f-4add-88b1-7eb1ba167343 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:04.281459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-3f27c260-009f-4add-88b1-7eb1ba167343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:04.281459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:04.281459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:04.281459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:04.281459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:04.281459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:04.281459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:04.281459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:04.281459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:04.281459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:04.281459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:04.281459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:04.281459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:04.281459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:04.281459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:04.282409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:04.282409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:04.282409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:04.282409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:04.282409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:04.282409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:04.282409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:04.282409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:04.282409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:04.282409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:04.282409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:04.282409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:04.282409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:04.282409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:04.282409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:04.282409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:04.282409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:04.283282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:04.283282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:04.283282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:04.283282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:04.283282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 320/618] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:04.288427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27c260-009f-4add-88b1-7eb1ba167343 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:04.291347 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8ee94-ef8a-4f88-8031-d3198e05406b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:04.326944 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15094723-7ee9-4f71-af9d-1d6f927679e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:04.327886 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15094723-7ee9-4f71-af9d-1d6f927679e8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:04.328168 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15094723-7ee9-4f71-af9d-1d6f927679e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:04.328584 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15094723-7ee9-4f71-af9d-1d6f927679e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:04.343231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15094723-7ee9-4f71-af9d-1d6f927679e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:04.354080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-15094723-7ee9-4f71-af9d-1d6f927679e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:04.354080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:04.354080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:04.354080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:04.354080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:04.354080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:04.354080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:04.354080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:04.354080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:04.354080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:04.354080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:04.354080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:04.354080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:04.354080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:04.354080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:04.354080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:04.355028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:04.355028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:04.355028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:04.355028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:04.355028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:04.355028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:04.355028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:04.355028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:04.355028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:04.355028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:04.355028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:04.355028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:04.355028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:04.355028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:04.355028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:04.355028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:04.355845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:04.355845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:04.355845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:04.355845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:04.355845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:04.355845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:04.355845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:04.355845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:04.355845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:04.355845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:04.355845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:04.355845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:04.356492 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 299/619] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:55:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:04.362772 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15094723-7ee9-4f71-af9d-1d6f927679e8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:04.440584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27c260-009f-4add-88b1-7eb1ba167343 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:04.442357 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:04.512762 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:04.514595 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0546e3d-4430-4220-b47f-ab83d4acad3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:04.515370 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0546e3d-4430-4220-b47f-ab83d4acad3b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:04.515737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0546e3d-4430-4220-b47f-ab83d4acad3b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:04.516025 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0546e3d-4430-4220-b47f-ab83d4acad3b None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:04.516913 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0546e3d-4430-4220-b47f-ab83d4acad3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:04.517225 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0546e3d-4430-4220-b47f-ab83d4acad3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:04.518680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0546e3d-4430-4220-b47f-ab83d4acad3b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:04.534646 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15094723-7ee9-4f71-af9d-1d6f927679e8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:04.548420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 321/620] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:04.554037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0546e3d-4430-4220-b47f-ab83d4acad3b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:04.577382 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741bba9-db1b-403d-9afd-db81a2a0e365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:04.580073 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741bba9-db1b-403d-9afd-db81a2a0e365 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:04.580360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741bba9-db1b-403d-9afd-db81a2a0e365 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:04.580622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741bba9-db1b-403d-9afd-db81a2a0e365 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:04.582846 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741bba9-db1b-403d-9afd-db81a2a0e365 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:04.583042 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741bba9-db1b-403d-9afd-db81a2a0e365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:04.585139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741bba9-db1b-403d-9afd-db81a2a0e365 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:04.597748 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 300/621] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:55:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:04.607179 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741bba9-db1b-403d-9afd-db81a2a0e365 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:04.686658 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0546e3d-4430-4220-b47f-ab83d4acad3b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:04.721945 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a4a4f-8129-4859-8189-1528d1d35ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:04.724257 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741bba9-db1b-403d-9afd-db81a2a0e365 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:04.725266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a4a4f-8129-4859-8189-1528d1d35ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:04.725567 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a4a4f-8129-4859-8189-1528d1d35ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:04.725890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a4a4f-8129-4859-8189-1528d1d35ca3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:04.733313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a4a4f-8129-4859-8189-1528d1d35ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:04.734865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a4a4f-8129-4859-8189-1528d1d35ca3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:04.749708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-0d7a4a4f-8129-4859-8189-1528d1d35ca3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:04.749708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:04.749708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:04.749708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:04.749708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:04.749708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:04.749708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:04.749708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:04.749708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:04.749708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:04.749708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:04.749708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:04.749708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:04.749708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:04.749708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:04.750652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:04.750652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:04.750652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:04.750652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:04.750652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:04.750652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:04.750652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:04.750652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:04.750652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:04.750652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:04.750652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:04.750652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:04.750652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:04.750652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:04.750652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:04.750652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:04.750652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:04.751517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:04.751517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:04.751517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:04.751517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:04.751517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:04.751517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:04.751517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:04.751517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:04.755710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 322/622] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:04.757065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201507c-e2ee-41e2-8afb-d58000cd8e35 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:04.757359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201507c-e2ee-41e2-8afb-d58000cd8e35 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:04.757639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201507c-e2ee-41e2-8afb-d58000cd8e35 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:04.760827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 323/623] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:04.760827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201507c-e2ee-41e2-8afb-d58000cd8e35 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:04.781442 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03affa80-a093-418e-9e5b-d9453d8343bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:04.783321 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03affa80-a093-418e-9e5b-d9453d8343bd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:04.783808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03affa80-a093-418e-9e5b-d9453d8343bd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:04.784525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03affa80-a093-418e-9e5b-d9453d8343bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:04.792395 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:04.801044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03affa80-a093-418e-9e5b-d9453d8343bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:04.803260 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03affa80-a093-418e-9e5b-d9453d8343bd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:04.814466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:04.827430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-03affa80-a093-418e-9e5b-d9453d8343bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:04.827430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:04.827430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:04.827430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:04.827430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:04.827430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:04.827430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:04.827430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:04.827430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:04.827430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:04.827430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:04.827430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:04.827430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:04.827430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:04.827430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:04.828568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:04.828568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:04.828568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:04.828568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:04.828568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:04.828568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:04.828568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:04.828568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:04.828568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:04.828568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:04.828568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:04.828568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:04.828568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:04.828568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:04.828568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:04.828568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:04.828568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:04.829535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:04.829535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:04.829535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:04.829535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:04.831329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 301/624] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:04.836642 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5499f2-6f69-4cdd-9216-90a1c3d3516f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:04.836642 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5499f2-6f69-4cdd-9216-90a1c3d3516f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:04.836642 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5499f2-6f69-4cdd-9216-90a1c3d3516f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:04.859791 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6f5499f2-6f69-4cdd-9216-90a1c3d3516f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:04.861930 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6f5499f2-6f69-4cdd-9216-90a1c3d3516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:04.887378 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201507c-e2ee-41e2-8afb-d58000cd8e35 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:04.927822 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b1e0f-a4cb-4b07-a9d5-c618d9ddda9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:04.928510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b1e0f-a4cb-4b07-a9d5-c618d9ddda9d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:04.928850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b1e0f-a4cb-4b07-a9d5-c618d9ddda9d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:04.929126 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b1e0f-a4cb-4b07-a9d5-c618d9ddda9d None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:04.930036 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b1e0f-a4cb-4b07-a9d5-c618d9ddda9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:04.930351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b1e0f-a4cb-4b07-a9d5-c618d9ddda9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:04.931886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b1e0f-a4cb-4b07-a9d5-c618d9ddda9d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:04.945518 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 324/625] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:04.950573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b1e0f-a4cb-4b07-a9d5-c618d9ddda9d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:04.956306 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 302/626] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:55:04.957412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5499f2-6f69-4cdd-9216-90a1c3d3516f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:05.054479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:05.075478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b1e0f-a4cb-4b07-a9d5-c618d9ddda9d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:05.096789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5499f2-6f69-4cdd-9216-90a1c3d3516f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:05.118683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3f3bf-c6cd-47cf-9472-fef5162b034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:05.119786 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3f3bf-c6cd-47cf-9472-fef5162b034a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:05.120430 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3f3bf-c6cd-47cf-9472-fef5162b034a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:05.121221 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3f3bf-c6cd-47cf-9472-fef5162b034a None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:05.122436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3f3bf-c6cd-47cf-9472-fef5162b034a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:05.123087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3f3bf-c6cd-47cf-9472-fef5162b034a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:05.125288 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3f3bf-c6cd-47cf-9472-fef5162b034a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:05.126245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:05.134746 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9924da-7614-4757-a335-fc56081d255c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:05.135745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9924da-7614-4757-a335-fc56081d255c None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:05.136308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9924da-7614-4757-a335-fc56081d255c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:05.136308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9924da-7614-4757-a335-fc56081d255c None admin] PATH_INFO: `/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/57a63879ec1242d08bba1ccad6212788/roles/6046421464dd48ea8977d7d1481bde10` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:05.145556 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 325/627] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:05.147068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3f3bf-c6cd-47cf-9472-fef5162b034a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:05.153741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9924da-7614-4757-a335-fc56081d255c None admin] RBAC: Authorizing `identity:create_grant(project_id=2c23678abd4f4dacaf35d73c5184e72e, user_id=57a63879ec1242d08bba1ccad6212788, role_id=6046421464dd48ea8977d7d1481bde10)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:05.155423 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9924da-7614-4757-a335-fc56081d255c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:05.172408 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 303/628] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:55:04 2022] PUT /identity/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/57a63879ec1242d08bba1ccad6212788/roles/6046421464dd48ea8977d7d1481bde10 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:55:05.178902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9924da-7614-4757-a335-fc56081d255c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:05.289460 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3f3bf-c6cd-47cf-9472-fef5162b034a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:05.332628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719efd2-685c-485f-b407-2e256c608736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:05.333884 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719efd2-685c-485f-b407-2e256c608736 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:05.334361 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719efd2-685c-485f-b407-2e256c608736 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:05.334876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719efd2-685c-485f-b407-2e256c608736 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:05.363722 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719efd2-685c-485f-b407-2e256c608736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:05.373678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-b719efd2-685c-485f-b407-2e256c608736 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:05.373678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:05.373678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:05.373678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:05.373678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:05.373678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:05.373678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:05.373678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:05.373678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:05.373678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:05.373678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:05.373678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:05.373678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:05.373678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:05.373678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:05.373678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:05.374766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:05.374766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:05.374766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:05.374766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:05.374766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:05.374766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:05.374766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:05.374766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:05.374766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:05.374766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:05.374766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:05.374766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:05.374766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:05.374766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:05.374766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:05.374766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:05.375768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:05.375768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:05.375768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:05.375768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:05.375768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:05.375768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:05.375768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:05.375768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:05.375768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:05.375768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:05.375768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:05.375768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:05.382912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9924da-7614-4757-a335-fc56081d255c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:05.383613 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 326/629] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:55:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:05.394893 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719efd2-685c-485f-b407-2e256c608736 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:05.402992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:05.452245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a34be9-9e9d-4b02-9003-32ba464970cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:05.453570 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a34be9-9e9d-4b02-9003-32ba464970cc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:05.454075 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a34be9-9e9d-4b02-9003-32ba464970cc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:05.454623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a34be9-9e9d-4b02-9003-32ba464970cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:05.471054 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a34be9-9e9d-4b02-9003-32ba464970cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:05.472661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a34be9-9e9d-4b02-9003-32ba464970cc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:05.489680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a7a34be9-9e9d-4b02-9003-32ba464970cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 20:55:05.489680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:05.489680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:05.489680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:05.489680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:05.489680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:05.489680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:05.489680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:05.489680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:05.489680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:05.489680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:05.489680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:05.489680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:05.489680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:05.489680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:05.489680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:05.490716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:05.491629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:05.491629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:05.491629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:05.491629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:05.491629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:05.491629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:05.491629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:05.491629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:05.491629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 20:55:05.491629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:05.491629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 304/630] 10.222.0.61 () {56 vars in 1093 bytes} [Thu May 26 20:55:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:05.503605 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a34be9-9e9d-4b02-9003-32ba464970cc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:05.562261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719efd2-685c-485f-b407-2e256c608736 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:05.562600 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:05.600111 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2d999-d18e-4ead-9b7d-1599cd719644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:05.600858 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2d999-d18e-4ead-9b7d-1599cd719644 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:05.601235 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2d999-d18e-4ead-9b7d-1599cd719644 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:05.601602 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2d999-d18e-4ead-9b7d-1599cd719644 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:05.602516 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2d999-d18e-4ead-9b7d-1599cd719644 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:05.602917 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2d999-d18e-4ead-9b7d-1599cd719644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:05.604424 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2d999-d18e-4ead-9b7d-1599cd719644 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:05.614549 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 327/631] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:55:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:05.619534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2d999-d18e-4ead-9b7d-1599cd719644 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:05.648572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a34be9-9e9d-4b02-9003-32ba464970cc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:05.683334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:05.687118 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfae5a-3414-4d91-93f6-c5a9e2868d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:05.688056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfae5a-3414-4d91-93f6-c5a9e2868d2c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:05.688568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfae5a-3414-4d91-93f6-c5a9e2868d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:05.689037 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfae5a-3414-4d91-93f6-c5a9e2868d2c None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:05.690154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfae5a-3414-4d91-93f6-c5a9e2868d2c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:05.690653 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfae5a-3414-4d91-93f6-c5a9e2868d2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:05.692282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfae5a-3414-4d91-93f6-c5a9e2868d2c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:05.723150 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2d999-d18e-4ead-9b7d-1599cd719644 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:05.726130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 305/632] 10.222.0.61 () {56 vars in 1133 bytes} [Thu May 26 20:55:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:05.735373 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfae5a-3414-4d91-93f6-c5a9e2868d2c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:05.773094 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c38a6-2992-4f99-82c7-8b8cddcbcdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:05.773777 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c38a6-2992-4f99-82c7-8b8cddcbcdeb None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:05.782244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c38a6-2992-4f99-82c7-8b8cddcbcdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:05.782533 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c38a6-2992-4f99-82c7-8b8cddcbcdeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:05.804532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c38a6-2992-4f99-82c7-8b8cddcbcdeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:05.806058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c38a6-2992-4f99-82c7-8b8cddcbcdeb None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:05.832278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-732c38a6-2992-4f99-82c7-8b8cddcbcdeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:05.832278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:05.832278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:05.832278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:05.832278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:05.832278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:05.832278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:05.832278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:05.832278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:05.832278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:05.832278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:05.832278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:05.832278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:05.832278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:05.832278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:05.833257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:05.833257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:05.833257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:05.833257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:05.833257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:05.833257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:05.833257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:05.833257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:05.833257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:05.833257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:05.833257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:05.833257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:05.833257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:05.833257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:05.833257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:05.833257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:05.833257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:05.834793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:05.834793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:05.834793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:05.834793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:05.834793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 328/633] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:05.846883 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c38a6-2992-4f99-82c7-8b8cddcbcdeb None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:05.871497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:05.878515 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfae5a-3414-4d91-93f6-c5a9e2868d2c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:05.916071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae6335-cd88-4e1e-94ae-5ab097b98da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:05.917171 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae6335-cd88-4e1e-94ae-5ab097b98da7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:05.917652 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae6335-cd88-4e1e-94ae-5ab097b98da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:05.918168 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae6335-cd88-4e1e-94ae-5ab097b98da7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:06.005821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c38a6-2992-4f99-82c7-8b8cddcbcdeb None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:06.038397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39c60b-4d3a-4ea2-b856-1fcdda087e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:06.041826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39c60b-4d3a-4ea2-b856-1fcdda087e7d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:06.041826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39c60b-4d3a-4ea2-b856-1fcdda087e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:06.041826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39c60b-4d3a-4ea2-b856-1fcdda087e7d None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:06.041826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39c60b-4d3a-4ea2-b856-1fcdda087e7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:06.041826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39c60b-4d3a-4ea2-b856-1fcdda087e7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:06.042402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39c60b-4d3a-4ea2-b856-1fcdda087e7d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:06.055993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 329/634] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:06.057000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:06.061302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39c60b-4d3a-4ea2-b856-1fcdda087e7d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:06.087143 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae6335-cd88-4e1e-94ae-5ab097b98da7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:06.088637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae6335-cd88-4e1e-94ae-5ab097b98da7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:06.170214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39c60b-4d3a-4ea2-b856-1fcdda087e7d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:06.208188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ddd03-8fe3-46fc-a0ae-e498d1e7acef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:06.209699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ddd03-8fe3-46fc-a0ae-e498d1e7acef None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:06.210241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ddd03-8fe3-46fc-a0ae-e498d1e7acef None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:06.211065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ddd03-8fe3-46fc-a0ae-e498d1e7acef None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:06.219160 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ddd03-8fe3-46fc-a0ae-e498d1e7acef None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:06.221619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ddd03-8fe3-46fc-a0ae-e498d1e7acef None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:06.238152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-f65ddd03-8fe3-46fc-a0ae-e498d1e7acef None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 20:55:06.238152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:06.238152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:06.238152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:06.238152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:06.238152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:06.238152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:06.238152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:06.238152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:06.238152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:06.238152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:06.238152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:06.238152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:06.238152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:06.238152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:06.238152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:06.239162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:06.240069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:06.240069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:06.240069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:06.240069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:06.240069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:06.240069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:06.240069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:06.240069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:06.240069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 20:55:06.240069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:06.240069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 330/635] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:55:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:06.245407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca7bbd-bf8b-4fe5-accc-0c2844d5f9a8 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:06.245699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca7bbd-bf8b-4fe5-accc-0c2844d5f9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:06.246110 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca7bbd-bf8b-4fe5-accc-0c2844d5f9a8 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:06.251779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 331/636] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:06.252505 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca7bbd-bf8b-4fe5-accc-0c2844d5f9a8 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:06.291065 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:06.298026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:06.308078 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 306/637] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:55:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 20:55:06.309546 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17601a-b500-4faf-8d27-da9f98daaca3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:06.309890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17601a-b500-4faf-8d27-da9f98daaca3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:06.310136 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17601a-b500-4faf-8d27-da9f98daaca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:06.327253 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ba17601a-b500-4faf-8d27-da9f98daaca3 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:06.328578 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ba17601a-b500-4faf-8d27-da9f98daaca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:06.387505 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca7bbd-bf8b-4fe5-accc-0c2844d5f9a8 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:06.406058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 307/638] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:55:06.406976 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17601a-b500-4faf-8d27-da9f98daaca3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:06.428603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdff9bf-b161-41a1-9044-8b8e9293fb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:06.430061 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdff9bf-b161-41a1-9044-8b8e9293fb52 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:06.430679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdff9bf-b161-41a1-9044-8b8e9293fb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:06.431174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdff9bf-b161-41a1-9044-8b8e9293fb52 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:06.432368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdff9bf-b161-41a1-9044-8b8e9293fb52 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:06.432888 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdff9bf-b161-41a1-9044-8b8e9293fb52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:06.435245 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdff9bf-b161-41a1-9044-8b8e9293fb52 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:06.463021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 332/639] 10.222.0.61 () {56 vars in 1137 bytes} [Thu May 26 20:55:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:06.464740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdff9bf-b161-41a1-9044-8b8e9293fb52 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:06.533882 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17601a-b500-4faf-8d27-da9f98daaca3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:06.562178 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:06.562520 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:06.570653 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdff9bf-b161-41a1-9044-8b8e9293fb52 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:06.572295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e7c4e-f7cf-45d1-9664-aba708ec44b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:06.573108 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7c4e-f7cf-45d1-9664-aba708ec44b1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:06.573385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7c4e-f7cf-45d1-9664-aba708ec44b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:06.573652 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7c4e-f7cf-45d1-9664-aba708ec44b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:06.584128 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e7c4e-f7cf-45d1-9664-aba708ec44b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:06.586098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e7c4e-f7cf-45d1-9664-aba708ec44b1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:06.603286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-979e7c4e-f7cf-45d1-9664-aba708ec44b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:06.603286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:06.603286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:06.603286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:06.603286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:06.603286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:06.603286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:06.603286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:06.603286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:06.603286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:06.603286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:06.603286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:06.603286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:06.603286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:06.603286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:06.604191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:06.604191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:06.604191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:06.604191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:06.604191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:06.604191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:06.604191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:06.604191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:06.604191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:06.604191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:06.604191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:06.604191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:06.604191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:06.604191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:06.604191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:06.604191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:06.604191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:06.605052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:06.605052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:06.605052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:06.605052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:06.605052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 308/640] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:06.610468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6baee9-1b71-44fc-a3d3-674f2b065fa3 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:06.610468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6baee9-1b71-44fc-a3d3-674f2b065fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:06.610468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6baee9-1b71-44fc-a3d3-674f2b065fa3 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:06.610468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 309/641] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:06.610468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6baee9-1b71-44fc-a3d3-674f2b065fa3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:06.616003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ef94e-22bf-416b-8822-a16c5e976de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:06.617014 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ef94e-22bf-416b-8822-a16c5e976de3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:06.617450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ef94e-22bf-416b-8822-a16c5e976de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:06.617905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ef94e-22bf-416b-8822-a16c5e976de3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:06.629717 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ef94e-22bf-416b-8822-a16c5e976de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:06.637522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-2c0ef94e-22bf-416b-8822-a16c5e976de3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:06.637522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:06.637522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:06.637522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:06.637522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:06.637522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:06.637522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:06.637522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:06.637522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:06.637522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:06.637522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:06.637522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:06.637522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:06.637522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:06.637522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:06.637522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:06.638631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:06.638631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:06.638631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:06.638631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:06.638631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:06.638631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:06.638631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:06.638631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:06.638631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:06.638631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:06.638631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:06.638631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:06.638631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:06.638631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:06.638631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:06.638631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:06.639621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:06.639621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:06.639621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:06.639621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:06.639621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:06.639621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:06.639621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:06.639621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:06.639621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:06.639621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:06.639621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:06.639621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:06.642143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 333/642] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:55:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:06.643167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ef94e-22bf-416b-8822-a16c5e976de3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:06.721896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6baee9-1b71-44fc-a3d3-674f2b065fa3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:06.756631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67224b82-7e6b-4c99-a07f-b0c84e5d2b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:06.757292 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67224b82-7e6b-4c99-a07f-b0c84e5d2b06 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:06.757570 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67224b82-7e6b-4c99-a07f-b0c84e5d2b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:06.757900 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67224b82-7e6b-4c99-a07f-b0c84e5d2b06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:06.762923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ef94e-22bf-416b-8822-a16c5e976de3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:06.799301 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741bf35-24e5-4dc9-8a2e-6b2501aaba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:06.799986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741bf35-24e5-4dc9-8a2e-6b2501aaba37 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:06.800273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741bf35-24e5-4dc9-8a2e-6b2501aaba37 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:06.800552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741bf35-24e5-4dc9-8a2e-6b2501aaba37 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:06.801280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741bf35-24e5-4dc9-8a2e-6b2501aaba37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:06.801589 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741bf35-24e5-4dc9-8a2e-6b2501aaba37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:06.803035 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741bf35-24e5-4dc9-8a2e-6b2501aaba37 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:06.809385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:06.820743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 334/643] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:06.820743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f2b9-6bb7-4928-8938-952b1681c6f0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:06.820743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f2b9-6bb7-4928-8938-952b1681c6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:06.820743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f2b9-6bb7-4928-8938-952b1681c6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:06.834461 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-9e44f2b9-6bb7-4928-8938-952b1681c6f0 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:06.835984 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9e44f2b9-6bb7-4928-8938-952b1681c6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:06.840137 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67224b82-7e6b-4c99-a07f-b0c84e5d2b06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:06.841713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67224b82-7e6b-4c99-a07f-b0c84e5d2b06 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:06.846633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:06.909317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 335/644] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:55:06.909993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44f2b9-6bb7-4928-8938-952b1681c6f0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:06.955333 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 310/645] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:55:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:55:06.956180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67224b82-7e6b-4c99-a07f-b0c84e5d2b06 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:07.020416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44f2b9-6bb7-4928-8938-952b1681c6f0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:07.043461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:07.058121 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749789f-62bd-46a6-86ba-d8991f000d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:07.058805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749789f-62bd-46a6-86ba-d8991f000d3c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:07.059079 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749789f-62bd-46a6-86ba-d8991f000d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:07.059339 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749789f-62bd-46a6-86ba-d8991f000d3c None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:07.060103 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749789f-62bd-46a6-86ba-d8991f000d3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:07.060399 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749789f-62bd-46a6-86ba-d8991f000d3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:07.061821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749789f-62bd-46a6-86ba-d8991f000d3c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:07.068912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67224b82-7e6b-4c99-a07f-b0c84e5d2b06 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:07.070807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 336/646] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:55:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:07.071617 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749789f-62bd-46a6-86ba-d8991f000d3c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:07.082446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:07.111615 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7e31f-c8e1-4049-ad89-f7c87ced9e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:07.112657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7e31f-c8e1-4049-ad89-f7c87ced9e2a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:07.113084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7e31f-c8e1-4049-ad89-f7c87ced9e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:07.113502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7e31f-c8e1-4049-ad89-f7c87ced9e2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:07.121404 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7e31f-c8e1-4049-ad89-f7c87ced9e2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:07.123059 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7e31f-c8e1-4049-ad89-f7c87ced9e2a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:07.137940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b3f7e31f-c8e1-4049-ad89-f7c87ced9e2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:07.137940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:07.137940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:07.137940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:07.137940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:07.137940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:07.137940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:07.137940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:07.137940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:07.137940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:07.137940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:07.137940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:07.137940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:07.137940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:07.137940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:07.138990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:07.138990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:07.138990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:07.138990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:07.138990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:07.138990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:07.138990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:07.138990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:07.138990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:07.138990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:07.138990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:07.138990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:07.138990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:07.138990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:07.138990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:07.138990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:07.138990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:07.140312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:07.140312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:07.140312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:07.140312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:07.140312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:07.140312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:07.140312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:07.140312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:07.142314 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 311/647] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:07.143399 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7e31f-c8e1-4049-ad89-f7c87ced9e2a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:07.180971 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749789f-62bd-46a6-86ba-d8991f000d3c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:07.214872 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fd468-278c-4f0e-afbe-84d9623ec6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:07.215693 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fd468-278c-4f0e-afbe-84d9623ec6aa None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:07.215974 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fd468-278c-4f0e-afbe-84d9623ec6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:07.216246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fd468-278c-4f0e-afbe-84d9623ec6aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:07.228387 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fd468-278c-4f0e-afbe-84d9623ec6aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:07.236337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-770fd468-278c-4f0e-afbe-84d9623ec6aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:07.236337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:07.236337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:07.236337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:07.236337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:07.236337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:07.236337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:07.236337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:07.236337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:07.236337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:07.236337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:07.236337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:07.236337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:07.236337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:07.236337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:07.236337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:07.237280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:07.237280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:07.237280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:07.237280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:07.237280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:07.237280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:07.237280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:07.237280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:07.237280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:07.237280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:07.237280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:07.237280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:07.237280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:07.237280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:07.237280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:07.237280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:07.238651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:07.238651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:07.238651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:07.238651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:07.238651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:07.238651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:07.238651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:07.238651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:07.238651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:07.238651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:07.238651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:07.238651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:07.238651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 337/648] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:55:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:07.238651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fd468-278c-4f0e-afbe-84d9623ec6aa None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:07.256991 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7e31f-c8e1-4049-ad89-f7c87ced9e2a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:07.292846 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1812da5-6edd-4588-bd09-219a68c76356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:07.293772 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1812da5-6edd-4588-bd09-219a68c76356 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:07.294091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1812da5-6edd-4588-bd09-219a68c76356 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:07.294366 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1812da5-6edd-4588-bd09-219a68c76356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:07.302017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:07.306858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1812da5-6edd-4588-bd09-219a68c76356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:07.308421 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1812da5-6edd-4588-bd09-219a68c76356 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:07.312970 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:07.328028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c1812da5-6edd-4588-bd09-219a68c76356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:07.328028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:07.328028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:07.328028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:07.328028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:07.328028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:07.328028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:07.328028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:07.328028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:07.328028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:07.328028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:07.328028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:07.328028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:07.328028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:07.328028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:07.328951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:07.328951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:07.328951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:07.328951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:07.328951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:07.328951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:07.328951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:07.328951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:07.328951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:07.328951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:07.328951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:07.328951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:07.328951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:07.328951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:07.328951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:07.328951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:07.328951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:07.329855 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:07.329855 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:07.329855 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:07.329855 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:07.329855 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 312/649] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:07.330142 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1812da5-6edd-4588-bd09-219a68c76356 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:07.355313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fd468-278c-4f0e-afbe-84d9623ec6aa None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:07.392152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980d6ac-fb0f-4d98-9336-54827f7790bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:07.393360 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980d6ac-fb0f-4d98-9336-54827f7790bb None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:07.393868 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980d6ac-fb0f-4d98-9336-54827f7790bb None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:07.394397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980d6ac-fb0f-4d98-9336-54827f7790bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:07.407515 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980d6ac-fb0f-4d98-9336-54827f7790bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:07.409388 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980d6ac-fb0f-4d98-9336-54827f7790bb None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:07.428384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-3980d6ac-fb0f-4d98-9336-54827f7790bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:07.428384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:07.428384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:07.428384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:07.428384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:07.428384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:07.428384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:07.428384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:07.428384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:07.428384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:07.428384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:07.428384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:07.428384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:07.428384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:07.428384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:07.429455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:07.429455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:07.429455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:07.429455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:07.429455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:07.429455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:07.429455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:07.429455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:07.429455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:07.429455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:07.429455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:07.429455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:07.429455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:07.429455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:07.429455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:07.429455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:07.429455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:07.435375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:07.435375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:07.435375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:07.435375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:07.435375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 338/650] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:07.435375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980d6ac-fb0f-4d98-9336-54827f7790bb None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:07.443176 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1812da5-6edd-4588-bd09-219a68c76356 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:07.479107 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10cd81-020b-4ecf-bfc4-6579df0083dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:07.480041 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10cd81-020b-4ecf-bfc4-6579df0083dd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:07.480324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10cd81-020b-4ecf-bfc4-6579df0083dd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:07.480589 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10cd81-020b-4ecf-bfc4-6579df0083dd None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:07.481386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10cd81-020b-4ecf-bfc4-6579df0083dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:07.481698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10cd81-020b-4ecf-bfc4-6579df0083dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:07.483333 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10cd81-020b-4ecf-bfc4-6579df0083dd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:07.501531 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 313/651] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:07.501531 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10cd81-020b-4ecf-bfc4-6579df0083dd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:07.545188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980d6ac-fb0f-4d98-9336-54827f7790bb None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:07.558839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:07.565023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:07.583458 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edff1a0-3669-46b2-99df-d0c9d0df7b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:07.584871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edff1a0-3669-46b2-99df-d0c9d0df7b02 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:07.584871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edff1a0-3669-46b2-99df-d0c9d0df7b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:07.584871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edff1a0-3669-46b2-99df-d0c9d0df7b02 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:07.585806 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edff1a0-3669-46b2-99df-d0c9d0df7b02 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:07.586129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edff1a0-3669-46b2-99df-d0c9d0df7b02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:07.588128 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edff1a0-3669-46b2-99df-d0c9d0df7b02 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:07.601339 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 339/652] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:55:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:07.601339 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edff1a0-3669-46b2-99df-d0c9d0df7b02 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:07.621927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10cd81-020b-4ecf-bfc4-6579df0083dd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:07.661639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71c170-85a0-44be-8d7b-831549228c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:07.662351 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71c170-85a0-44be-8d7b-831549228c46 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:07.662635 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71c170-85a0-44be-8d7b-831549228c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:07.662918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71c170-85a0-44be-8d7b-831549228c46 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:07.663644 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71c170-85a0-44be-8d7b-831549228c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:07.663951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71c170-85a0-44be-8d7b-831549228c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:07.665344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71c170-85a0-44be-8d7b-831549228c46 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:07.679120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 314/653] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:07.679780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71c170-85a0-44be-8d7b-831549228c46 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:07.713031 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edff1a0-3669-46b2-99df-d0c9d0df7b02 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:07.749480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114d539-d54a-4356-8aa4-651be7ba925d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:07.750272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d539-d54a-4356-8aa4-651be7ba925d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:07.750560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d539-d54a-4356-8aa4-651be7ba925d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:07.750839 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d539-d54a-4356-8aa4-651be7ba925d None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:07.751578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114d539-d54a-4356-8aa4-651be7ba925d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:07.751891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114d539-d54a-4356-8aa4-651be7ba925d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:07.753308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114d539-d54a-4356-8aa4-651be7ba925d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:07.767436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 340/654] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:07.768413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114d539-d54a-4356-8aa4-651be7ba925d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:07.792041 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71c170-85a0-44be-8d7b-831549228c46 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:07.802506 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:07.810886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:07.826388 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804df220-5e5f-4dd7-a99b-da8df328a8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:07.827056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804df220-5e5f-4dd7-a99b-da8df328a8ac None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:07.827340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804df220-5e5f-4dd7-a99b-da8df328a8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:07.827674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804df220-5e5f-4dd7-a99b-da8df328a8ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:07.828507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804df220-5e5f-4dd7-a99b-da8df328a8ac None admin] RBAC: Adding query filter params (role.id=6046421464dd48ea8977d7d1481bde10, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=a99b767501244338bc48fb5428a589a1) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:07.828816 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804df220-5e5f-4dd7-a99b-da8df328a8ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:07.830336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804df220-5e5f-4dd7-a99b-da8df328a8ac None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:07.836649 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 315/655] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:55:07 2022] GET /identity/v3/role_assignments?user.id=a99b767501244338bc48fb5428a589a1&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=6046421464dd48ea8977d7d1481bde10 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:07.837410 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804df220-5e5f-4dd7-a99b-da8df328a8ac None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:07.873493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114d539-d54a-4356-8aa4-651be7ba925d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:07.911046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba3d23-00c5-4d08-8705-ee5f5bdb273b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:07.911876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba3d23-00c5-4d08-8705-ee5f5bdb273b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:07.912162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba3d23-00c5-4d08-8705-ee5f5bdb273b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:07.912429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba3d23-00c5-4d08-8705-ee5f5bdb273b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:07.924134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba3d23-00c5-4d08-8705-ee5f5bdb273b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:07.925706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba3d23-00c5-4d08-8705-ee5f5bdb273b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:07.945351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-cbba3d23-00c5-4d08-8705-ee5f5bdb273b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:07.945351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:07.945351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:07.945351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:07.945351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:07.945351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:07.945351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:07.945351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:07.945351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:07.945351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:07.945351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:07.945351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:07.945351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:07.945351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:07.945351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:07.946557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:07.946557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:07.946557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:07.946557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:07.946557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:07.946557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:07.946557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:07.946557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:07.946557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:07.946557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:07.946557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:07.946557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:07.946557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:07.946557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:07.946557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:07.946557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:07.946557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:07.947473 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:07.947473 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:07.947473 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:07.947473 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:07.947473 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 341/656] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:07.948054 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4608bd-adad-4157-80dd-7b05a9d8c3e9 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:07.948345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4608bd-adad-4157-80dd-7b05a9d8c3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:07.948623 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4608bd-adad-4157-80dd-7b05a9d8c3e9 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:07.950138 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 342/657] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:07.955794 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4608bd-adad-4157-80dd-7b05a9d8c3e9 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:07.977491 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804df220-5e5f-4dd7-a99b-da8df328a8ac None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:08.018605 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6691e6f-0f19-456f-8b1c-0c0aa18425ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:08.019743 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6691e6f-0f19-456f-8b1c-0c0aa18425ea None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:08.020193 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6691e6f-0f19-456f-8b1c-0c0aa18425ea None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:08.020630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6691e6f-0f19-456f-8b1c-0c0aa18425ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:08.028868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6691e6f-0f19-456f-8b1c-0c0aa18425ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:08.030389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6691e6f-0f19-456f-8b1c-0c0aa18425ea None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:08.046892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d6691e6f-0f19-456f-8b1c-0c0aa18425ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:08.046892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:08.046892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:08.046892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:08.046892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:08.046892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:08.046892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:08.046892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:08.046892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:08.046892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:08.046892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:08.046892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:08.046892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:08.046892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:08.046892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:08.048002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:08.048002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:08.048002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:08.048002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:08.048002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:08.048002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:08.048002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:08.048002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:08.048002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:08.048002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:08.048002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:08.048002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:08.048002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:08.048002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:08.048002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:08.048002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:08.048002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:08.049097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:08.049097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:08.049097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:08.049097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:08.049097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:08.049097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:08.049097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:08.049097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:08.053160 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 316/658] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:08.053954 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6691e6f-0f19-456f-8b1c-0c0aa18425ea None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:08.062448 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:08.075212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4608bd-adad-4157-80dd-7b05a9d8c3e9 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:08.094946 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:08.117079 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fa692-847d-49b9-9c0d-57c01e6b98b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:08.117999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fa692-847d-49b9-9c0d-57c01e6b98b9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:08.118287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fa692-847d-49b9-9c0d-57c01e6b98b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:08.118567 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fa692-847d-49b9-9c0d-57c01e6b98b9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:08.126512 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fa692-847d-49b9-9c0d-57c01e6b98b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:08.128024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fa692-847d-49b9-9c0d-57c01e6b98b9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:08.143227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-228fa692-847d-49b9-9c0d-57c01e6b98b9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 20:55:08.143227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:08.143227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:08.143227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:08.143227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:08.143227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:08.143227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:08.143227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:08.143227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:08.143227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:08.143227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:08.143227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:08.143227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:08.143227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:08.143227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:08.143227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:08.144219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:08.145129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:08.145129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:08.145129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:08.145129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:08.145129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:08.145129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:08.145129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:08.145129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:08.145129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 20:55:08.145129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:08.145129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 343/659] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:55:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:08.145745 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b8e07-842b-44f8-b761-bc453b964b1c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:08.146708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b8e07-842b-44f8-b761-bc453b964b1c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:08.146708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b8e07-842b-44f8-b761-bc453b964b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:08.163414 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1c8b8e07-842b-44f8-b761-bc453b964b1c None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:08.164611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1c8b8e07-842b-44f8-b761-bc453b964b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:08.175237 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6691e6f-0f19-456f-8b1c-0c0aa18425ea None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:08.213014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260615b-fb82-43ab-b92b-14df71ec7fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:08.213689 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260615b-fb82-43ab-b92b-14df71ec7fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:08.214026 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260615b-fb82-43ab-b92b-14df71ec7fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:08.214302 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260615b-fb82-43ab-b92b-14df71ec7fa9 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:08.215034 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260615b-fb82-43ab-b92b-14df71ec7fa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:08.215340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260615b-fb82-43ab-b92b-14df71ec7fa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:08.216716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260615b-fb82-43ab-b92b-14df71ec7fa9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:08.229764 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 317/660] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:08.234820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260615b-fb82-43ab-b92b-14df71ec7fa9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:08.241833 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 344/661] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:55:08.241833 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b8e07-842b-44f8-b761-bc453b964b1c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:08.331709 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:08.342508 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:08.351167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260615b-fb82-43ab-b92b-14df71ec7fa9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:08.352253 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b8e07-842b-44f8-b761-bc453b964b1c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:08.387379 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d9d24-5dce-4658-9eda-86c7442b40e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:08.387739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4c5d8-e5ad-498b-bdf7-41a40368cb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:08.388057 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d9d24-5dce-4658-9eda-86c7442b40e5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:08.388349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d9d24-5dce-4658-9eda-86c7442b40e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:08.388537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4c5d8-e5ad-498b-bdf7-41a40368cb10 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:08.388646 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d9d24-5dce-4658-9eda-86c7442b40e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:08.388792 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4c5d8-e5ad-498b-bdf7-41a40368cb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:08.389072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4c5d8-e5ad-498b-bdf7-41a40368cb10 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:08.389386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d9d24-5dce-4658-9eda-86c7442b40e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:08.389692 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d9d24-5dce-4658-9eda-86c7442b40e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:08.390081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4c5d8-e5ad-498b-bdf7-41a40368cb10 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:08.390420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4c5d8-e5ad-498b-bdf7-41a40368cb10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:08.391213 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d9d24-5dce-4658-9eda-86c7442b40e5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:08.391881 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4c5d8-e5ad-498b-bdf7-41a40368cb10 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:08.409955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 318/662] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:08.409955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d9d24-5dce-4658-9eda-86c7442b40e5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:08.414411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 345/663] 10.222.0.61 () {56 vars in 1137 bytes} [Thu May 26 20:55:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:08.418977 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4c5d8-e5ad-498b-bdf7-41a40368cb10 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:08.517115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d9d24-5dce-4658-9eda-86c7442b40e5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:08.523067 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4c5d8-e5ad-498b-bdf7-41a40368cb10 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:08.554772 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48826ed7-ac10-4a8f-8a07-f0354f41ded7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:08.555674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826ed7-ac10-4a8f-8a07-f0354f41ded7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:08.555954 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826ed7-ac10-4a8f-8a07-f0354f41ded7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:08.556223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826ed7-ac10-4a8f-8a07-f0354f41ded7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:08.557971 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1820a67-c05b-4b5d-99cc-f04e6d68a556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:08.558825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1820a67-c05b-4b5d-99cc-f04e6d68a556 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:08.559183 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1820a67-c05b-4b5d-99cc-f04e6d68a556 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:08.559529 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1820a67-c05b-4b5d-99cc-f04e6d68a556 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:08.564028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48826ed7-ac10-4a8f-8a07-f0354f41ded7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:08.565574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48826ed7-ac10-4a8f-8a07-f0354f41ded7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:08.567997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:08.571943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1820a67-c05b-4b5d-99cc-f04e6d68a556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:08.580405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-b1820a67-c05b-4b5d-99cc-f04e6d68a556 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:08.580405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:08.580405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:08.580405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:08.580405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:08.580405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:08.580405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:08.580405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:08.580405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:08.580405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:08.580405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:08.580405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:08.580405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:08.580405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:08.580405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:08.580405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:08.581526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:08.581526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:08.581526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:08.581526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:08.581526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:08.581526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:08.581526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:08.581526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:08.581526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:08.581526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:08.581526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:08.581526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:08.581526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:08.581526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:08.581526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:08.581526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:08.582445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:08.582445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:08.582445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:08.582445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:08.582445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:08.582445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:08.582445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:08.582445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:08.582445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:08.582445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:08.582445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:08.582445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:08.583494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-48826ed7-ac10-4a8f-8a07-f0354f41ded7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 20:55:08.583494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:08.583494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:08.583494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:08.583494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:08.583494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:08.583494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:08.583494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:08.583494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:08.583494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:08.583494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:08.583494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:08.583494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:08.583494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:08.583494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:08.583494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:08.584328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:08.585229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:08.585229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:08.585229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:08.585229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:08.585229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:08.585229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:08.585229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:08.585229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:08.585229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 20:55:08.585229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:08.589471 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 346/664] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:55:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:08.589937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 319/665] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:55:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:08.590398 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1820a67-c05b-4b5d-99cc-f04e6d68a556 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:08.590952 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48826ed7-ac10-4a8f-8a07-f0354f41ded7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:08.608560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:08.697028 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1820a67-c05b-4b5d-99cc-f04e6d68a556 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:08.697935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48826ed7-ac10-4a8f-8a07-f0354f41ded7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:08.731666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca6b3a-e2c1-4d32-aa33-614fe5beccf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:08.732334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca6b3a-e2c1-4d32-aa33-614fe5beccf8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:08.732613 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca6b3a-e2c1-4d32-aa33-614fe5beccf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:08.732885 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca6b3a-e2c1-4d32-aa33-614fe5beccf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:08.733763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca6b3a-e2c1-4d32-aa33-614fe5beccf8 None admin] RBAC: Adding query filter params (role.id=6046421464dd48ea8977d7d1481bde10, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=e877e97dae064fe9ad3d378296b78ff9) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:08.733954 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abe9ca-db39-48cd-930d-9e94c4021a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:08.734131 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca6b3a-e2c1-4d32-aa33-614fe5beccf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:08.734682 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abe9ca-db39-48cd-930d-9e94c4021a01 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:08.734969 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abe9ca-db39-48cd-930d-9e94c4021a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:08.735247 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abe9ca-db39-48cd-930d-9e94c4021a01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:08.735570 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca6b3a-e2c1-4d32-aa33-614fe5beccf8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:08.749846 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 347/666] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:55:08 2022] GET /identity/v3/role_assignments?user.id=e877e97dae064fe9ad3d378296b78ff9&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=6046421464dd48ea8977d7d1481bde10 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:08.749846 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca6b3a-e2c1-4d32-aa33-614fe5beccf8 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:08.825033 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:08.825924 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abe9ca-db39-48cd-930d-9e94c4021a01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:08.827936 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abe9ca-db39-48cd-930d-9e94c4021a01 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:08.846550 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:08.875530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca6b3a-e2c1-4d32-aa33-614fe5beccf8 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:08.920096 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1073e-be19-4e6a-a0a9-8916ba04d6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:08.920328 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1073e-be19-4e6a-a0a9-8916ba04d6ab None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:08.920409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1073e-be19-4e6a-a0a9-8916ba04d6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:08.920691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1073e-be19-4e6a-a0a9-8916ba04d6ab None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:08.921550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1073e-be19-4e6a-a0a9-8916ba04d6ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:08.921903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1073e-be19-4e6a-a0a9-8916ba04d6ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:08.923471 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1073e-be19-4e6a-a0a9-8916ba04d6ab None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:08.938583 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 348/667] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:55:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:08.938583 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1073e-be19-4e6a-a0a9-8916ba04d6ab None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:08.966851 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 320/668] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:55:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:55:08.967573 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abe9ca-db39-48cd-930d-9e94c4021a01 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:09.085725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1073e-be19-4e6a-a0a9-8916ba04d6ab None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:09.109004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abe9ca-db39-48cd-930d-9e94c4021a01 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:09.114440 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:09.125469 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3a191-5de1-42ed-a465-a208881fe5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:09.126479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3a191-5de1-42ed-a465-a208881fe5cc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:09.126961 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3a191-5de1-42ed-a465-a208881fe5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:09.127419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3a191-5de1-42ed-a465-a208881fe5cc None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:09.128438 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3a191-5de1-42ed-a465-a208881fe5cc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:09.128850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:09.129097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3a191-5de1-42ed-a465-a208881fe5cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:09.130819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3a191-5de1-42ed-a465-a208881fe5cc None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:09.150242 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 349/669] 10.222.0.61 () {56 vars in 1139 bytes} [Thu May 26 20:55:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:09.151367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3a191-5de1-42ed-a465-a208881fe5cc None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:09.156663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238eae3c-2ceb-47d0-88e7-66a9c785edee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:09.157662 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238eae3c-2ceb-47d0-88e7-66a9c785edee None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:09.157984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238eae3c-2ceb-47d0-88e7-66a9c785edee None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:09.158267 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238eae3c-2ceb-47d0-88e7-66a9c785edee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:09.170383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238eae3c-2ceb-47d0-88e7-66a9c785edee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:09.171996 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238eae3c-2ceb-47d0-88e7-66a9c785edee None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:09.194971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-238eae3c-2ceb-47d0-88e7-66a9c785edee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:09.194971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:09.194971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:09.194971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:09.194971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:09.194971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:09.194971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:09.194971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:09.194971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:09.194971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:09.194971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:09.194971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:09.194971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:09.194971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:09.194971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:09.195896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:09.195896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:09.195896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:09.195896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:09.195896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:09.195896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:09.195896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:09.195896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:09.195896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:09.195896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:09.195896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:09.195896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:09.195896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:09.195896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:09.195896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:09.195896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:09.195896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:09.196765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:09.196765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:09.196765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:09.196765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:09.196765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 321/670] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:09.197875 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238eae3c-2ceb-47d0-88e7-66a9c785edee None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:09.280933 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3a191-5de1-42ed-a465-a208881fe5cc None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:09.316577 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95c055-0a12-44f9-9a59-01ff1ea966f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:09.317386 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95c055-0a12-44f9-9a59-01ff1ea966f3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:09.317670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95c055-0a12-44f9-9a59-01ff1ea966f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:09.317994 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95c055-0a12-44f9-9a59-01ff1ea966f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:09.322244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238eae3c-2ceb-47d0-88e7-66a9c785edee None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:09.330651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95c055-0a12-44f9-9a59-01ff1ea966f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:09.332552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95c055-0a12-44f9-9a59-01ff1ea966f3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:09.355657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-9f95c055-0a12-44f9-9a59-01ff1ea966f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:09.355657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:09.355657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:09.355657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:09.355657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:09.355657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:09.355657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:09.355657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:09.355657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:09.355657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:09.355657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:09.355657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:09.355657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:09.355657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:09.355657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:09.356603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:09.356603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:09.356603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:09.356603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:09.356603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:09.356603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:09.356603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:09.356603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:09.356603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:09.356603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:09.356603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:09.356603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:09.356603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:09.356603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:09.356603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:09.356603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:09.356603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:09.357479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:09.357479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:09.357479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:09.357479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:09.357479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 350/671] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:09.358205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95c055-0a12-44f9-9a59-01ff1ea966f3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:09.366454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756aa42f-e10a-47cf-81de-be65618cf4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:09.367423 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756aa42f-e10a-47cf-81de-be65618cf4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:09.368423 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756aa42f-e10a-47cf-81de-be65618cf4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:09.368914 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756aa42f-e10a-47cf-81de-be65618cf4e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:09.399652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:09.416438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:09.466886 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756aa42f-e10a-47cf-81de-be65618cf4e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:09.469726 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756aa42f-e10a-47cf-81de-be65618cf4e6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:09.481426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95c055-0a12-44f9-9a59-01ff1ea966f3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:09.524521 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7a0f7-0488-4b53-9f1b-50b35bcf849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:09.525402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7a0f7-0488-4b53-9f1b-50b35bcf849a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:09.526145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7a0f7-0488-4b53-9f1b-50b35bcf849a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:09.526526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7a0f7-0488-4b53-9f1b-50b35bcf849a None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:09.527640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7a0f7-0488-4b53-9f1b-50b35bcf849a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:09.528041 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7a0f7-0488-4b53-9f1b-50b35bcf849a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:09.529707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7a0f7-0488-4b53-9f1b-50b35bcf849a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:09.545633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 351/672] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:09.546885 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7a0f7-0488-4b53-9f1b-50b35bcf849a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:09.596256 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 322/673] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:55:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:55:09.597396 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756aa42f-e10a-47cf-81de-be65618cf4e6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:09.652739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:09.660394 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7a0f7-0488-4b53-9f1b-50b35bcf849a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:09.670705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:09.696269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85974a1e-1c85-4922-8e87-f549d0bb9732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:09.697315 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85974a1e-1c85-4922-8e87-f549d0bb9732 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:09.697923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85974a1e-1c85-4922-8e87-f549d0bb9732 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:09.698398 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85974a1e-1c85-4922-8e87-f549d0bb9732 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:09.699315 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85974a1e-1c85-4922-8e87-f549d0bb9732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:09.699813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85974a1e-1c85-4922-8e87-f549d0bb9732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:09.701610 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85974a1e-1c85-4922-8e87-f549d0bb9732 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:09.710853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756aa42f-e10a-47cf-81de-be65618cf4e6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:09.716453 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 352/674] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:09.717611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85974a1e-1c85-4922-8e87-f549d0bb9732 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:09.748883 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5b3c1-7e21-493e-83c8-bac8c5339065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:09.750099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5b3c1-7e21-493e-83c8-bac8c5339065 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:09.750234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5b3c1-7e21-493e-83c8-bac8c5339065 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:09.750489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5b3c1-7e21-493e-83c8-bac8c5339065 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:09.758497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5b3c1-7e21-493e-83c8-bac8c5339065 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:09.760021 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5b3c1-7e21-493e-83c8-bac8c5339065 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:09.776239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-6cf5b3c1-7e21-493e-83c8-bac8c5339065 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 20:55:09.776239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:09.776239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:09.776239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:09.776239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:09.776239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:09.776239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:09.776239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:09.776239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:09.776239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:09.776239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:09.776239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:09.776239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:09.776239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:09.776239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:09.776239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:09.777156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:09.778139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:09.778139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:09.778139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:09.778139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:09.778139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:09.778139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:09.778139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:09.778139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:09.778139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 20:55:09.778139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:09.778139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 323/675] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:55:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:09.779201 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5b3c1-7e21-493e-83c8-bac8c5339065 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:09.831926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85974a1e-1c85-4922-8e87-f549d0bb9732 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:09.873105 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef1dbd-80a1-4410-9ef2-1658bbf3814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:09.874005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef1dbd-80a1-4410-9ef2-1658bbf3814f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:09.874463 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef1dbd-80a1-4410-9ef2-1658bbf3814f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:09.874745 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef1dbd-80a1-4410-9ef2-1658bbf3814f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:09.885504 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5b3c1-7e21-493e-83c8-bac8c5339065 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:09.886019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef1dbd-80a1-4410-9ef2-1658bbf3814f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:09.887627 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef1dbd-80a1-4410-9ef2-1658bbf3814f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:09.906909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-e0ef1dbd-80a1-4410-9ef2-1658bbf3814f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:09.906909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:09.906909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:09.906909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:09.906909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:09.906909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:09.906909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:09.906909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:09.906909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:09.906909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:09.906909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:09.906909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:09.906909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:09.906909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:09.906909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:09.907815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:09.907815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:09.907815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:09.907815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:09.907815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:09.907815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:09.907815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:09.907815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:09.907815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:09.907815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:09.907815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:09.907815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:09.907815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:09.907815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:09.907815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:09.907815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:09.907815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:09.908689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:09.908689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:09.908689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:09.908689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:09.912775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 353/676] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:09.913761 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:09.914167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef1dbd-80a1-4410-9ef2-1658bbf3814f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:09.923466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acca013-f328-4600-a400-f5747906b4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:09.925171 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acca013-f328-4600-a400-f5747906b4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:09.925463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acca013-f328-4600-a400-f5747906b4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:09.925745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acca013-f328-4600-a400-f5747906b4c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:09.929889 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:09.936890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acca013-f328-4600-a400-f5747906b4c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:09.939947 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acca013-f328-4600-a400-f5747906b4c5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:09.956453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3acca013-f328-4600-a400-f5747906b4c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:09.956453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:09.956453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:09.956453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:09.956453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:09.956453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:09.956453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:09.956453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:09.956453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:09.956453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:09.956453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:09.956453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:09.956453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:09.956453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:09.956453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:09.957435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:09.957435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:09.957435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:09.957435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:09.957435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:09.957435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:09.957435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:09.957435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:09.957435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:09.957435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:09.957435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:09.957435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:09.957435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:09.957435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:09.957435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:09.957435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:09.957435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:09.958556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:09.958556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:09.958556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:09.958556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:09.958556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:09.958556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:09.958556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:09.958556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:09.966028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 324/677] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:09.967430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acca013-f328-4600-a400-f5747906b4c5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:10.036574 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef1dbd-80a1-4410-9ef2-1658bbf3814f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:10.072871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9433376-b6eb-4a00-916d-ee9e765d13aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:10.073559 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9433376-b6eb-4a00-916d-ee9e765d13aa None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:10.073864 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9433376-b6eb-4a00-916d-ee9e765d13aa None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:10.074145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9433376-b6eb-4a00-916d-ee9e765d13aa None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:10.075103 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9433376-b6eb-4a00-916d-ee9e765d13aa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:10.075415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9433376-b6eb-4a00-916d-ee9e765d13aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:10.076978 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9433376-b6eb-4a00-916d-ee9e765d13aa None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:10.078653 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acca013-f328-4600-a400-f5747906b4c5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:10.101022 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 354/678] 10.222.0.61 () {56 vars in 1135 bytes} [Thu May 26 20:55:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:10.102088 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9433376-b6eb-4a00-916d-ee9e765d13aa None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:10.114222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c46551-b261-445d-87e9-f5c20e41313a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:10.114889 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c46551-b261-445d-87e9-f5c20e41313a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:10.115171 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c46551-b261-445d-87e9-f5c20e41313a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:10.115444 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c46551-b261-445d-87e9-f5c20e41313a None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:10.116179 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c46551-b261-445d-87e9-f5c20e41313a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:10.116482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c46551-b261-445d-87e9-f5c20e41313a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:10.117896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c46551-b261-445d-87e9-f5c20e41313a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:10.130774 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 325/679] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:10.131630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c46551-b261-445d-87e9-f5c20e41313a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:10.175661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:10.184867 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:10.213689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9433376-b6eb-4a00-916d-ee9e765d13aa None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:10.242892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c46551-b261-445d-87e9-f5c20e41313a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:10.251606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be12079-17aa-4919-9fc2-af9c3d082e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:10.252574 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12079-17aa-4919-9fc2-af9c3d082e8c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:10.253061 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12079-17aa-4919-9fc2-af9c3d082e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:10.253517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12079-17aa-4919-9fc2-af9c3d082e8c None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:10.254516 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be12079-17aa-4919-9fc2-af9c3d082e8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:10.254993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be12079-17aa-4919-9fc2-af9c3d082e8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:10.256662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be12079-17aa-4919-9fc2-af9c3d082e8c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:10.274462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 355/680] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:10.274462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be12079-17aa-4919-9fc2-af9c3d082e8c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:10.284537 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d03c0-99ab-46f4-b696-5a6bb0a15fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:10.285310 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d03c0-99ab-46f4-b696-5a6bb0a15fdb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:10.285655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d03c0-99ab-46f4-b696-5a6bb0a15fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:10.286060 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d03c0-99ab-46f4-b696-5a6bb0a15fdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:10.365000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d03c0-99ab-46f4-b696-5a6bb0a15fdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:10.367051 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d03c0-99ab-46f4-b696-5a6bb0a15fdb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:10.419322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:10.479830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 326/681] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:55:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:55:10.481185 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63646fff-d98c-4e7b-ae0f-08da7ca9d29b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:10.481475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63646fff-d98c-4e7b-ae0f-08da7ca9d29b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:10.481752 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63646fff-d98c-4e7b-ae0f-08da7ca9d29b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:10.483201 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 327/682] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:10.484406 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63646fff-d98c-4e7b-ae0f-08da7ca9d29b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:10.524015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be12079-17aa-4919-9fc2-af9c3d082e8c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:10.552980 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:10.563540 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00252e-1c9e-4dcc-87ba-81c471135243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:10.564374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00252e-1c9e-4dcc-87ba-81c471135243 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:10.564659 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00252e-1c9e-4dcc-87ba-81c471135243 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:10.564911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00252e-1c9e-4dcc-87ba-81c471135243 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:10.572271 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00252e-1c9e-4dcc-87ba-81c471135243 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:10.573749 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00252e-1c9e-4dcc-87ba-81c471135243 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:10.589005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-bf00252e-1c9e-4dcc-87ba-81c471135243 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:10.589005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:10.589005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:10.589005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:10.589005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:10.589005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:10.589005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:10.589005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:10.589005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:10.589005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:10.589005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:10.589005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:10.589005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:10.589005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:10.589005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:10.589939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:10.589939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:10.589939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:10.589939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:10.589939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:10.589939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:10.589939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:10.589939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:10.589939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:10.589939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:10.589939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:10.589939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:10.589939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:10.589939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:10.589939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:10.589939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:10.589939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:10.590840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:10.590840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:10.590840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:10.590840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:10.590840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:10.590840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:10.590840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:10.590840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:10.591261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 356/683] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:10.591845 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00252e-1c9e-4dcc-87ba-81c471135243 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:10.601286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63646fff-d98c-4e7b-ae0f-08da7ca9d29b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:10.636848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc3b95-6e6e-4d9a-ad11-5dd095a00bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:10.637502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc3b95-6e6e-4d9a-ad11-5dd095a00bea None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:10.637786 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc3b95-6e6e-4d9a-ad11-5dd095a00bea None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:10.638089 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc3b95-6e6e-4d9a-ad11-5dd095a00bea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:10.638925 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc3b95-6e6e-4d9a-ad11-5dd095a00bea None admin] RBAC: Adding query filter params (role.id=6046421464dd48ea8977d7d1481bde10, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=7d7e1c8c42cd4f6dab8b27829e5fc5ed) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:10.639234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc3b95-6e6e-4d9a-ad11-5dd095a00bea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:10.640761 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc3b95-6e6e-4d9a-ad11-5dd095a00bea None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:10.646762 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 328/684] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:55:10 2022] GET /identity/v3/role_assignments?user.id=7d7e1c8c42cd4f6dab8b27829e5fc5ed&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=6046421464dd48ea8977d7d1481bde10 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:10.648092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f84953-bae8-462e-ad83-d0a601734d98 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:10.648382 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f84953-bae8-462e-ad83-d0a601734d98 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:10.648655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f84953-bae8-462e-ad83-d0a601734d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:10.669975 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-04f84953-bae8-462e-ad83-d0a601734d98 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:10.671993 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-04f84953-bae8-462e-ad83-d0a601734d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:10.675599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:10.713503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00252e-1c9e-4dcc-87ba-81c471135243 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:10.765726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d17be-926a-444a-8bdb-75af6d12bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:10.773149 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 329/685] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:55:10.773149 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f84953-bae8-462e-ad83-d0a601734d98 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:10.774374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d17be-926a-444a-8bdb-75af6d12bfda None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:10.774553 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d17be-926a-444a-8bdb-75af6d12bfda None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:10.774846 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d17be-926a-444a-8bdb-75af6d12bfda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:10.797357 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d17be-926a-444a-8bdb-75af6d12bfda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:10.800772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d17be-926a-444a-8bdb-75af6d12bfda None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:10.821273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-cd7d17be-926a-444a-8bdb-75af6d12bfda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:10.821273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:10.821273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:10.821273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:10.821273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:10.821273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:10.821273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:10.821273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:10.821273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:10.821273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:10.821273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:10.821273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:10.821273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:10.821273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:10.821273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:10.822285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:10.822285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:10.822285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:10.822285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:10.822285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:10.822285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:10.822285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:10.822285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:10.822285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:10.822285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:10.822285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:10.822285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:10.822285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:10.822285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:10.822285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:10.822285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:10.822285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:10.823156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:10.823156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:10.823156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:10.823156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:10.827472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 357/686] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:10.828510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d17be-926a-444a-8bdb-75af6d12bfda None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:10.880255 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:10.925995 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f84953-bae8-462e-ad83-d0a601734d98 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:10.962992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d17be-926a-444a-8bdb-75af6d12bfda None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:10.981356 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f972a5-1244-44bf-9874-cd4edb73de52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:10.982084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f972a5-1244-44bf-9874-cd4edb73de52 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:10.982370 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f972a5-1244-44bf-9874-cd4edb73de52 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:10.982645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f972a5-1244-44bf-9874-cd4edb73de52 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:10.983988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f972a5-1244-44bf-9874-cd4edb73de52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:10.983988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f972a5-1244-44bf-9874-cd4edb73de52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:10.985327 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f972a5-1244-44bf-9874-cd4edb73de52 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:10.995036 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:10.998562 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 330/687] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:11.000118 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f972a5-1244-44bf-9874-cd4edb73de52 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:11.014131 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9e09f-6e29-4c0a-bc2b-5ce87cc32670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:11.015509 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9e09f-6e29-4c0a-bc2b-5ce87cc32670 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:11.015864 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9e09f-6e29-4c0a-bc2b-5ce87cc32670 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:11.016089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9e09f-6e29-4c0a-bc2b-5ce87cc32670 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:11.029703 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9e09f-6e29-4c0a-bc2b-5ce87cc32670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:11.039742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-06a9e09f-6e29-4c0a-bc2b-5ce87cc32670 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:55:11.039742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:11.039742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:11.039742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:11.039742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:11.039742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:11.039742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:11.039742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:11.039742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:11.039742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:11.039742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:11.039742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:11.039742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:11.039742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:11.039742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:11.039742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:11.040831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:11.040831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:11.040831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:11.040831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:11.040831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:11.040831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:11.040831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:11.040831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:11.040831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:11.040831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:11.040831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:11.040831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:11.040831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:11.040831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:11.040831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:11.040831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:11.041680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:11.041680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:11.041680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:11.041680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:11.041680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:11.041680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:11.041680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:11.041680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:11.041680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:11.041680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:11.041680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:55:11.041680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:11.041680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 358/688] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:55:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:11.042400 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9e09f-6e29-4c0a-bc2b-5ce87cc32670 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:11.121892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f972a5-1244-44bf-9874-cd4edb73de52 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:11.157998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf7dca-a6df-4a66-a586-a0f39043693b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:11.158690 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf7dca-a6df-4a66-a586-a0f39043693b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:11.158972 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf7dca-a6df-4a66-a586-a0f39043693b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:11.159249 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf7dca-a6df-4a66-a586-a0f39043693b None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:11.159982 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf7dca-a6df-4a66-a586-a0f39043693b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:11.160291 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf7dca-a6df-4a66-a586-a0f39043693b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:11.161682 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf7dca-a6df-4a66-a586-a0f39043693b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:11.163916 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:11.167839 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9e09f-6e29-4c0a-bc2b-5ce87cc32670 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:11.175592 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 331/689] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:11.180285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf7dca-a6df-4a66-a586-a0f39043693b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:11.205140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b2a62-74f6-4a1c-be66-3674d02e35bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:11.205828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b2a62-74f6-4a1c-be66-3674d02e35bb None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:11.206256 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b2a62-74f6-4a1c-be66-3674d02e35bb None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:11.206462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b2a62-74f6-4a1c-be66-3674d02e35bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:11.207299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b2a62-74f6-4a1c-be66-3674d02e35bb None admin] RBAC: Adding query filter params (role.id=6046421464dd48ea8977d7d1481bde10, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=e3514a1833104114894abe6c41ea30a6) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:11.207615 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b2a62-74f6-4a1c-be66-3674d02e35bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:11.209073 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b2a62-74f6-4a1c-be66-3674d02e35bb None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:11.216500 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 359/690] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:55:11 2022] GET /identity/v3/role_assignments?user.id=e3514a1833104114894abe6c41ea30a6&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=6046421464dd48ea8977d7d1481bde10 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:11.217779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c12cf-c4c2-46b1-9e77-b73f143b0a6f None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:11.218490 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c12cf-c4c2-46b1-9e77-b73f143b0a6f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:11.218770 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c12cf-c4c2-46b1-9e77-b73f143b0a6f None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:11.220253 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 360/691] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:11.225326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c12cf-c4c2-46b1-9e77-b73f143b0a6f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:11.255135 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:11.311561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf7dca-a6df-4a66-a586-a0f39043693b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:11.353174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4377c0-df41-48c4-837e-79e901feea50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:11.354434 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4377c0-df41-48c4-837e-79e901feea50 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:11.354922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4377c0-df41-48c4-837e-79e901feea50 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:11.355413 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4377c0-df41-48c4-837e-79e901feea50 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:11.356669 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4377c0-df41-48c4-837e-79e901feea50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:11.357206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4377c0-df41-48c4-837e-79e901feea50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:11.357313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c12cf-c4c2-46b1-9e77-b73f143b0a6f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:11.359334 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4377c0-df41-48c4-837e-79e901feea50 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:11.369584 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 332/692] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:55:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:11.371419 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531c5a5-24df-41af-a8b6-3f3afa75f106 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:11.371941 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531c5a5-24df-41af-a8b6-3f3afa75f106 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:11.372505 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531c5a5-24df-41af-a8b6-3f3afa75f106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:11.392629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6531c5a5-24df-41af-a8b6-3f3afa75f106 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:11.395023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6531c5a5-24df-41af-a8b6-3f3afa75f106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:11.397844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67fea6-0d65-4078-b45c-83d8d4791c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:11.398677 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67fea6-0d65-4078-b45c-83d8d4791c2c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:11.398957 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67fea6-0d65-4078-b45c-83d8d4791c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:11.399225 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67fea6-0d65-4078-b45c-83d8d4791c2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:11.409054 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67fea6-0d65-4078-b45c-83d8d4791c2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:11.410582 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67fea6-0d65-4078-b45c-83d8d4791c2c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:11.429093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-5f67fea6-0d65-4078-b45c-83d8d4791c2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:11.429093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:11.429093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:11.429093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:11.429093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:11.429093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:11.429093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:11.429093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:11.429093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:11.429093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:11.429093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:11.429093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:11.429093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:11.429093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:11.429093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:11.430362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:11.430362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:11.430362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:11.430362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:11.430362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:11.430362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:11.430362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:11.430362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:11.430362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:11.430362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:11.430362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:11.430362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:11.430362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:11.430362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:11.430362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:11.430362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:11.430362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:11.431248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:11.431248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:11.431248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:11.431248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:11.431248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:11.431248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:11.431248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:11.431248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:11.433875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 361/693] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:11.435088 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67fea6-0d65-4078-b45c-83d8d4791c2c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:11.466932 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:11.486947 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 333/694] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:55:11.488302 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531c5a5-24df-41af-a8b6-3f3afa75f106 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:11.555846 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67fea6-0d65-4078-b45c-83d8d4791c2c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:11.558356 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:11.600679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2d326-3dcf-453f-99f3-b2ff18c8b3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:11.601669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d326-3dcf-453f-99f3-b2ff18c8b3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:11.601987 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d326-3dcf-453f-99f3-b2ff18c8b3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:11.602646 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d326-3dcf-453f-99f3-b2ff18c8b3d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:11.616843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2d326-3dcf-453f-99f3-b2ff18c8b3d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:11.618467 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2d326-3dcf-453f-99f3-b2ff18c8b3d4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:11.618576 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531c5a5-24df-41af-a8b6-3f3afa75f106 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:11.641272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-f5c2d326-3dcf-453f-99f3-b2ff18c8b3d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:11.641272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:11.641272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:11.641272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:11.641272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:11.641272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:11.641272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:11.641272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:11.641272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:11.641272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:11.641272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:11.641272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:11.641272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:11.641272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:11.641272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:11.642263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:11.642263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:11.642263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:11.642263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:11.642263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:11.642263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:11.642263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:11.642263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:11.642263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:11.642263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:11.642263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:11.642263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:11.642263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:11.642263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:11.642263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:11.642263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:11.642263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:11.643124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:11.643124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:11.643124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:11.643124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:11.643772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 362/695] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:11.644675 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2d326-3dcf-453f-99f3-b2ff18c8b3d4 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:11.660707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865780b-89cc-4df5-88be-ff6aea90786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:11.661644 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865780b-89cc-4df5-88be-ff6aea90786f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:11.661973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865780b-89cc-4df5-88be-ff6aea90786f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:11.662256 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865780b-89cc-4df5-88be-ff6aea90786f None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:11.663691 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865780b-89cc-4df5-88be-ff6aea90786f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:11.664128 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865780b-89cc-4df5-88be-ff6aea90786f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:11.665898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865780b-89cc-4df5-88be-ff6aea90786f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:11.682949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 334/696] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:11.683948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865780b-89cc-4df5-88be-ff6aea90786f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:11.737289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:11.778622 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2d326-3dcf-453f-99f3-b2ff18c8b3d4 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:11.818134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe333ef-660a-47ec-9190-c393b8460096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:11.819203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe333ef-660a-47ec-9190-c393b8460096 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:11.819338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe333ef-660a-47ec-9190-c393b8460096 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:11.819511 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe333ef-660a-47ec-9190-c393b8460096 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:11.820180 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe333ef-660a-47ec-9190-c393b8460096 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:11.821579 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe333ef-660a-47ec-9190-c393b8460096 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:11.830102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865780b-89cc-4df5-88be-ff6aea90786f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:11.836738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-cfe333ef-660a-47ec-9190-c393b8460096 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 20:55:11.836738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:11.836738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:11.836738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:11.836738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:11.836738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:11.836738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:11.836738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:11.836738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 20:55:11.836738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:11.836738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:11.836738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:11.836738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:11.836738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:11.836738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:11.836738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:11.837691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:11.837691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:11.837691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:11.837691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:11.837691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:11.837691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:11.837691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:11.837691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:11.837691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:11.837691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:11.837691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:11.837691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:11.837691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:11.837691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:11.837691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:11.837691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:11.838608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:11.838608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:11.838608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:11.838608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:11.838608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:11.838608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:11.838608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:11.838608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:11.838608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:11.838608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:11.838608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:11.838608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:11.838608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:11.838608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 20:55:11.838608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:11.838608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 363/697] 10.222.0.61 () {56 vars in 1129 bytes} [Thu May 26 20:55:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:11.839453 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe333ef-660a-47ec-9190-c393b8460096 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:11.848197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:11.874838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a0cf2-3476-43c7-9208-8b7645d6f0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:11.875812 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a0cf2-3476-43c7-9208-8b7645d6f0ad None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:11.876274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a0cf2-3476-43c7-9208-8b7645d6f0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:11.876741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a0cf2-3476-43c7-9208-8b7645d6f0ad None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:11.877658 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a0cf2-3476-43c7-9208-8b7645d6f0ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:11.878167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a0cf2-3476-43c7-9208-8b7645d6f0ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:11.879723 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a0cf2-3476-43c7-9208-8b7645d6f0ad None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:11.897409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 335/698] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:11.898638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a0cf2-3476-43c7-9208-8b7645d6f0ad None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:11.971282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe333ef-660a-47ec-9190-c393b8460096 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:12.008285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228040f5-4147-4959-9273-aecdf413274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:12.009739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228040f5-4147-4959-9273-aecdf413274d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:12.010255 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228040f5-4147-4959-9273-aecdf413274d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:12.010782 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228040f5-4147-4959-9273-aecdf413274d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:12.011851 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228040f5-4147-4959-9273-aecdf413274d None admin] RBAC: Adding query filter params (role.id=6046421464dd48ea8977d7d1481bde10, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=57a63879ec1242d08bba1ccad6212788) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:12.012382 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228040f5-4147-4959-9273-aecdf413274d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:12.014120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228040f5-4147-4959-9273-aecdf413274d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:12.021917 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 364/699] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:55:11 2022] GET /identity/v3/role_assignments?user.id=57a63879ec1242d08bba1ccad6212788&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=6046421464dd48ea8977d7d1481bde10 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:12.023173 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228040f5-4147-4959-9273-aecdf413274d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:12.027014 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:12.030985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a0cf2-3476-43c7-9208-8b7645d6f0ad None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:12.084958 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9672a-7c99-47f3-baba-f31e52ac5ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:12.086365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9672a-7c99-47f3-baba-f31e52ac5ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:12.086653 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9672a-7c99-47f3-baba-f31e52ac5ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:12.086934 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9672a-7c99-47f3-baba-f31e52ac5ad6 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:12.087663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9672a-7c99-47f3-baba-f31e52ac5ad6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:12.087971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9672a-7c99-47f3-baba-f31e52ac5ad6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:12.097833 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9672a-7c99-47f3-baba-f31e52ac5ad6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:12.105355 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 336/700] 10.222.0.61 () {56 vars in 1124 bytes} [Thu May 26 20:55:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:12.111155 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9672a-7c99-47f3-baba-f31e52ac5ad6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:12.189080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:12.201605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228040f5-4147-4959-9273-aecdf413274d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:12.260847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03f09e-d8c2-4684-8766-5d29c2605b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:12.261675 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03f09e-d8c2-4684-8766-5d29c2605b16 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:12.261997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03f09e-d8c2-4684-8766-5d29c2605b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:12.262276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03f09e-d8c2-4684-8766-5d29c2605b16 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:12.275086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03f09e-d8c2-4684-8766-5d29c2605b16 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:12.276624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03f09e-d8c2-4684-8766-5d29c2605b16 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:12.291850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-8c03f09e-d8c2-4684-8766-5d29c2605b16 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 20:55:12.291850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:12.291850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:12.291850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:12.291850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:12.291850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:12.291850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:12.291850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:12.291850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:12.291850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:12.291850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:12.291850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:12.291850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:12.291850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:12.291850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:12.291850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:12.292812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:12.293733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:12.293733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:12.293733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:12.293733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:12.293733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:12.293733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:12.293733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:12.293733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:12.293733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 20:55:12.293733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:12.297937 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 365/701] 10.222.0.61 () {56 vars in 1093 bytes} [Thu May 26 20:55:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:12.299167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03f09e-d8c2-4684-8766-5d29c2605b16 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:12.312340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9672a-7c99-47f3-baba-f31e52ac5ad6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:12.350799 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79aba30-90c6-4ec2-9624-5fba982c0cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:12.351981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79aba30-90c6-4ec2-9624-5fba982c0cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:12.352484 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79aba30-90c6-4ec2-9624-5fba982c0cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:12.353007 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79aba30-90c6-4ec2-9624-5fba982c0cb2 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:12.353940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79aba30-90c6-4ec2-9624-5fba982c0cb2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:12.354451 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79aba30-90c6-4ec2-9624-5fba982c0cb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:12.356160 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79aba30-90c6-4ec2-9624-5fba982c0cb2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:12.364578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:12.367078 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 337/702] 10.222.0.61 () {56 vars in 1124 bytes} [Thu May 26 20:55:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:12.418106 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03f09e-d8c2-4684-8766-5d29c2605b16 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:12.458509 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbdaca-8eda-4b83-a963-01ea6be3d734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:12.459138 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbdaca-8eda-4b83-a963-01ea6be3d734 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:12.459422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbdaca-8eda-4b83-a963-01ea6be3d734 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:12.459697 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbdaca-8eda-4b83-a963-01ea6be3d734 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:12.460918 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbdaca-8eda-4b83-a963-01ea6be3d734 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:12.461234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbdaca-8eda-4b83-a963-01ea6be3d734 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:12.462757 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbdaca-8eda-4b83-a963-01ea6be3d734 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:12.488807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 366/703] 10.222.0.61 () {56 vars in 1133 bytes} [Thu May 26 20:55:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:12.490418 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79aba30-90c6-4ec2-9624-5fba982c0cb2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:12.609561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:12.612483 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79aba30-90c6-4ec2-9624-5fba982c0cb2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:12.648409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03debfc3-39d1-40fd-bb91-e6ccf1543810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:12.649079 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03debfc3-39d1-40fd-bb91-e6ccf1543810 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:12.649358 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03debfc3-39d1-40fd-bb91-e6ccf1543810 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:12.649631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03debfc3-39d1-40fd-bb91-e6ccf1543810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:12.724286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03debfc3-39d1-40fd-bb91-e6ccf1543810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:12.725674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03debfc3-39d1-40fd-bb91-e6ccf1543810 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:12.833938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:12.841629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 338/704] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:55:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:55:12.848169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbdaca-8eda-4b83-a963-01ea6be3d734 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:12.995475 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbdaca-8eda-4b83-a963-01ea6be3d734 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:13.027353 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:13.047495 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928aea2-c6a2-4bc2-acb9-46d15cf5d684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:13.048309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928aea2-c6a2-4bc2-acb9-46d15cf5d684 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:13.048585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928aea2-c6a2-4bc2-acb9-46d15cf5d684 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:13.048855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928aea2-c6a2-4bc2-acb9-46d15cf5d684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:13.059545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928aea2-c6a2-4bc2-acb9-46d15cf5d684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:13.061019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928aea2-c6a2-4bc2-acb9-46d15cf5d684 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:13.079272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-3928aea2-c6a2-4bc2-acb9-46d15cf5d684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:13.079272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:13.079272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:13.079272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:13.079272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:13.079272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:13.079272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:13.079272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:13.079272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:13.079272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:13.079272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:13.079272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:13.079272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:13.079272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:13.079272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:13.080189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:13.080189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:13.080189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:13.080189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:13.080189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:13.080189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:13.080189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:13.080189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:13.080189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:13.080189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:13.080189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:13.080189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:13.080189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:13.080189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:13.080189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:13.080189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:13.080189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:13.081508 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:13.081508 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:13.081508 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:13.081508 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:13.081508 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 367/705] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:13.087965 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03debfc3-39d1-40fd-bb91-e6ccf1543810 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:13.093675 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9c8bc-de33-4167-8eec-0167af5054ea None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:13.094047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9c8bc-de33-4167-8eec-0167af5054ea None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:13.094263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9c8bc-de33-4167-8eec-0167af5054ea None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:13.095893 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 368/706] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:55:13.103055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39141a6c-ab6b-445e-a827-919e1297d994 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:13.103337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39141a6c-ab6b-445e-a827-919e1297d994 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:13.103609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39141a6c-ab6b-445e-a827-919e1297d994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:13.134859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-39141a6c-ab6b-445e-a827-919e1297d994 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:13.137019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-39141a6c-ab6b-445e-a827-919e1297d994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:13.243425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03debfc3-39d1-40fd-bb91-e6ccf1543810 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:13.266961 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 369/707] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:55:13.292751 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39141a6c-ab6b-445e-a827-919e1297d994 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:13.317259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391810f-ea20-4741-826c-7b2568f40d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:13.317979 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391810f-ea20-4741-826c-7b2568f40d80 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:13.318244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391810f-ea20-4741-826c-7b2568f40d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:13.318517 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391810f-ea20-4741-826c-7b2568f40d80 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:13.319248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391810f-ea20-4741-826c-7b2568f40d80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:13.319550 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391810f-ea20-4741-826c-7b2568f40d80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:13.320935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391810f-ea20-4741-826c-7b2568f40d80 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:13.345532 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 339/708] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:13.350546 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391810f-ea20-4741-826c-7b2568f40d80 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:13.404279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39141a6c-ab6b-445e-a827-919e1297d994 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:13.406543 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:13.446599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1a16d-a184-451a-bdb5-39f08f7244ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:13.449165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1a16d-a184-451a-bdb5-39f08f7244ed None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:13.450776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1a16d-a184-451a-bdb5-39f08f7244ed None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:13.451251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1a16d-a184-451a-bdb5-39f08f7244ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:13.474848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:13.479238 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1a16d-a184-451a-bdb5-39f08f7244ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:13.480956 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1a16d-a184-451a-bdb5-39f08f7244ed None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:13.524227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-a3f1a16d-a184-451a-bdb5-39f08f7244ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:13.524227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:13.524227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:13.524227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:13.524227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:13.524227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:13.524227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:13.524227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:13.524227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:13.524227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:13.524227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:13.524227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:13.524227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:13.524227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:13.524227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:13.525140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:13.525140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:13.525140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:13.525140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:13.525140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:13.525140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:13.525140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:13.525140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:13.525140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:13.525140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:13.525140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:13.525140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:13.525140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:13.525140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:13.525140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:13.525140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:13.525140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:13.526055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:13.526055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:13.526055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:13.526055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:13.529325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 370/709] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:13.538427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1a16d-a184-451a-bdb5-39f08f7244ed None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:13.567860 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391810f-ea20-4741-826c-7b2568f40d80 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:13.658786 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1a16d-a184-451a-bdb5-39f08f7244ed None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:13.670725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf881a-8845-450b-bb04-860e7f45ab57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:13.671512 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf881a-8845-450b-bb04-860e7f45ab57 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:13.671796 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf881a-8845-450b-bb04-860e7f45ab57 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:13.672076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf881a-8845-450b-bb04-860e7f45ab57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:13.686962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf881a-8845-450b-bb04-860e7f45ab57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:13.688465 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf881a-8845-450b-bb04-860e7f45ab57 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:13.699299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c58ec2-9d9c-4b9e-81fd-c230141ec1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:13.700242 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c58ec2-9d9c-4b9e-81fd-c230141ec1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:13.700738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c58ec2-9d9c-4b9e-81fd-c230141ec1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:13.701248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c58ec2-9d9c-4b9e-81fd-c230141ec1f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:13.702263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c58ec2-9d9c-4b9e-81fd-c230141ec1f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:13.702763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c58ec2-9d9c-4b9e-81fd-c230141ec1f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:13.704515 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c58ec2-9d9c-4b9e-81fd-c230141ec1f9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:13.717023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-93bf881a-8845-450b-bb04-860e7f45ab57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:13.717023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:13.717023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:13.717023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:13.717023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:13.717023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:13.717023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:13.717023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:13.717023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:13.717023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:13.717023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:13.717023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:13.717023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:13.717023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:13.717023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:13.718003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:13.718003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:13.718003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:13.718003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:13.718003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:13.718003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:13.718003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:13.718003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:13.718003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:13.718003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:13.718003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:13.718003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:13.718003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:13.718003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:13.718003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:13.718003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:13.718003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:13.719113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:13.719113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:13.719113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:13.719113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:13.719113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:13.719113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:13.719113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:13.719113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:13.721088 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 371/710] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:13.722613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 340/711] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:13.726172 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c58ec2-9d9c-4b9e-81fd-c230141ec1f9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:13.727925 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf881a-8845-450b-bb04-860e7f45ab57 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:13.762146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:13.889036 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf881a-8845-450b-bb04-860e7f45ab57 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:13.902144 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c58ec2-9d9c-4b9e-81fd-c230141ec1f9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:13.910197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:13.927339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b801ec-3ec8-43c5-9677-fb4514d30182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:13.928048 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b801ec-3ec8-43c5-9677-fb4514d30182 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:13.928337 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b801ec-3ec8-43c5-9677-fb4514d30182 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:13.928608 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b801ec-3ec8-43c5-9677-fb4514d30182 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:13.929408 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b801ec-3ec8-43c5-9677-fb4514d30182 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:13.929720 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b801ec-3ec8-43c5-9677-fb4514d30182 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:13.931223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b801ec-3ec8-43c5-9677-fb4514d30182 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:13.944678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 341/712] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:13.946137 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d452fda-9209-45e5-9d11-262ebfea408c None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:13.946406 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d452fda-9209-45e5-9d11-262ebfea408c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:13.946690 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d452fda-9209-45e5-9d11-262ebfea408c None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:13.953827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 342/713] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:13.953827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d452fda-9209-45e5-9d11-262ebfea408c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:13.955462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaba6ff-b49e-4e1a-a53b-35fb23ff7aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:13.956174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaba6ff-b49e-4e1a-a53b-35fb23ff7aad None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:13.956461 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaba6ff-b49e-4e1a-a53b-35fb23ff7aad None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:13.956740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaba6ff-b49e-4e1a-a53b-35fb23ff7aad None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:13.957481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaba6ff-b49e-4e1a-a53b-35fb23ff7aad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:13.959109 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaba6ff-b49e-4e1a-a53b-35fb23ff7aad None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:13.993001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 372/714] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:55:13 2022] POST /identity/v3/users => generated 254 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:55:13.993001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb68a0-c3a4-4042-9a21-f970b06f9d4a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:13.993001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb68a0-c3a4-4042-9a21-f970b06f9d4a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:13.993001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb68a0-c3a4-4042-9a21-f970b06f9d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:14.024830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-84bb68a0-c3a4-4042-9a21-f970b06f9d4a None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:14.026153 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-84bb68a0-c3a4-4042-9a21-f970b06f9d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:14.167226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d452fda-9209-45e5-9d11-262ebfea408c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:14.193268 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:14.206398 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 373/715] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:55:14.225732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a8004-047d-4715-a35f-f6fc35be0896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:14.226440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8004-047d-4715-a35f-f6fc35be0896 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:14.226729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8004-047d-4715-a35f-f6fc35be0896 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:14.227008 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8004-047d-4715-a35f-f6fc35be0896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:14.227859 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a8004-047d-4715-a35f-f6fc35be0896 None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=a99b767501244338bc48fb5428a589a1) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:14.228227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a8004-047d-4715-a35f-f6fc35be0896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:14.229756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a8004-047d-4715-a35f-f6fc35be0896 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:14.241903 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 343/716] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:55:13 2022] GET /identity/v3/role_assignments?user.id=a99b767501244338bc48fb5428a589a1&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=aefba81d87bf47258c17064af7d9a05f => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:14.248012 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb68a0-c3a4-4042-9a21-f970b06f9d4a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:14.387930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb68a0-c3a4-4042-9a21-f970b06f9d4a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:14.432516 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297f315-d3bf-45fa-a459-d2005ae6a71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:14.433643 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297f315-d3bf-45fa-a459-d2005ae6a71d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:14.433962 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297f315-d3bf-45fa-a459-d2005ae6a71d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:14.434248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297f315-d3bf-45fa-a459-d2005ae6a71d None admin] PATH_INFO: `/v3/services/network` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:14.434922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297f315-d3bf-45fa-a459-d2005ae6a71d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:14.438340 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297f315-d3bf-45fa-a459-d2005ae6a71d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:14.451532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-e297f315-d3bf-45fa-a459-d2005ae6a71d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 20:55:14.451532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:14.451532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:14.451532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:14.451532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:14.451532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:14.451532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:14.451532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:14.451532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 20:55:14.451532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:14.451532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:14.451532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:14.451532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:14.451532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:14.451532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:14.451532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:14.451532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:14.452863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:14.452863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:14.452863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:14.452863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:14.452863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:14.452863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:14.452863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:14.452863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:14.452863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:14.452863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:14.452863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:14.452863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:14.452863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:14.452863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:14.452863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:14.452863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:14.453819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:14.453819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:14.453819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:14.453819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:14.453819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:14.453819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:14.453819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:14.453819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:14.453819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:14.453819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:14.453819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:14.453819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:14.453819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 20:55:14.453819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:14.455258 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 374/717] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:14 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:14.460819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a8004-047d-4715-a35f-f6fc35be0896 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:14.519199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:14.587411 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a8004-047d-4715-a35f-f6fc35be0896 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:14.630550 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb06c0d-c007-47fa-a707-4cd0bfe6b630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:14.631238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb06c0d-c007-47fa-a707-4cd0bfe6b630 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:14.631564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb06c0d-c007-47fa-a707-4cd0bfe6b630 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:14.631844 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb06c0d-c007-47fa-a707-4cd0bfe6b630 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:14.632571 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb06c0d-c007-47fa-a707-4cd0bfe6b630 None admin] RBAC: Adding query filter params (name=network) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:14.632876 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb06c0d-c007-47fa-a707-4cd0bfe6b630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:14.634315 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb06c0d-c007-47fa-a707-4cd0bfe6b630 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:14.639904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 344/718] 10.222.0.61 () {56 vars in 1112 bytes} [Thu May 26 20:55:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:14.645215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297f315-d3bf-45fa-a459-d2005ae6a71d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:14.743236 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:14.820979 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297f315-d3bf-45fa-a459-d2005ae6a71d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:14.871658 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56590d5-18a4-4876-af2e-ab38db0f00e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:14.872353 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56590d5-18a4-4876-af2e-ab38db0f00e7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:14.872662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56590d5-18a4-4876-af2e-ab38db0f00e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:14.872973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56590d5-18a4-4876-af2e-ab38db0f00e7 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:14.873710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56590d5-18a4-4876-af2e-ab38db0f00e7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:14.874083 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56590d5-18a4-4876-af2e-ab38db0f00e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:14.875975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56590d5-18a4-4876-af2e-ab38db0f00e7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:14.882945 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 375/719] 10.222.0.61 () {56 vars in 1112 bytes} [Thu May 26 20:55:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:15.107898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c7c54-e7f4-4c0c-8b86-9c1d45c38110 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:15.108113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c7c54-e7f4-4c0c-8b86-9c1d45c38110 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:15.108385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c7c54-e7f4-4c0c-8b86-9c1d45c38110 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:15.110751 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 345/720] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:15.121114 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7b1e-ec6d-4cd0-bb5e-f2162333c50b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:15.121637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7b1e-ec6d-4cd0-bb5e-f2162333c50b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:15.122030 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7b1e-ec6d-4cd0-bb5e-f2162333c50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:15.146439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-c3fc7b1e-ec6d-4cd0-bb5e-f2162333c50b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:15.148167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c3fc7b1e-ec6d-4cd0-bb5e-f2162333c50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:15.241405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 376/721] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:55:15.264141 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c7c54-e7f4-4c0c-8b86-9c1d45c38110 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:15.301080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35079d23-c5b7-4161-b020-a6ed322b8621 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:15.301470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35079d23-c5b7-4161-b020-a6ed322b8621 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:15.301740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35079d23-c5b7-4161-b020-a6ed322b8621 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:15.303440 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 377/722] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:15.308651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b20c4-18cc-45f6-a17f-d45387cce359 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:15.308935 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b20c4-18cc-45f6-a17f-d45387cce359 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:15.309215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b20c4-18cc-45f6-a17f-d45387cce359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:15.326563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-239b20c4-18cc-45f6-a17f-d45387cce359 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:15.327898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-239b20c4-18cc-45f6-a17f-d45387cce359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:15.384978 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:15.400155 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 378/723] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 20:55:15.424270 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b20c4-18cc-45f6-a17f-d45387cce359 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:15.448126 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c7c54-e7f4-4c0c-8b86-9c1d45c38110 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:15.459324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:15.490193 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc5deb-81c5-4875-b79c-c3397b10ebc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:15.490872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc5deb-81c5-4875-b79c-c3397b10ebc3 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:15.491151 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc5deb-81c5-4875-b79c-c3397b10ebc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:15.491424 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc5deb-81c5-4875-b79c-c3397b10ebc3 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:15.493089 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc5deb-81c5-4875-b79c-c3397b10ebc3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:15.494488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc5deb-81c5-4875-b79c-c3397b10ebc3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:15.519401 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 346/724] 10.222.0.61 () {60 vars in 1141 bytes} [Thu May 26 20:55:15 2022] POST /identity/v3/services => generated 251 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:55:15.580105 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b20c4-18cc-45f6-a17f-d45387cce359 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:15.631380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c442f-4bbc-4714-8d76-8785020d7a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:15.632222 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c442f-4bbc-4714-8d76-8785020d7a13 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:15.632502 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c442f-4bbc-4714-8d76-8785020d7a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:15.632776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c442f-4bbc-4714-8d76-8785020d7a13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:15.647127 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c442f-4bbc-4714-8d76-8785020d7a13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:15.660775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-0c9c442f-4bbc-4714-8d76-8785020d7a13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:55:15.660775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:15.660775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:15.660775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:15.660775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:15.660775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:15.660775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:15.660775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:15.660775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:15.660775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:15.660775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:15.660775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:15.660775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:15.660775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:15.660775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:15.660775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:15.661818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:15.661818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:15.661818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:15.661818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:15.661818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:15.661818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:15.661818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:15.661818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:15.661818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:15.661818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:15.661818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:15.661818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:15.661818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:15.661818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:15.661818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:15.661818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:15.662700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:15.662700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:15.662700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:15.662700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:15.662700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:15.662700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:15.662700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:15.662700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:15.662700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:15.662700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:15.662700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:55:15.662700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:15.662700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 379/725] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:55:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:15.668377 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc5deb-81c5-4875-b79c-c3397b10ebc3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:15.791941 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc5deb-81c5-4875-b79c-c3397b10ebc3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:15.835082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef855c-ca0a-48d2-84a6-0eebe4b9eddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:15.836125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef855c-ca0a-48d2-84a6-0eebe4b9eddf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:15.836409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef855c-ca0a-48d2-84a6-0eebe4b9eddf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:15.836684 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef855c-ca0a-48d2-84a6-0eebe4b9eddf None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:15.837458 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef855c-ca0a-48d2-84a6-0eebe4b9eddf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:15.837761 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef855c-ca0a-48d2-84a6-0eebe4b9eddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:15.839208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef855c-ca0a-48d2-84a6-0eebe4b9eddf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:15.849559 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 347/726] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:55:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:15.855264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c442f-4bbc-4714-8d76-8785020d7a13 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:15.910596 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:15.966043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c442f-4bbc-4714-8d76-8785020d7a13 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:16.003172 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768509ea-e918-41a7-9a59-446d8364a9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:16.004000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768509ea-e918-41a7-9a59-446d8364a9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:16.004282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768509ea-e918-41a7-9a59-446d8364a9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:16.004557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768509ea-e918-41a7-9a59-446d8364a9a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:16.016430 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768509ea-e918-41a7-9a59-446d8364a9a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:16.017952 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768509ea-e918-41a7-9a59-446d8364a9a1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:16.036325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-768509ea-e918-41a7-9a59-446d8364a9a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:16.036325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:16.036325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:16.036325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:16.036325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:16.036325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:16.036325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:16.036325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:16.036325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:16.036325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:16.036325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:16.036325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:16.036325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:16.036325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:16.036325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:16.037282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:16.037282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:16.037282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:16.037282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:16.037282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:16.037282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:16.037282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:16.037282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:16.037282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:16.037282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:16.037282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:16.037282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:16.037282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:16.037282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:16.037282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:16.037282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:16.037282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:16.039046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:16.039046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:16.039046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:16.039046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:16.041918 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 380/727] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:16.043577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef855c-ca0a-48d2-84a6-0eebe4b9eddf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:16.086326 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:16.161687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef855c-ca0a-48d2-84a6-0eebe4b9eddf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:16.197148 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871b173-4762-4f07-969b-b44a1e0c6143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:16.197849 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871b173-4762-4f07-969b-b44a1e0c6143 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:16.198136 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871b173-4762-4f07-969b-b44a1e0c6143 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:16.198413 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871b173-4762-4f07-969b-b44a1e0c6143 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:16.199142 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871b173-4762-4f07-969b-b44a1e0c6143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:16.199448 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871b173-4762-4f07-969b-b44a1e0c6143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:16.200837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871b173-4762-4f07-969b-b44a1e0c6143 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:16.215642 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 348/728] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:16.221660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768509ea-e918-41a7-9a59-446d8364a9a1 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:16.328113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768509ea-e918-41a7-9a59-446d8364a9a1 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:16.330200 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:16.365727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9840bc-adcc-4979-82f8-d0b3661cd966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:16.366577 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9840bc-adcc-4979-82f8-d0b3661cd966 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:16.366859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9840bc-adcc-4979-82f8-d0b3661cd966 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:16.367133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9840bc-adcc-4979-82f8-d0b3661cd966 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:16.375813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9840bc-adcc-4979-82f8-d0b3661cd966 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:16.377294 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9840bc-adcc-4979-82f8-d0b3661cd966 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:16.392817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-cf9840bc-adcc-4979-82f8-d0b3661cd966 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 20:55:16.392817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:16.392817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:16.392817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:16.392817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:16.392817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:16.392817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:16.392817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:16.392817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:16.392817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:16.392817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:16.392817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:16.392817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:16.392817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:16.392817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:16.392817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:16.393761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:16.394716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:16.394716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:16.394716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:16.394716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:16.394716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:16.394716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:16.394716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:16.394716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:16.394716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 20:55:16.394716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:16.394716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 381/729] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:55:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:16.400099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871b173-4762-4f07-969b-b44a1e0c6143 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:16.502130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:16.511938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871b173-4762-4f07-969b-b44a1e0c6143 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:16.552598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0ec1b-d4c8-41b6-9a4d-fea43eb5491b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:16.553290 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0ec1b-d4c8-41b6-9a4d-fea43eb5491b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:16.553615 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0ec1b-d4c8-41b6-9a4d-fea43eb5491b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:16.553926 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0ec1b-d4c8-41b6-9a4d-fea43eb5491b None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:16.554776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0ec1b-d4c8-41b6-9a4d-fea43eb5491b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:16.555084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0ec1b-d4c8-41b6-9a4d-fea43eb5491b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:16.556542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0ec1b-d4c8-41b6-9a4d-fea43eb5491b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:16.576119 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 349/730] 10.222.0.61 () {56 vars in 1135 bytes} [Thu May 26 20:55:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:16.582616 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9840bc-adcc-4979-82f8-d0b3661cd966 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:16.696144 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9840bc-adcc-4979-82f8-d0b3661cd966 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:16.731338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20211a9e-98e9-456f-b21b-aa53f082261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:16.732010 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20211a9e-98e9-456f-b21b-aa53f082261b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:16.732297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20211a9e-98e9-456f-b21b-aa53f082261b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:16.732574 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20211a9e-98e9-456f-b21b-aa53f082261b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:16.760206 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:16.805294 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20211a9e-98e9-456f-b21b-aa53f082261b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:16.806817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20211a9e-98e9-456f-b21b-aa53f082261b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:16.922946 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 382/731] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:55:16 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 20:55:16.928576 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0ec1b-d4c8-41b6-9a4d-fea43eb5491b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:17.051262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0ec1b-d4c8-41b6-9a4d-fea43eb5491b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:17.087114 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bd87e-fc7c-4498-8b98-3385f3726d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:17.087931 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bd87e-fc7c-4498-8b98-3385f3726d77 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:17.088217 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bd87e-fc7c-4498-8b98-3385f3726d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:17.088496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bd87e-fc7c-4498-8b98-3385f3726d77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:17.099176 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bd87e-fc7c-4498-8b98-3385f3726d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:17.100651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bd87e-fc7c-4498-8b98-3385f3726d77 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:17.122549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-5d9bd87e-fc7c-4498-8b98-3385f3726d77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:17.122549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:17.122549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:17.122549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:17.122549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:17.122549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:17.122549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:17.122549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:17.122549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:17.122549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:17.122549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:17.122549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:17.122549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:17.122549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:17.122549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:17.123482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:17.123482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:17.123482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:17.123482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:17.123482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:17.123482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:17.123482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:17.123482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:17.123482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:17.123482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:17.123482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:17.123482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:17.123482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:17.123482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:17.123482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:17.123482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:17.123482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:17.124433 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:17.124433 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:17.124433 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:17.124433 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:17.124433 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 350/732] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:17.125292 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:17.129784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20211a9e-98e9-456f-b21b-aa53f082261b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:17.181735 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0353db7-1cc0-4738-9be0-1dc207005e0a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:17.182075 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0353db7-1cc0-4738-9be0-1dc207005e0a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:17.182337 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0353db7-1cc0-4738-9be0-1dc207005e0a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:17.184070 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 351/733] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:17.204556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59ddfe-d5d9-41c4-adaf-4b402a4d6cb3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:17.204890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59ddfe-d5d9-41c4-adaf-4b402a4d6cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:17.205122 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59ddfe-d5d9-41c4-adaf-4b402a4d6cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:17.214163 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:17.238865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1e59ddfe-d5d9-41c4-adaf-4b402a4d6cb3 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:17.240154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1e59ddfe-d5d9-41c4-adaf-4b402a4d6cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:17.273006 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20211a9e-98e9-456f-b21b-aa53f082261b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:17.309440 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00677c-3af0-4c4e-b21b-6a674a135c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:17.310069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00677c-3af0-4c4e-b21b-6a674a135c36 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:17.310357 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00677c-3af0-4c4e-b21b-6a674a135c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:17.310635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00677c-3af0-4c4e-b21b-6a674a135c36 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:17.311415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00677c-3af0-4c4e-b21b-6a674a135c36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:17.311829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00677c-3af0-4c4e-b21b-6a674a135c36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:17.313233 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00677c-3af0-4c4e-b21b-6a674a135c36 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:17.319762 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 352/734] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:55:17.321149 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3b226-db9a-4e6d-8cb2-87c5aecbf377 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:17.321442 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3b226-db9a-4e6d-8cb2-87c5aecbf377 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:17.321726 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3b226-db9a-4e6d-8cb2-87c5aecbf377 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:17.323281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 353/735] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:17.329707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 383/736] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:17.334808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3b226-db9a-4e6d-8cb2-87c5aecbf377 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:17.349831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00677c-3af0-4c4e-b21b-6a674a135c36 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:17.456931 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00677c-3af0-4c4e-b21b-6a674a135c36 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:17.457770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3b226-db9a-4e6d-8cb2-87c5aecbf377 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:17.475063 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:17.492455 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:17.495239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdae58-9356-442a-8ad9-46dcbe929164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:17.496024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdae58-9356-442a-8ad9-46dcbe929164 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:17.496312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdae58-9356-442a-8ad9-46dcbe929164 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:17.496590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdae58-9356-442a-8ad9-46dcbe929164 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:17.500323 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af82b1-817b-4c0a-a43a-62d773fa59c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:17.501388 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af82b1-817b-4c0a-a43a-62d773fa59c0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:17.501880 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af82b1-817b-4c0a-a43a-62d773fa59c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:17.502631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af82b1-817b-4c0a-a43a-62d773fa59c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:17.508917 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdae58-9356-442a-8ad9-46dcbe929164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:17.511216 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af82b1-817b-4c0a-a43a-62d773fa59c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:17.512834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af82b1-817b-4c0a-a43a-62d773fa59c0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:17.517514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-c7fdae58-9356-442a-8ad9-46dcbe929164 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:55:17.517514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:17.517514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:17.517514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:17.517514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:17.517514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:17.517514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:17.517514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:17.517514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:17.517514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:17.517514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:17.517514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:17.517514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:17.517514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:17.517514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:17.517514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:17.518825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:17.518825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:17.518825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:17.518825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:17.518825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:17.518825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:17.518825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:17.518825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:17.518825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:17.518825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:17.518825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:17.518825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:17.518825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:17.518825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:17.518825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:17.518825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:17.519865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:17.519865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:17.519865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:17.519865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:17.519865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:17.519865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:17.519865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:17.519865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:17.519865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:17.519865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:17.519865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:55:17.519865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:17.524076 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 384/737] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:55:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:17.525648 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f943e4-15c7-4e3a-ba0a-6d39086f02b7 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:17.525985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f943e4-15c7-4e3a-ba0a-6d39086f02b7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:17.526267 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f943e4-15c7-4e3a-ba0a-6d39086f02b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:17.533243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f1af82b1-817b-4c0a-a43a-62d773fa59c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:17.533243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:17.533243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:17.533243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:17.533243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:17.533243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:17.533243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:17.533243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:17.533243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:17.533243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:17.533243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:17.533243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:17.533243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:17.533243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:17.533243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:17.534439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:17.534439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:17.534439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:17.534439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:17.534439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:17.534439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:17.534439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:17.534439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:17.534439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:17.534439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:17.534439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:17.534439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:17.534439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:17.534439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:17.534439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:17.534439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:17.534439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:17.535437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:17.535437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:17.535437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:17.535437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:17.535437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:17.535437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:17.535437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:17.535437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:17.542648 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 354/738] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:17.544007 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af82b1-817b-4c0a-a43a-62d773fa59c0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:17.546759 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-47f943e4-15c7-4e3a-ba0a-6d39086f02b7 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:17.548162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-47f943e4-15c7-4e3a-ba0a-6d39086f02b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:17.629896 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 385/739] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:55:17.629896 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f943e4-15c7-4e3a-ba0a-6d39086f02b7 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:17.683339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af82b1-817b-4c0a-a43a-62d773fa59c0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:17.721296 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318621-0fdc-45dd-b764-f5af3d07bafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:17.722266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318621-0fdc-45dd-b764-f5af3d07bafb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:17.722749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318621-0fdc-45dd-b764-f5af3d07bafb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:17.723252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318621-0fdc-45dd-b764-f5af3d07bafb None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:17.724338 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93318621-0fdc-45dd-b764-f5af3d07bafb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:17.724805 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93318621-0fdc-45dd-b764-f5af3d07bafb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:17.726247 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93318621-0fdc-45dd-b764-f5af3d07bafb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:17.727086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f943e4-15c7-4e3a-ba0a-6d39086f02b7 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:17.735093 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 355/740] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:55:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:17.735629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:17.735758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318621-0fdc-45dd-b764-f5af3d07bafb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:17.769886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d20828-7e1e-4f19-82eb-82e9f206c38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:17.770931 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d20828-7e1e-4f19-82eb-82e9f206c38f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:17.771437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d20828-7e1e-4f19-82eb-82e9f206c38f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:17.772013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d20828-7e1e-4f19-82eb-82e9f206c38f None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:17.773159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d20828-7e1e-4f19-82eb-82e9f206c38f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:17.773629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d20828-7e1e-4f19-82eb-82e9f206c38f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:17.775134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d20828-7e1e-4f19-82eb-82e9f206c38f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:17.793238 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 386/741] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:17.793238 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fbb82-dd71-4c49-ad60-f209ee76f031 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:17.793238 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fbb82-dd71-4c49-ad60-f209ee76f031 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:17.793238 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fbb82-dd71-4c49-ad60-f209ee76f031 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:17.793238 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 387/742] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:17.793238 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fbb82-dd71-4c49-ad60-f209ee76f031 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:17.802884 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:17.854868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318621-0fdc-45dd-b764-f5af3d07bafb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:17.891803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da1dd8-84ca-4053-82f7-59437266069d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:17.892545 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da1dd8-84ca-4053-82f7-59437266069d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:17.892829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da1dd8-84ca-4053-82f7-59437266069d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:17.893099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da1dd8-84ca-4053-82f7-59437266069d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:17.901619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fbb82-dd71-4c49-ad60-f209ee76f031 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:17.908899 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da1dd8-84ca-4053-82f7-59437266069d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:17.916657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-98da1dd8-84ca-4053-82f7-59437266069d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:17.916657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:17.916657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:17.916657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:17.916657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:17.916657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:17.916657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:17.916657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:17.916657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:17.916657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:17.916657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:17.916657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:17.916657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:17.916657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:17.916657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:17.916657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:17.917557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:17.917557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:17.917557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:17.917557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:17.917557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:17.917557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:17.917557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:17.917557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:17.917557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:17.917557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:17.917557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:17.917557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:17.917557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:17.917557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:17.917557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:17.917557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:17.918422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:17.918422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:17.918422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:17.918422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:17.918422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:17.918422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:17.918422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:17.918422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:17.918422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:17.918422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:17.918422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:17.918422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:17.918422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 356/743] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:55:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:17.919104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da1dd8-84ca-4053-82f7-59437266069d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:17.943760 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba599a0-3661-4558-a230-7517103f3c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:17.944584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba599a0-3661-4558-a230-7517103f3c32 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:17.944870 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba599a0-3661-4558-a230-7517103f3c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:17.945146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba599a0-3661-4558-a230-7517103f3c32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:17.957326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba599a0-3661-4558-a230-7517103f3c32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:17.958867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba599a0-3661-4558-a230-7517103f3c32 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:17.977247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-9ba599a0-3661-4558-a230-7517103f3c32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:17.977247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:17.977247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:17.977247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:17.977247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:17.977247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:17.977247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:17.977247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:17.977247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:17.977247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:17.977247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:17.977247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:17.977247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:17.977247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:17.977247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:17.978280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:17.978280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:17.978280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:17.978280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:17.978280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:17.978280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:17.978280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:17.978280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:17.978280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:17.978280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:17.978280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:17.978280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:17.978280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:17.978280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:17.978280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:17.978280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:17.978280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:17.979778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:17.979778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:17.979778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:17.979778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:17.979778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 388/744] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:17.980075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839164f2-79ed-4665-9105-1804999f1c81 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:17.980343 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839164f2-79ed-4665-9105-1804999f1c81 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:17.980623 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839164f2-79ed-4665-9105-1804999f1c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:17.999842 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-839164f2-79ed-4665-9105-1804999f1c81 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:18.001360 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-839164f2-79ed-4665-9105-1804999f1c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:18.016421 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:18.034976 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da1dd8-84ca-4053-82f7-59437266069d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:18.048864 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:18.071514 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c124ee-0501-47a3-bb4c-296d61f40a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:18.072182 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c124ee-0501-47a3-bb4c-296d61f40a9a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:18.072466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c124ee-0501-47a3-bb4c-296d61f40a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:18.072743 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c124ee-0501-47a3-bb4c-296d61f40a9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:18.073585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c124ee-0501-47a3-bb4c-296d61f40a9a None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=57a63879ec1242d08bba1ccad6212788) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:18.073937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c124ee-0501-47a3-bb4c-296d61f40a9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:18.075394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c124ee-0501-47a3-bb4c-296d61f40a9a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:18.079659 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 389/745] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 20:55:18.080891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839164f2-79ed-4665-9105-1804999f1c81 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:18.081392 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 357/746] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:55:17 2022] GET /identity/v3/role_assignments?user.id=57a63879ec1242d08bba1ccad6212788&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=aefba81d87bf47258c17064af7d9a05f => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:18.082244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c124ee-0501-47a3-bb4c-296d61f40a9a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:18.208294 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c124ee-0501-47a3-bb4c-296d61f40a9a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:18.212212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839164f2-79ed-4665-9105-1804999f1c81 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:18.252532 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cd686-fe38-42b2-b22b-3969f9f531df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:18.253411 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cd686-fe38-42b2-b22b-3969f9f531df None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:18.253611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cd686-fe38-42b2-b22b-3969f9f531df None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:18.253880 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cd686-fe38-42b2-b22b-3969f9f531df None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:18.254640 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cd686-fe38-42b2-b22b-3969f9f531df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:18.255030 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cd686-fe38-42b2-b22b-3969f9f531df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:18.256492 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cd686-fe38-42b2-b22b-3969f9f531df None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:18.263596 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efcdbd-8334-4f46-960d-144ac0376c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:18.266135 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efcdbd-8334-4f46-960d-144ac0376c0d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:18.266729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efcdbd-8334-4f46-960d-144ac0376c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:18.267252 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efcdbd-8334-4f46-960d-144ac0376c0d None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:18.268947 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efcdbd-8334-4f46-960d-144ac0376c0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:18.269728 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efcdbd-8334-4f46-960d-144ac0376c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:18.271605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efcdbd-8334-4f46-960d-144ac0376c0d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:18.272184 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 358/747] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:18.273152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cd686-fe38-42b2-b22b-3969f9f531df None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:18.285424 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 390/748] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:55:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:18.287056 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efcdbd-8334-4f46-960d-144ac0376c0d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:18.305392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:18.327387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:18.416466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efcdbd-8334-4f46-960d-144ac0376c0d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:18.422764 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cd686-fe38-42b2-b22b-3969f9f531df None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:18.457781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff0983-e606-419e-8806-6b712a18293d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:18.459071 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff0983-e606-419e-8806-6b712a18293d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:18.459370 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff0983-e606-419e-8806-6b712a18293d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:18.459717 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff0983-e606-419e-8806-6b712a18293d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:18.469230 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1838e38-ec68-4f1c-9df4-37b33b2a4af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:18.470259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1838e38-ec68-4f1c-9df4-37b33b2a4af9 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:18.470765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1838e38-ec68-4f1c-9df4-37b33b2a4af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:18.471152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1838e38-ec68-4f1c-9df4-37b33b2a4af9 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:18.471784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff0983-e606-419e-8806-6b712a18293d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:18.472250 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1838e38-ec68-4f1c-9df4-37b33b2a4af9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:18.473637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff0983-e606-419e-8806-6b712a18293d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:18.473744 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1838e38-ec68-4f1c-9df4-37b33b2a4af9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:18.489776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-5eff0983-e606-419e-8806-6b712a18293d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 20:55:18.489776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:18.489776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:18.489776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:18.489776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:18.489776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:18.489776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:18.489776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:18.489776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:18.489776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:18.489776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:18.489776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:18.489776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:18.489776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:18.489776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:18.489776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:18.490807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:18.491828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:18.491828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:18.491828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:18.491828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:18.491828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:18.491828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:18.491828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:18.491828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:18.491828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 20:55:18.491828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:18.492359 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 359/749] 10.222.0.61 () {60 vars in 1141 bytes} [Thu May 26 20:55:18 2022] POST /identity/v3/services => generated 240 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:55:18.492359 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1838e38-ec68-4f1c-9df4-37b33b2a4af9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:18.497854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 391/750] 10.222.0.61 () {56 vars in 1093 bytes} [Thu May 26 20:55:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:18.497854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2ab91-6cf2-4523-83ac-8d608f1ed5d3 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:18.497854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2ab91-6cf2-4523-83ac-8d608f1ed5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:18.497854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2ab91-6cf2-4523-83ac-8d608f1ed5d3 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:18.503593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 392/751] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:18.503593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2ab91-6cf2-4523-83ac-8d608f1ed5d3 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:18.613036 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:18.615862 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:18.641041 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1838e38-ec68-4f1c-9df4-37b33b2a4af9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:18.657194 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2ab91-6cf2-4523-83ac-8d608f1ed5d3 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:18.687390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663ab85-0119-425e-9c8a-36ef7025231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:18.688543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663ab85-0119-425e-9c8a-36ef7025231e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:18.688821 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663ab85-0119-425e-9c8a-36ef7025231e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:18.689092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663ab85-0119-425e-9c8a-36ef7025231e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:18.705299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663ab85-0119-425e-9c8a-36ef7025231e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:18.705617 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff00dd-6606-46a4-b865-aa06b3fb7e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:18.706305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff00dd-6606-46a4-b865-aa06b3fb7e16 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:18.706592 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff00dd-6606-46a4-b865-aa06b3fb7e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:18.706870 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff00dd-6606-46a4-b865-aa06b3fb7e16 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:18.707732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663ab85-0119-425e-9c8a-36ef7025231e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:18.707843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff00dd-6606-46a4-b865-aa06b3fb7e16 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:18.708080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff00dd-6606-46a4-b865-aa06b3fb7e16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:18.709585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff00dd-6606-46a4-b865-aa06b3fb7e16 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:18.733130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-5663ab85-0119-425e-9c8a-36ef7025231e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:18.733130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:18.733130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:18.733130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:18.733130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:18.733130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:18.733130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:18.733130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:18.733130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:18.733130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:18.733130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:18.733130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:18.733130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:18.733130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:18.733130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:18.734175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:18.734175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:18.734175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:18.734175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:18.734175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:18.734175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:18.734175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:18.734175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:18.734175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:18.734175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:18.734175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:18.734175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:18.734175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:18.734175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:18.734175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:18.734175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:18.734175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:18.735198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:18.735198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:18.735198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:18.735198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:18.735198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 360/752] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:18.736578 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d4812-1b0a-4129-9b60-9b0695c95323 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:18.737112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d4812-1b0a-4129-9b60-9b0695c95323 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:18.737271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d4812-1b0a-4129-9b60-9b0695c95323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:18.741370 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 393/753] 10.222.0.61 () {56 vars in 1133 bytes} [Thu May 26 20:55:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:18.742259 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff00dd-6606-46a4-b865-aa06b3fb7e16 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:18.754726 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a09d4812-1b0a-4129-9b60-9b0695c95323 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:18.755670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a09d4812-1b0a-4129-9b60-9b0695c95323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:18.829147 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 361/754] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:18.834151 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d4812-1b0a-4129-9b60-9b0695c95323 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:18.877743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff00dd-6606-46a4-b865-aa06b3fb7e16 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:18.914996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:18.926543 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdde5b9-3a70-4c6d-b4cd-78c7457cf413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:18.927641 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdde5b9-3a70-4c6d-b4cd-78c7457cf413 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:18.928899 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdde5b9-3a70-4c6d-b4cd-78c7457cf413 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:18.929354 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdde5b9-3a70-4c6d-b4cd-78c7457cf413 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:18.930302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdde5b9-3a70-4c6d-b4cd-78c7457cf413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:18.930780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdde5b9-3a70-4c6d-b4cd-78c7457cf413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:18.932347 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdde5b9-3a70-4c6d-b4cd-78c7457cf413 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:18.933274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:18.947944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 394/755] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:18.949220 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdde5b9-3a70-4c6d-b4cd-78c7457cf413 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:18.968004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d4812-1b0a-4129-9b60-9b0695c95323 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:19.011547 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17ade6-db87-4e37-a852-67b311b90b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:19.012667 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17ade6-db87-4e37-a852-67b311b90b86 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:19.013092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17ade6-db87-4e37-a852-67b311b90b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:19.013833 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17ade6-db87-4e37-a852-67b311b90b86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:19.033037 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17ade6-db87-4e37-a852-67b311b90b86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:19.035167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17ade6-db87-4e37-a852-67b311b90b86 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:19.053363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3f17ade6-db87-4e37-a852-67b311b90b86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:19.053363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:19.053363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:19.053363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:19.053363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:19.053363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:19.053363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:19.053363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:19.053363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:19.053363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:19.053363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:19.053363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:19.053363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:19.053363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:19.053363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:19.054357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:19.054357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:19.054357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:19.054357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:19.054357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:19.054357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:19.054357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:19.054357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:19.054357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:19.054357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:19.054357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:19.054357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:19.054357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:19.054357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:19.054357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:19.054357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:19.054357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:19.055251 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:19.055251 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:19.055251 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:19.055251 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:19.060734 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 362/756] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:19.065986 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17ade6-db87-4e37-a852-67b311b90b86 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:19.066733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdde5b9-3a70-4c6d-b4cd-78c7457cf413 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:19.103127 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d8f82-031c-4118-aa44-a3d08f12f105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:19.103958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8f82-031c-4118-aa44-a3d08f12f105 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:19.104237 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8f82-031c-4118-aa44-a3d08f12f105 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:19.104613 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8f82-031c-4118-aa44-a3d08f12f105 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:19.105321 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d8f82-031c-4118-aa44-a3d08f12f105 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:19.106843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d8f82-031c-4118-aa44-a3d08f12f105 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:19.119797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-db9d8f82-031c-4118-aa44-a3d08f12f105 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 20:55:19.119797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:19.119797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:19.119797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:19.119797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:19.119797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:19.119797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:19.119797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:19.119797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 20:55:19.119797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:19.119797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:19.119797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:19.119797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:19.119797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:19.119797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:19.119797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:19.120752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:19.120752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:19.120752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:19.120752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:19.120752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:19.120752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:19.120752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:19.120752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:19.120752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:19.120752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:19.120752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:19.120752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:19.120752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:19.120752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:19.120752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:19.120752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:19.121741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:19.121741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:19.121741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:19.121741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:19.121741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:19.121741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:19.121741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:19.121741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:19.121741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:19.121741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:19.121741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:19.121741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:19.121741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:19.121741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 20:55:19.121741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:19.126206 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 395/757] 10.222.0.61 () {56 vars in 1129 bytes} [Thu May 26 20:55:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:19.127105 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d8f82-031c-4118-aa44-a3d08f12f105 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:19.172432 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17ade6-db87-4e37-a852-67b311b90b86 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:19.183153 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:19.202174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:19.211853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0cfad-1922-49d6-8385-904e49356e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:19.213076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0cfad-1922-49d6-8385-904e49356e9c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:19.213498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0cfad-1922-49d6-8385-904e49356e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:19.213965 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0cfad-1922-49d6-8385-904e49356e9c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:19.222612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0cfad-1922-49d6-8385-904e49356e9c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:19.224271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0cfad-1922-49d6-8385-904e49356e9c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:19.237195 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d8f82-031c-4118-aa44-a3d08f12f105 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:19.241194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0dd0cfad-1922-49d6-8385-904e49356e9c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 20:55:19.241194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:19.241194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:19.241194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:19.241194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:19.241194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:19.241194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:19.241194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:19.241194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:19.241194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:19.241194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:19.241194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:19.241194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:19.241194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:19.241194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:19.241194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:19.242308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:19.243293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:19.243293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:19.243293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:19.243293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:19.243293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:19.243293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:19.243293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:19.243293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:19.243293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 20:55:19.243293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:19.245625 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 363/758] 10.222.0.61 () {56 vars in 1117 bytes} [Thu May 26 20:55:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:19.246754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0cfad-1922-49d6-8385-904e49356e9c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:19.272702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274577d-6db1-42fe-96c2-ca9c84b13718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:19.273386 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274577d-6db1-42fe-96c2-ca9c84b13718 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:19.273686 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274577d-6db1-42fe-96c2-ca9c84b13718 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:19.274066 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274577d-6db1-42fe-96c2-ca9c84b13718 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:19.275086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274577d-6db1-42fe-96c2-ca9c84b13718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:19.275201 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274577d-6db1-42fe-96c2-ca9c84b13718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:19.276580 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274577d-6db1-42fe-96c2-ca9c84b13718 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:19.290520 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 396/759] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:19.291396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274577d-6db1-42fe-96c2-ca9c84b13718 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:19.365465 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0cfad-1922-49d6-8385-904e49356e9c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:19.407775 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c6d75-9cdc-4ec5-bf5f-a7893bedde5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:19.408815 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c6d75-9cdc-4ec5-bf5f-a7893bedde5a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:19.409097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c6d75-9cdc-4ec5-bf5f-a7893bedde5a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:19.409371 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c6d75-9cdc-4ec5-bf5f-a7893bedde5a None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:19.410133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c6d75-9cdc-4ec5-bf5f-a7893bedde5a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:19.410438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c6d75-9cdc-4ec5-bf5f-a7893bedde5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:19.412061 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c6d75-9cdc-4ec5-bf5f-a7893bedde5a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:19.422950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 364/760] 10.222.0.61 () {56 vars in 1124 bytes} [Thu May 26 20:55:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:19.424005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c6d75-9cdc-4ec5-bf5f-a7893bedde5a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:19.427705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274577d-6db1-42fe-96c2-ca9c84b13718 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:19.462631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:19.487545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfcd9e-2470-4005-8c72-bb3f6977fc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:19.488112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfcd9e-2470-4005-8c72-bb3f6977fc38 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:19.488397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfcd9e-2470-4005-8c72-bb3f6977fc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:19.488663 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfcd9e-2470-4005-8c72-bb3f6977fc38 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:19.489510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfcd9e-2470-4005-8c72-bb3f6977fc38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:19.491533 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfcd9e-2470-4005-8c72-bb3f6977fc38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:19.491661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfcd9e-2470-4005-8c72-bb3f6977fc38 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:19.521708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 397/761] 10.222.0.61 () {56 vars in 1149 bytes} [Thu May 26 20:55:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:19.522644 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfcd9e-2470-4005-8c72-bb3f6977fc38 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:19.550331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:19.641002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c6d75-9cdc-4ec5-bf5f-a7893bedde5a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:19.699224 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfcd9e-2470-4005-8c72-bb3f6977fc38 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:19.704411 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc91996-c2fd-4242-aa3a-85e520f79321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:19.705343 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc91996-c2fd-4242-aa3a-85e520f79321 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:19.705626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc91996-c2fd-4242-aa3a-85e520f79321 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:19.705919 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc91996-c2fd-4242-aa3a-85e520f79321 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:19.728116 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc91996-c2fd-4242-aa3a-85e520f79321 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:19.729629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc91996-c2fd-4242-aa3a-85e520f79321 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:19.767962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-1dc91996-c2fd-4242-aa3a-85e520f79321 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:19.767962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:19.767962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:19.767962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:19.767962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:19.767962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:19.767962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:19.767962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:19.767962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:19.767962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:19.767962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:19.767962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:19.767962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:19.767962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:19.767962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:19.768840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:19.768840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:19.768840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:19.768840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:19.768840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:19.768840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:19.768840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:19.768840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:19.768840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:19.768840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:19.768840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:19.768840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:19.768840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:19.768840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:19.768840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:19.768840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:19.768840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:19.769701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:19.769701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:19.769701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:19.769701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:19.769701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:19.769701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:19.769701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:19.769701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:19.771737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 365/762] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:19.774823 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc91996-c2fd-4242-aa3a-85e520f79321 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:19.786223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b72c6-7f4a-4c8e-b507-89dd9dce0846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:19.786223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b72c6-7f4a-4c8e-b507-89dd9dce0846 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:19.786223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b72c6-7f4a-4c8e-b507-89dd9dce0846 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:19.786223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b72c6-7f4a-4c8e-b507-89dd9dce0846 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:19.787553 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b72c6-7f4a-4c8e-b507-89dd9dce0846 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:19.787553 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b72c6-7f4a-4c8e-b507-89dd9dce0846 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:19.788564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b72c6-7f4a-4c8e-b507-89dd9dce0846 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:19.799026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 398/763] 10.222.0.61 () {56 vars in 1124 bytes} [Thu May 26 20:55:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:19.799745 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b72c6-7f4a-4c8e-b507-89dd9dce0846 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:19.834719 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:19.907764 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc91996-c2fd-4242-aa3a-85e520f79321 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:19.916649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b72c6-7f4a-4c8e-b507-89dd9dce0846 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:19.919365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:19.945540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a323b-93ac-44af-b521-62f2adcf6dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:19.946656 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a323b-93ac-44af-b521-62f2adcf6dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:19.947130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a323b-93ac-44af-b521-62f2adcf6dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:19.947643 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a323b-93ac-44af-b521-62f2adcf6dc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:19.953935 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491b571-6d84-4dde-b304-c5ff83bac41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:19.954622 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491b571-6d84-4dde-b304-c5ff83bac41c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:19.954899 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491b571-6d84-4dde-b304-c5ff83bac41c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:19.955169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491b571-6d84-4dde-b304-c5ff83bac41c None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:19.955968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491b571-6d84-4dde-b304-c5ff83bac41c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:19.956274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491b571-6d84-4dde-b304-c5ff83bac41c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:19.957727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491b571-6d84-4dde-b304-c5ff83bac41c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:19.970766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 399/764] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:19.971761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491b571-6d84-4dde-b304-c5ff83bac41c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:20.022970 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a323b-93ac-44af-b521-62f2adcf6dc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:20.024760 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a323b-93ac-44af-b521-62f2adcf6dc6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:20.067881 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:20.074623 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491b571-6d84-4dde-b304-c5ff83bac41c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:20.110639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55e79d-57d7-49f6-a9f2-74a232a84898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:20.111549 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55e79d-57d7-49f6-a9f2-74a232a84898 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:20.111872 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55e79d-57d7-49f6-a9f2-74a232a84898 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:20.112102 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55e79d-57d7-49f6-a9f2-74a232a84898 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:20.112912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55e79d-57d7-49f6-a9f2-74a232a84898 None admin] RBAC: Adding query filter params (interface=public, service_id=7cf304425ab14e0c92784f548b09c270, region_id=RegionOne) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:20.113220 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55e79d-57d7-49f6-a9f2-74a232a84898 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:20.114657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55e79d-57d7-49f6-a9f2-74a232a84898 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:20.127899 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 400/765] 10.222.0.61 () {56 vars in 1251 bytes} [Thu May 26 20:55:19 2022] GET /identity/v3/endpoints?service_id=7cf304425ab14e0c92784f548b09c270&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:20.128768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55e79d-57d7-49f6-a9f2-74a232a84898 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:20.136037 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 366/766] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:55:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:55:20.137276 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a323b-93ac-44af-b521-62f2adcf6dc6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:20.149357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:20.232570 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55e79d-57d7-49f6-a9f2-74a232a84898 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:20.241985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a323b-93ac-44af-b521-62f2adcf6dc6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:20.268529 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a9b1e-2a90-4ea9-bfe7-8c7dec4361cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:20.269466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a9b1e-2a90-4ea9-bfe7-8c7dec4361cf None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:20.269748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a9b1e-2a90-4ea9-bfe7-8c7dec4361cf None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:20.270049 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a9b1e-2a90-4ea9-bfe7-8c7dec4361cf None admin] PATH_INFO: `/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/a99b767501244338bc48fb5428a589a1/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:20.272181 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a9b1e-2a90-4ea9-bfe7-8c7dec4361cf None admin] RBAC: Authorizing `identity:create_grant(project_id=2c23678abd4f4dacaf35d73c5184e72e, user_id=a99b767501244338bc48fb5428a589a1, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:20.273822 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a9b1e-2a90-4ea9-bfe7-8c7dec4361cf None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:20.284689 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bc3d4-8d12-4ab0-aeeb-ac5d67ed3a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:20.285904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bc3d4-8d12-4ab0-aeeb-ac5d67ed3a64 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:20.286489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bc3d4-8d12-4ab0-aeeb-ac5d67ed3a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:20.286959 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bc3d4-8d12-4ab0-aeeb-ac5d67ed3a64 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:20.287941 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bc3d4-8d12-4ab0-aeeb-ac5d67ed3a64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:20.289666 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bc3d4-8d12-4ab0-aeeb-ac5d67ed3a64 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:20.291307 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 401/767] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:55:20 2022] PUT /identity/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/a99b767501244338bc48fb5428a589a1/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:55:20.292678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a9b1e-2a90-4ea9-bfe7-8c7dec4361cf None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:20.298402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 367/768] 10.222.0.61 () {56 vars in 1087 bytes} [Thu May 26 20:55:20 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:20.328400 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:20.484110 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a9b1e-2a90-4ea9-bfe7-8c7dec4361cf None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:20.523411 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f77f0-71bf-419a-a04b-f4f77344b789 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:20.524444 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f77f0-71bf-419a-a04b-f4f77344b789 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:20.525490 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f77f0-71bf-419a-a04b-f4f77344b789 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:20.528756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 368/769] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:20.534906 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b1f6c-4aa2-49ed-82bd-7835434e0d12 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:20.534906 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b1f6c-4aa2-49ed-82bd-7835434e0d12 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:20.534906 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b1f6c-4aa2-49ed-82bd-7835434e0d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:20.540934 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135061e-ec11-403e-b84b-f66d188e4a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:20.541900 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135061e-ec11-403e-b84b-f66d188e4a0c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:20.542190 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135061e-ec11-403e-b84b-f66d188e4a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:20.542472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135061e-ec11-403e-b84b-f66d188e4a0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:20.555478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135061e-ec11-403e-b84b-f66d188e4a0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:20.557006 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135061e-ec11-403e-b84b-f66d188e4a0c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:20.560634 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ab6b1f6c-4aa2-49ed-82bd-7835434e0d12 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:20.562080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ab6b1f6c-4aa2-49ed-82bd-7835434e0d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:20.576836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-3135061e-ec11-403e-b84b-f66d188e4a0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:20.576836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:20.576836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:20.576836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:20.576836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:20.576836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:20.576836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:20.576836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:20.576836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:20.576836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:20.576836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:20.576836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:20.576836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:20.576836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:20.576836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:20.577911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:20.577911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:20.577911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:20.577911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:20.577911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:20.577911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:20.577911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:20.577911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:20.577911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:20.577911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:20.577911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:20.577911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:20.577911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:20.577911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:20.577911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:20.577911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:20.577911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:20.578996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:20.578996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:20.578996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:20.578996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:20.578996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 402/770] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:20.584033 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135061e-ec11-403e-b84b-f66d188e4a0c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:20.642239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 369/771] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:20.664460 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:20.665090 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b1f6c-4aa2-49ed-82bd-7835434e0d12 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:20.668508 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:20.709275 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135061e-ec11-403e-b84b-f66d188e4a0c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:20.751793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f19b4-a87d-4a0a-890e-a953818bd56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:20.753403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f19b4-a87d-4a0a-890e-a953818bd56c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:20.754069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f19b4-a87d-4a0a-890e-a953818bd56c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:20.754553 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f19b4-a87d-4a0a-890e-a953818bd56c None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:20.755749 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f19b4-a87d-4a0a-890e-a953818bd56c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:20.756724 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f19b4-a87d-4a0a-890e-a953818bd56c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:20.761519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f19b4-a87d-4a0a-890e-a953818bd56c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:20.778299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 403/772] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:20.783346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f19b4-a87d-4a0a-890e-a953818bd56c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:20.794814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b1f6c-4aa2-49ed-82bd-7835434e0d12 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:20.834854 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f06af0-0a0d-4a90-923c-5276c58cf1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:20.836521 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f06af0-0a0d-4a90-923c-5276c58cf1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:20.837007 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f06af0-0a0d-4a90-923c-5276c58cf1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:20.837559 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f06af0-0a0d-4a90-923c-5276c58cf1d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:20.850026 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f06af0-0a0d-4a90-923c-5276c58cf1d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:20.858526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-09f06af0-0a0d-4a90-923c-5276c58cf1d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:55:20.858526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:20.858526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:20.858526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:20.858526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:20.858526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:20.858526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:20.858526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:20.858526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:20.858526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:20.858526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:20.858526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:20.858526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:20.858526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:20.858526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:20.858526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:20.859522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:20.859522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:20.859522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:20.859522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:20.859522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:20.859522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:20.859522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:20.859522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:20.859522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:20.859522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:20.859522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:20.859522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:20.859522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:20.859522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:20.859522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:20.859522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:20.860385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:20.860385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:20.860385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:20.860385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:20.860385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:20.860385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:20.860385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:20.860385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:20.860385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:20.860385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:20.860385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:55:20.860385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:20.863200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 370/773] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:55:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:20.869245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f06af0-0a0d-4a90-923c-5276c58cf1d0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:20.891845 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f19b4-a87d-4a0a-890e-a953818bd56c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:20.925638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7580fb-04e6-41b2-a637-1b7690a1cd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:20.926489 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7580fb-04e6-41b2-a637-1b7690a1cd6b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:20.926775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7580fb-04e6-41b2-a637-1b7690a1cd6b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:20.927041 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7580fb-04e6-41b2-a637-1b7690a1cd6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:20.934295 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7580fb-04e6-41b2-a637-1b7690a1cd6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:20.935818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7580fb-04e6-41b2-a637-1b7690a1cd6b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:20.938369 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:20.942147 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:20.953581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-cc7580fb-04e6-41b2-a637-1b7690a1cd6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:20.953581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:20.953581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:20.953581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:20.953581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:20.953581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:20.953581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:20.953581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:20.953581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:20.953581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:20.953581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:20.953581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:20.953581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:20.953581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:20.953581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:20.954891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:20.954891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:20.954891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:20.954891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:20.954891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:20.954891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:20.954891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:20.954891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:20.954891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:20.954891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:20.954891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:20.954891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:20.954891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:20.954891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:20.954891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:20.954891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:20.954891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:20.956184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:20.956184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:20.956184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:20.956184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:20.956184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:20.956184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:20.956184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:20.956184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:20.956184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 404/774] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:20.956665 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60f828-3993-4813-963b-6b20810b3513 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:20.956993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60f828-3993-4813-963b-6b20810b3513 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:20.957225 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60f828-3993-4813-963b-6b20810b3513 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:20.958755 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 405/775] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:20.964430 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0475fa-2b74-49ea-b4aa-7b38cae08396 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:20.964653 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0475fa-2b74-49ea-b4aa-7b38cae08396 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:20.964882 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0475fa-2b74-49ea-b4aa-7b38cae08396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:20.984452 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-4a0475fa-2b74-49ea-b4aa-7b38cae08396 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:20.985628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-4a0475fa-2b74-49ea-b4aa-7b38cae08396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:20.994941 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f06af0-0a0d-4a90-923c-5276c58cf1d0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:21.038361 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72971994-5243-4c12-9030-93f11f353289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:21.039213 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72971994-5243-4c12-9030-93f11f353289 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:21.039326 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72971994-5243-4c12-9030-93f11f353289 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:21.039593 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72971994-5243-4c12-9030-93f11f353289 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:21.040352 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72971994-5243-4c12-9030-93f11f353289 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:21.040654 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72971994-5243-4c12-9030-93f11f353289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:21.042155 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72971994-5243-4c12-9030-93f11f353289 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:21.056342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 371/776] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:55:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:21.056342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72971994-5243-4c12-9030-93f11f353289 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:21.081665 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 406/777] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:55:21.083654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0475fa-2b74-49ea-b4aa-7b38cae08396 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:21.169286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72971994-5243-4c12-9030-93f11f353289 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:21.195704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:21.200849 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0475fa-2b74-49ea-b4aa-7b38cae08396 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:21.205677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f3b4b-7ece-4334-9653-41770d0de1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:21.205945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f3b4b-7ece-4334-9653-41770d0de1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:21.206202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f3b4b-7ece-4334-9653-41770d0de1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:21.206483 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f3b4b-7ece-4334-9653-41770d0de1d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:21.207276 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f3b4b-7ece-4334-9653-41770d0de1d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:21.207586 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f3b4b-7ece-4334-9653-41770d0de1d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:21.209025 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f3b4b-7ece-4334-9653-41770d0de1d5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:21.222910 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 372/778] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:21.224163 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f3b4b-7ece-4334-9653-41770d0de1d5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:21.227463 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:21.245051 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e4ed6-1496-4fd9-b296-83c27e963406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:21.246335 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e4ed6-1496-4fd9-b296-83c27e963406 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:21.246836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e4ed6-1496-4fd9-b296-83c27e963406 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:21.247295 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e4ed6-1496-4fd9-b296-83c27e963406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:21.259652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e4ed6-1496-4fd9-b296-83c27e963406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:21.261664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e4ed6-1496-4fd9-b296-83c27e963406 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:21.281481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-747e4ed6-1496-4fd9-b296-83c27e963406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:21.281481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:21.281481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:21.281481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:21.281481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:21.281481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:21.281481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:21.281481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:21.281481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:21.281481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:21.281481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:21.281481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:21.281481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:21.281481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:21.281481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:21.282420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:21.282420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:21.282420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:21.282420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:21.282420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:21.282420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:21.282420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:21.282420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:21.282420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:21.282420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:21.282420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:21.282420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:21.282420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:21.282420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:21.282420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:21.282420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:21.282420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:21.283379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:21.283379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:21.283379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:21.283379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:21.290060 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 407/779] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:21.291177 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e4ed6-1496-4fd9-b296-83c27e963406 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:21.327499 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f3b4b-7ece-4334-9653-41770d0de1d5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:21.362256 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08429969-0cdc-4a5d-939f-fe8106034329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:21.363431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08429969-0cdc-4a5d-939f-fe8106034329 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:21.363431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08429969-0cdc-4a5d-939f-fe8106034329 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:21.363623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08429969-0cdc-4a5d-939f-fe8106034329 None admin] PATH_INFO: `/v3/services/network` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:21.364232 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08429969-0cdc-4a5d-939f-fe8106034329 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:21.365600 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08429969-0cdc-4a5d-939f-fe8106034329 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:21.379574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-08429969-0cdc-4a5d-939f-fe8106034329 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 20:55:21.379574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:21.379574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:21.379574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:21.379574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:21.379574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:21.379574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:21.379574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:21.379574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 20:55:21.379574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:21.379574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:21.379574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:21.379574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:21.379574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:21.379574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:21.379574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:21.379574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:21.380581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:21.380581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:21.380581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:21.380581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:21.380581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:21.380581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:21.380581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:21.380581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:21.380581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:21.380581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:21.380581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:21.380581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:21.380581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:21.380581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:21.380581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:21.380581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:21.381398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:21.381398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:21.381398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:21.381398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:21.381398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:21.381398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:21.381398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:21.381398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:21.381398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:21.381398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:21.381398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:21.381398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:21.381398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 20:55:21.381398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:21.381398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 373/780] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:21 2022] GET /identity/v3/services/network => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:21.382220 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08429969-0cdc-4a5d-939f-fe8106034329 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:21.402622 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e4ed6-1496-4fd9-b296-83c27e963406 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:21.440155 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e98b9a-682c-4db9-8f8c-92072e7e994a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:21.441015 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:21.442008 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e98b9a-682c-4db9-8f8c-92072e7e994a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:21.442629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e98b9a-682c-4db9-8f8c-92072e7e994a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:21.443107 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e98b9a-682c-4db9-8f8c-92072e7e994a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:21.444432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e98b9a-682c-4db9-8f8c-92072e7e994a None admin] RBAC: Adding query filter params (role.id=6046421464dd48ea8977d7d1481bde10, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=3953b14656774edb92da1ecdb4bbbb07) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:21.444986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e98b9a-682c-4db9-8f8c-92072e7e994a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:21.446811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e98b9a-682c-4db9-8f8c-92072e7e994a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:21.455278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 408/781] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:55:21 2022] GET /identity/v3/role_assignments?user.id=3953b14656774edb92da1ecdb4bbbb07&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=6046421464dd48ea8977d7d1481bde10 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:21.456513 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e98b9a-682c-4db9-8f8c-92072e7e994a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:21.494327 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08429969-0cdc-4a5d-939f-fe8106034329 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:21.498307 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:21.532954 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40195c6a-804d-4419-b209-8cf18223df05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:21.533634 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40195c6a-804d-4419-b209-8cf18223df05 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:21.533949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40195c6a-804d-4419-b209-8cf18223df05 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:21.534245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40195c6a-804d-4419-b209-8cf18223df05 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:21.534960 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40195c6a-804d-4419-b209-8cf18223df05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:21.535265 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40195c6a-804d-4419-b209-8cf18223df05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:21.536674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40195c6a-804d-4419-b209-8cf18223df05 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:21.550074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 374/782] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:21.557516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40195c6a-804d-4419-b209-8cf18223df05 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:21.582945 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e98b9a-682c-4db9-8f8c-92072e7e994a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:21.622490 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b2c84-a5f0-46d5-9d29-4728dd8f1ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:21.623633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b2c84-a5f0-46d5-9d29-4728dd8f1ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:21.624190 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b2c84-a5f0-46d5-9d29-4728dd8f1ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:21.624674 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b2c84-a5f0-46d5-9d29-4728dd8f1ca9 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:21.625826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b2c84-a5f0-46d5-9d29-4728dd8f1ca9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:21.626424 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b2c84-a5f0-46d5-9d29-4728dd8f1ca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:21.628055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b2c84-a5f0-46d5-9d29-4728dd8f1ca9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:21.634063 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 409/783] 10.222.0.61 () {56 vars in 1112 bytes} [Thu May 26 20:55:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:21.643000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b2c84-a5f0-46d5-9d29-4728dd8f1ca9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:21.755547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:21.759705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b2c84-a5f0-46d5-9d29-4728dd8f1ca9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:21.804610 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead5e2e-0286-4155-a2ea-6fd0ca6694a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:21.805537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead5e2e-0286-4155-a2ea-6fd0ca6694a3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:21.805999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead5e2e-0286-4155-a2ea-6fd0ca6694a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:21.806443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead5e2e-0286-4155-a2ea-6fd0ca6694a3 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:21.807315 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead5e2e-0286-4155-a2ea-6fd0ca6694a3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:21.807817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead5e2e-0286-4155-a2ea-6fd0ca6694a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:21.809488 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead5e2e-0286-4155-a2ea-6fd0ca6694a3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:21.815637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 410/784] 10.222.0.61 () {56 vars in 1112 bytes} [Thu May 26 20:55:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:21.825323 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead5e2e-0286-4155-a2ea-6fd0ca6694a3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:21.845501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40195c6a-804d-4419-b209-8cf18223df05 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:21.870796 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:21.919268 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde12cdc-8856-42be-b9a3-76b1fbd239e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:21.920340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde12cdc-8856-42be-b9a3-76b1fbd239e4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:21.921828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde12cdc-8856-42be-b9a3-76b1fbd239e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:21.923654 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde12cdc-8856-42be-b9a3-76b1fbd239e4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:21.938767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde12cdc-8856-42be-b9a3-76b1fbd239e4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:21.940297 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde12cdc-8856-42be-b9a3-76b1fbd239e4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:21.984041 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead5e2e-0286-4155-a2ea-6fd0ca6694a3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:22.033511 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d90996-1cd5-48dc-ba44-a47805d9551e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:22.034494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d90996-1cd5-48dc-ba44-a47805d9551e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:22.034927 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d90996-1cd5-48dc-ba44-a47805d9551e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:22.035349 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d90996-1cd5-48dc-ba44-a47805d9551e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:22.036327 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d90996-1cd5-48dc-ba44-a47805d9551e None admin] RBAC: Adding query filter params (interface=public, service_id=c667646b74594052bad5e8c656fb6668, region_id=RegionOne) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:22.036807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d90996-1cd5-48dc-ba44-a47805d9551e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:22.039067 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d90996-1cd5-48dc-ba44-a47805d9551e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:22.052270 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 411/785] 10.222.0.61 () {56 vars in 1251 bytes} [Thu May 26 20:55:21 2022] GET /identity/v3/endpoints?service_id=c667646b74594052bad5e8c656fb6668&interface=public®ion_id=RegionOne => generated 194 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:22.059547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d90996-1cd5-48dc-ba44-a47805d9551e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:22.091688 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:22.172459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d90996-1cd5-48dc-ba44-a47805d9551e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:22.194516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-fde12cdc-8856-42be-b9a3-76b1fbd239e4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 20:55:22.194516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:22.194516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:22.194516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:22.194516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:22.194516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:22.194516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:22.194516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:22.194516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:22.194516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:22.194516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:22.194516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:22.194516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:22.194516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:22.194516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:22.194516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:22.195511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:22.196431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:22.196431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:22.196431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:22.196431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:22.196431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:22.196431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:22.196431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:22.196431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:22.196431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 20:55:22.196431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:22.196431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 375/786] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:55:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 639 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:22.201551 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde12cdc-8856-42be-b9a3-76b1fbd239e4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:22.218214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059c162-bdcd-4013-8ba4-5295151b1e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:22.219266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059c162-bdcd-4013-8ba4-5295151b1e0b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:22.219750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059c162-bdcd-4013-8ba4-5295151b1e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:22.220224 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059c162-bdcd-4013-8ba4-5295151b1e0b None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:22.221122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059c162-bdcd-4013-8ba4-5295151b1e0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:22.224708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059c162-bdcd-4013-8ba4-5295151b1e0b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:22.234343 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 412/787] 10.222.0.61 () {56 vars in 1087 bytes} [Thu May 26 20:55:22 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:22.369615 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde12cdc-8856-42be-b9a3-76b1fbd239e4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:22.429394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305a24b-e537-4695-b6bb-21b722b1b749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:22.430138 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305a24b-e537-4695-b6bb-21b722b1b749 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:22.430415 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305a24b-e537-4695-b6bb-21b722b1b749 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:22.430687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305a24b-e537-4695-b6bb-21b722b1b749 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:22.431561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305a24b-e537-4695-b6bb-21b722b1b749 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:22.431861 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305a24b-e537-4695-b6bb-21b722b1b749 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:22.433323 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305a24b-e537-4695-b6bb-21b722b1b749 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:22.454198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 376/788] 10.222.0.61 () {56 vars in 1135 bytes} [Thu May 26 20:55:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:22.462925 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059c162-bdcd-4013-8ba4-5295151b1e0b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:22.568985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:22.579284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059c162-bdcd-4013-8ba4-5295151b1e0b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:22.629314 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bb83d-b31d-48b7-b334-16f2513efbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:22.630083 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bb83d-b31d-48b7-b334-16f2513efbbc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:22.630369 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bb83d-b31d-48b7-b334-16f2513efbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:22.630646 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bb83d-b31d-48b7-b334-16f2513efbbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:22.645496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bb83d-b31d-48b7-b334-16f2513efbbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:22.647016 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bb83d-b31d-48b7-b334-16f2513efbbc None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:22.675142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-1a1bb83d-b31d-48b7-b334-16f2513efbbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:22.675142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:22.675142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:22.675142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:22.675142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:22.675142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:22.675142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:22.675142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:22.675142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:22.675142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:22.675142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:22.675142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:22.675142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:22.675142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:22.675142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:22.676197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:22.676197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:22.676197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:22.676197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:22.676197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:22.676197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:22.676197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:22.676197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:22.676197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:22.676197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:22.676197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:22.676197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:22.676197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:22.676197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:22.676197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:22.676197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:22.676197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:22.677089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:22.677089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:22.677089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:22.677089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:22.677089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 413/789] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:22.682360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305a24b-e537-4695-b6bb-21b722b1b749 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:22.747194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:22.911667 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305a24b-e537-4695-b6bb-21b722b1b749 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:22.940501 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bc610-e2b9-48d5-8cac-5afc4775ed76 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:22.940789 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bc610-e2b9-48d5-8cac-5afc4775ed76 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:22.941070 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bc610-e2b9-48d5-8cac-5afc4775ed76 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:22.942850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 414/790] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:22.955773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeae389-4389-42b3-95a4-13667c9ab189 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:22.956065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeae389-4389-42b3-95a4-13667c9ab189 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:22.956344 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeae389-4389-42b3-95a4-13667c9ab189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:22.962812 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821d96b-0cd4-49eb-8a6f-6b7502e1e4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:22.963935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821d96b-0cd4-49eb-8a6f-6b7502e1e4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:22.964388 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821d96b-0cd4-49eb-8a6f-6b7502e1e4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:22.964884 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821d96b-0cd4-49eb-8a6f-6b7502e1e4b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:22.965786 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821d96b-0cd4-49eb-8a6f-6b7502e1e4b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:22.966282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821d96b-0cd4-49eb-8a6f-6b7502e1e4b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:22.968102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821d96b-0cd4-49eb-8a6f-6b7502e1e4b6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:22.985000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-dfeae389-4389-42b3-95a4-13667c9ab189 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:22.987999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 377/791] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:22.989639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-dfeae389-4389-42b3-95a4-13667c9ab189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:22.993104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821d96b-0cd4-49eb-8a6f-6b7502e1e4b6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:23.122975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 415/792] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:55:23.150169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:23.167071 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeae389-4389-42b3-95a4-13667c9ab189 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:23.167665 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821d96b-0cd4-49eb-8a6f-6b7502e1e4b6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:23.204707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8726b2-ac2d-4932-b8af-bd149531d9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:23.205523 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8726b2-ac2d-4932-b8af-bd149531d9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:23.205818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8726b2-ac2d-4932-b8af-bd149531d9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:23.206119 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8726b2-ac2d-4932-b8af-bd149531d9a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:23.213463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8726b2-ac2d-4932-b8af-bd149531d9a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:23.214949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8726b2-ac2d-4932-b8af-bd149531d9a9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:23.229594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-1f8726b2-ac2d-4932-b8af-bd149531d9a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:23.229594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:23.229594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:23.229594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:23.229594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:23.229594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:23.229594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:23.229594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:23.229594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:23.229594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:23.229594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:23.229594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:23.229594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:23.229594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:23.229594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:23.230719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:23.230719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:23.230719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:23.230719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:23.230719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:23.230719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:23.230719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:23.230719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:23.230719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:23.230719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:23.230719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:23.230719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:23.230719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:23.230719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:23.230719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:23.230719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:23.230719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:23.231948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:23.231948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:23.231948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:23.231948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:23.231948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:23.231948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:23.231948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:23.231948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:23.231948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 378/793] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:23.232470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd2c4b-9083-4887-ac2f-d879aa7f2b13 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:23.232646 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd2c4b-9083-4887-ac2f-d879aa7f2b13 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:23.232925 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd2c4b-9083-4887-ac2f-d879aa7f2b13 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:23.239415 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 379/794] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:23.240212 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd2c4b-9083-4887-ac2f-d879aa7f2b13 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:23.267377 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:23.301990 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeae389-4389-42b3-95a4-13667c9ab189 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:23.350058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805522a6-866b-4d62-91bd-a5938bfb8bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:23.351417 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805522a6-866b-4d62-91bd-a5938bfb8bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:23.352278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805522a6-866b-4d62-91bd-a5938bfb8bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:23.352970 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805522a6-866b-4d62-91bd-a5938bfb8bb4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:23.353776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805522a6-866b-4d62-91bd-a5938bfb8bb4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:23.355627 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805522a6-866b-4d62-91bd-a5938bfb8bb4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:23.355795 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd2c4b-9083-4887-ac2f-d879aa7f2b13 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:23.372062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-805522a6-866b-4d62-91bd-a5938bfb8bb4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 20:55:23.372062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:23.372062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:23.372062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:23.372062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:23.372062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:23.372062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:23.372062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:23.372062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 20:55:23.372062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:23.372062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:23.372062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:23.372062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:23.372062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:23.372062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:23.372062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:23.373219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:23.373219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:23.373219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:23.373219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:23.373219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:23.373219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:23.373219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:23.373219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:23.373219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:23.373219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:23.373219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:23.373219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:23.373219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:23.373219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:23.373219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:23.373219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:23.374491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:23.374491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:23.374491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:23.374491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:23.374491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:23.374491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:23.374491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:23.374491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:23.374491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:23.374491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:23.374491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:23.374491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:23.374491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:23.374491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 20:55:23.374491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:23.382310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 416/795] 10.222.0.61 () {56 vars in 1129 bytes} [Thu May 26 20:55:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:23.384178 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1463202-cfc7-4978-8aaf-7aa160744aa5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:23.384471 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1463202-cfc7-4978-8aaf-7aa160744aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:23.384748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1463202-cfc7-4978-8aaf-7aa160744aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:23.400243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852678a-16b5-4c10-9e88-17170e8e93a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:23.401279 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852678a-16b5-4c10-9e88-17170e8e93a0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:23.401753 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852678a-16b5-4c10-9e88-17170e8e93a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:23.402073 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d1463202-cfc7-4978-8aaf-7aa160744aa5 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:23.402499 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852678a-16b5-4c10-9e88-17170e8e93a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:23.403253 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d1463202-cfc7-4978-8aaf-7aa160744aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:23.403763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852678a-16b5-4c10-9e88-17170e8e93a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:23.404307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852678a-16b5-4c10-9e88-17170e8e93a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:23.406195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852678a-16b5-4c10-9e88-17170e8e93a0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:23.420038 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 380/796] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:23.421289 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852678a-16b5-4c10-9e88-17170e8e93a0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:23.440129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:23.494265 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 417/797] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:23.495255 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1463202-cfc7-4978-8aaf-7aa160744aa5 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:23.539099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852678a-16b5-4c10-9e88-17170e8e93a0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:23.578875 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa14626-c695-4a8b-bb30-c84348f21777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:23.579830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa14626-c695-4a8b-bb30-c84348f21777 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:23.580204 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa14626-c695-4a8b-bb30-c84348f21777 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:23.580569 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa14626-c695-4a8b-bb30-c84348f21777 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:23.581180 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:23.582503 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa14626-c695-4a8b-bb30-c84348f21777 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:23.582866 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa14626-c695-4a8b-bb30-c84348f21777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:23.585446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa14626-c695-4a8b-bb30-c84348f21777 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:23.595308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 381/798] 10.222.0.61 () {56 vars in 1124 bytes} [Thu May 26 20:55:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:23.595308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa14626-c695-4a8b-bb30-c84348f21777 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:23.634490 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1463202-cfc7-4978-8aaf-7aa160744aa5 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:23.670222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:23.682924 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b10a69-6272-4474-b33f-3592f1e89aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:23.683835 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b10a69-6272-4474-b33f-3592f1e89aae None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:23.684113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b10a69-6272-4474-b33f-3592f1e89aae None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:23.684384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b10a69-6272-4474-b33f-3592f1e89aae None admin] PATH_INFO: `/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/57a63879ec1242d08bba1ccad6212788/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:23.687408 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b10a69-6272-4474-b33f-3592f1e89aae None admin] RBAC: Authorizing `identity:create_grant(project_id=2c23678abd4f4dacaf35d73c5184e72e, user_id=57a63879ec1242d08bba1ccad6212788, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:23.689773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b10a69-6272-4474-b33f-3592f1e89aae None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:23.708137 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa14626-c695-4a8b-bb30-c84348f21777 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:23.709204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 418/799] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:55:23 2022] PUT /identity/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/57a63879ec1242d08bba1ccad6212788/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:55:23.711937 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b10a69-6272-4474-b33f-3592f1e89aae None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:23.749207 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25306d52-a9ad-42e3-871e-7e9ecb779992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:23.750180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25306d52-a9ad-42e3-871e-7e9ecb779992 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:23.750550 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25306d52-a9ad-42e3-871e-7e9ecb779992 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:23.750734 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25306d52-a9ad-42e3-871e-7e9ecb779992 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:23.762920 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25306d52-a9ad-42e3-871e-7e9ecb779992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:23.770647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-25306d52-a9ad-42e3-871e-7e9ecb779992 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:55:23.770647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:23.770647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:23.770647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:23.770647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:23.770647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:23.770647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:23.770647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:23.770647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:23.770647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:23.770647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:23.770647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:23.770647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:23.770647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:23.770647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:23.770647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:23.771698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:23.771698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:23.771698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:23.771698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:23.771698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:23.771698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:23.771698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:23.771698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:23.771698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:23.771698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:23.771698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:23.771698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:23.771698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:23.771698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:23.771698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:23.771698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:23.772595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:23.772595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:23.772595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:23.772595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:23.772595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:23.772595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:23.772595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:23.772595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:23.772595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:23.772595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:23.772595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:55:23.772595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:23.772595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 382/800] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:55:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:23.777865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25306d52-a9ad-42e3-871e-7e9ecb779992 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:23.839227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b10a69-6272-4474-b33f-3592f1e89aae None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:23.870641 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:23.882037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7911b3-d48c-49f5-98d1-e5a59c8d54b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:23.882874 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7911b3-d48c-49f5-98d1-e5a59c8d54b2 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:23.883246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7911b3-d48c-49f5-98d1-e5a59c8d54b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:23.883618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7911b3-d48c-49f5-98d1-e5a59c8d54b2 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:23.884676 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7911b3-d48c-49f5-98d1-e5a59c8d54b2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:23.885388 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7911b3-d48c-49f5-98d1-e5a59c8d54b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:23.887111 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7911b3-d48c-49f5-98d1-e5a59c8d54b2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:23.903662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 419/801] 10.222.0.61 () {56 vars in 1124 bytes} [Thu May 26 20:55:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:23.911590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7911b3-d48c-49f5-98d1-e5a59c8d54b2 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:23.922833 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25306d52-a9ad-42e3-871e-7e9ecb779992 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:23.988069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:23.998507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1595b-d1b7-4f66-a4ce-fa1976258ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:23.999306 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1595b-d1b7-4f66-a4ce-fa1976258ecf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:23.999591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1595b-d1b7-4f66-a4ce-fa1976258ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:23.999866 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1595b-d1b7-4f66-a4ce-fa1976258ecf None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:24.000686 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1595b-d1b7-4f66-a4ce-fa1976258ecf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:24.000996 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1595b-d1b7-4f66-a4ce-fa1976258ecf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:24.002437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1595b-d1b7-4f66-a4ce-fa1976258ecf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:24.019398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 383/802] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:55:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:24.024502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1595b-d1b7-4f66-a4ce-fa1976258ecf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:24.072746 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7911b3-d48c-49f5-98d1-e5a59c8d54b2 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:24.119415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb71fd8-a260-4207-a586-d21a2cc12813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:24.120101 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb71fd8-a260-4207-a586-d21a2cc12813 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:24.120384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb71fd8-a260-4207-a586-d21a2cc12813 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:24.120656 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb71fd8-a260-4207-a586-d21a2cc12813 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:24.121459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb71fd8-a260-4207-a586-d21a2cc12813 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:24.123193 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb71fd8-a260-4207-a586-d21a2cc12813 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:24.161724 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 420/803] 10.222.0.61 () {60 vars in 1144 bytes} [Thu May 26 20:55:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:55:24.179533 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1595b-d1b7-4f66-a4ce-fa1976258ecf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:24.226054 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108d540-ae4b-42ca-8482-4778ce5190ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:24.226880 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108d540-ae4b-42ca-8482-4778ce5190ca None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:24.227162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108d540-ae4b-42ca-8482-4778ce5190ca None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:24.227432 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108d540-ae4b-42ca-8482-4778ce5190ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:24.239615 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108d540-ae4b-42ca-8482-4778ce5190ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:24.241174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108d540-ae4b-42ca-8482-4778ce5190ca None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:24.261169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3108d540-ae4b-42ca-8482-4778ce5190ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:24.261169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:24.261169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:24.261169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:24.261169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:24.261169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:24.261169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:24.261169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:24.261169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:24.261169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:24.261169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:24.261169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:24.261169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:24.261169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:24.261169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:24.263348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:24.263348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:24.263348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:24.263348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:24.263348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:24.263348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:24.263348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:24.263348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:24.263348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:24.263348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:24.263348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:24.263348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:24.263348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:24.263348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:24.263348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:24.263348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:24.263348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:24.265573 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:24.265573 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:24.265573 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:24.265573 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:24.265573 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 384/804] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:24.270999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb71fd8-a260-4207-a586-d21a2cc12813 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:24.332240 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115de5d3-720b-4da7-a37d-2b2db8ad1d40 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:24.332572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115de5d3-720b-4da7-a37d-2b2db8ad1d40 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:24.332794 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115de5d3-720b-4da7-a37d-2b2db8ad1d40 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:24.334216 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 385/805] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:55:24.340255 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7d13d-2009-4a93-a493-2ff1d50527f6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:24.340547 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7d13d-2009-4a93-a493-2ff1d50527f6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:24.340806 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7d13d-2009-4a93-a493-2ff1d50527f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:24.361061 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:24.370991 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-17c7d13d-2009-4a93-a493-2ff1d50527f6 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:24.372604 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-17c7d13d-2009-4a93-a493-2ff1d50527f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:24.440568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb71fd8-a260-4207-a586-d21a2cc12813 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:24.465557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:24.505707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa4ad2-5b2a-47f6-8586-f4e855987004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:24.506474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa4ad2-5b2a-47f6-8586-f4e855987004 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:24.506714 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa4ad2-5b2a-47f6-8586-f4e855987004 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:24.506986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa4ad2-5b2a-47f6-8586-f4e855987004 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:24.507721 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa4ad2-5b2a-47f6-8586-f4e855987004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:24.508029 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa4ad2-5b2a-47f6-8586-f4e855987004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:24.509429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa4ad2-5b2a-47f6-8586-f4e855987004 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:24.523010 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 386/806] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:24.525826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 421/807] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:24.529654 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7d13d-2009-4a93-a493-2ff1d50527f6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:24.551582 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa4ad2-5b2a-47f6-8586-f4e855987004 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:24.676954 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa4ad2-5b2a-47f6-8586-f4e855987004 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:24.684749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7d13d-2009-4a93-a493-2ff1d50527f6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:24.697198 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:24.742432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de1178-db0e-4c6c-a57d-b91bd307118b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:24.743262 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de1178-db0e-4c6c-a57d-b91bd307118b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:24.743545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de1178-db0e-4c6c-a57d-b91bd307118b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:24.743822 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de1178-db0e-4c6c-a57d-b91bd307118b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:24.758391 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597159d-9acf-4c2b-a8ed-abd2ea672cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:24.759211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597159d-9acf-4c2b-a8ed-abd2ea672cac None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:24.759489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597159d-9acf-4c2b-a8ed-abd2ea672cac None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:24.759760 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597159d-9acf-4c2b-a8ed-abd2ea672cac None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:24.772993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de1178-db0e-4c6c-a57d-b91bd307118b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:24.777815 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597159d-9acf-4c2b-a8ed-abd2ea672cac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:24.777815 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597159d-9acf-4c2b-a8ed-abd2ea672cac None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:24.778442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-58de1178-db0e-4c6c-a57d-b91bd307118b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:24.778442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:24.778442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:24.778442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:24.778442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:24.778442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:24.778442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:24.778442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:24.778442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:24.778442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:24.778442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:24.778442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:24.778442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:24.778442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:24.778442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:24.778442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:24.779510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:24.779510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:24.779510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:24.779510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:24.779510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:24.779510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:24.779510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:24.779510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:24.779510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:24.779510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:24.779510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:24.779510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:24.779510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:24.779510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:24.779510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:24.779510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:24.780411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:24.780411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:24.780411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:24.780411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:24.780411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:24.780411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:24.780411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:24.780411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:24.780411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:24.780411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:24.780411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:24.780411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:24.780411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 422/808] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:55:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:24.786723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de1178-db0e-4c6c-a57d-b91bd307118b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:24.807469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-2597159d-9acf-4c2b-a8ed-abd2ea672cac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 20:55:24.807469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:24.807469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:24.807469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:24.807469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:24.807469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:24.807469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:24.807469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:24.807469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:24.807469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:24.807469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:24.807469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:24.807469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:24.807469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:24.807469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:24.807469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:24.808466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:24.809378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:24.809378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:24.809378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:24.809378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:24.809378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:24.809378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:24.809378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:24.809378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:24.809378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 20:55:24.809378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:24.810402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 387/809] 10.222.0.61 () {56 vars in 1093 bytes} [Thu May 26 20:55:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:24.816458 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597159d-9acf-4c2b-a8ed-abd2ea672cac None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:24.862197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:24.925707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597159d-9acf-4c2b-a8ed-abd2ea672cac None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:24.958779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de1178-db0e-4c6c-a57d-b91bd307118b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:24.962497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194b99a-4ce3-4452-958a-8bfee24ad3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:24.963408 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194b99a-4ce3-4452-958a-8bfee24ad3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:24.963876 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194b99a-4ce3-4452-958a-8bfee24ad3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:24.964323 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194b99a-4ce3-4452-958a-8bfee24ad3e0 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:24.965335 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194b99a-4ce3-4452-958a-8bfee24ad3e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:24.966014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194b99a-4ce3-4452-958a-8bfee24ad3e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:24.968090 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194b99a-4ce3-4452-958a-8bfee24ad3e0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:24.990011 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 388/810] 10.222.0.61 () {56 vars in 1133 bytes} [Thu May 26 20:55:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:24.991656 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf7ba2-3431-4049-944d-41f87d62b573 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:24.992104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf7ba2-3431-4049-944d-41f87d62b573 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:24.992539 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf7ba2-3431-4049-944d-41f87d62b573 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:24.995525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 389/811] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:24.996810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf7ba2-3431-4049-944d-41f87d62b573 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:25.002179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fcd20-76f4-4c0c-9550-66defd9ce996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:25.003667 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fcd20-76f4-4c0c-9550-66defd9ce996 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:25.004174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fcd20-76f4-4c0c-9550-66defd9ce996 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:25.004660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fcd20-76f4-4c0c-9550-66defd9ce996 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:25.005632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34fcd20-76f4-4c0c-9550-66defd9ce996 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:25.006155 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34fcd20-76f4-4c0c-9550-66defd9ce996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:25.007759 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34fcd20-76f4-4c0c-9550-66defd9ce996 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:25.018523 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 423/812] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:55:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:25.020251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ceadd-7b6b-4a47-bb43-10a217d85e0e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:25.020738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ceadd-7b6b-4a47-bb43-10a217d85e0e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:25.021212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ceadd-7b6b-4a47-bb43-10a217d85e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:25.041622 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f19ceadd-7b6b-4a47-bb43-10a217d85e0e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:25.043502 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f19ceadd-7b6b-4a47-bb43-10a217d85e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:25.069611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:25.117343 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:25.126219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 424/813] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:25.127367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ceadd-7b6b-4a47-bb43-10a217d85e0e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:25.139119 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf7ba2-3431-4049-944d-41f87d62b573 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:25.191063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cede291-13b4-4776-a4dd-7f17566f6039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:25.192219 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cede291-13b4-4776-a4dd-7f17566f6039 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:25.192711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cede291-13b4-4776-a4dd-7f17566f6039 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:25.193284 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cede291-13b4-4776-a4dd-7f17566f6039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:25.263907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ceadd-7b6b-4a47-bb43-10a217d85e0e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:25.280889 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cede291-13b4-4776-a4dd-7f17566f6039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:25.282583 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cede291-13b4-4776-a4dd-7f17566f6039 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:25.301213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057165b-88a1-4952-9448-a57d22181188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:25.302421 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057165b-88a1-4952-9448-a57d22181188 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:25.302905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057165b-88a1-4952-9448-a57d22181188 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:25.303398 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057165b-88a1-4952-9448-a57d22181188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:25.316466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057165b-88a1-4952-9448-a57d22181188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:25.318511 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057165b-88a1-4952-9448-a57d22181188 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:25.342705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-c057165b-88a1-4952-9448-a57d22181188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:25.342705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:25.342705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:25.342705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:25.342705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:25.342705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:25.342705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:25.342705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:25.342705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:25.342705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:25.342705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:25.342705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:25.342705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:25.342705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:25.342705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:25.343670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:25.343670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:25.343670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:25.343670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:25.343670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:25.343670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:25.343670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:25.343670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:25.343670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:25.343670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:25.343670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:25.343670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:25.343670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:25.343670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:25.343670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:25.343670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:25.343670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:25.344546 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:25.344546 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:25.344546 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:25.344546 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:25.344546 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 425/814] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:25.345299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057165b-88a1-4952-9448-a57d22181188 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:25.366723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:25.403310 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:25.418293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 390/815] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:55:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:55:25.419406 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cede291-13b4-4776-a4dd-7f17566f6039 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:25.463300 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057165b-88a1-4952-9448-a57d22181188 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:25.500161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c06090-93a0-4247-86e2-2d857817c02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:25.501116 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c06090-93a0-4247-86e2-2d857817c02d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:25.501492 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c06090-93a0-4247-86e2-2d857817c02d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:25.501898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c06090-93a0-4247-86e2-2d857817c02d None admin] PATH_INFO: `/v3/services/network` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:25.502747 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c06090-93a0-4247-86e2-2d857817c02d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:25.504127 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c06090-93a0-4247-86e2-2d857817c02d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:25.518297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-37c06090-93a0-4247-86e2-2d857817c02d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 20:55:25.518297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:25.518297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:25.518297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:25.518297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:25.518297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:25.518297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:25.518297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:25.518297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 20:55:25.518297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:25.518297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:25.518297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:25.518297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:25.518297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:25.518297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:25.518297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:25.518297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:25.519958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:25.519958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:25.519958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:25.519958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:25.519958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:25.519958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:25.519958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:25.519958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:25.519958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:25.519958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:25.519958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:25.519958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:25.519958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:25.519958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:25.519958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:25.519958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:25.520993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:25.520993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:25.520993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:25.520993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:25.520993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:25.520993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:25.520993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:25.520993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:25.520993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:25.520993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:25.520993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:25.520993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:25.520993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 20:55:25.520993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:25.522683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 426/816] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:25 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:25.523710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c06090-93a0-4247-86e2-2d857817c02d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:25.547715 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cede291-13b4-4776-a4dd-7f17566f6039 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:25.599228 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff4c79-a0aa-4eee-8c2c-34650d17a174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:25.601004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff4c79-a0aa-4eee-8c2c-34650d17a174 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:25.601436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff4c79-a0aa-4eee-8c2c-34650d17a174 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:25.601903 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff4c79-a0aa-4eee-8c2c-34650d17a174 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:25.602794 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff4c79-a0aa-4eee-8c2c-34650d17a174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:25.603257 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff4c79-a0aa-4eee-8c2c-34650d17a174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:25.604771 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff4c79-a0aa-4eee-8c2c-34650d17a174 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:25.608155 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:25.622231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 391/817] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:25.623379 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff4c79-a0aa-4eee-8c2c-34650d17a174 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:25.645170 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c06090-93a0-4247-86e2-2d857817c02d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:25.681918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:25.695943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066f9fc-30e6-49e4-a93e-d7904dd548e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:25.696766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066f9fc-30e6-49e4-a93e-d7904dd548e1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:25.697038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066f9fc-30e6-49e4-a93e-d7904dd548e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:25.697309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066f9fc-30e6-49e4-a93e-d7904dd548e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:25.712780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066f9fc-30e6-49e4-a93e-d7904dd548e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:25.714707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066f9fc-30e6-49e4-a93e-d7904dd548e1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:25.739685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-3066f9fc-30e6-49e4-a93e-d7904dd548e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:25.739685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:25.739685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:25.739685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:25.739685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:25.739685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:25.739685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:25.739685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:25.739685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:25.739685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:25.739685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:25.739685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:25.739685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:25.739685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:25.739685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:25.740649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:25.740649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:25.740649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:25.740649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:25.740649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:25.740649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:25.740649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:25.740649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:25.740649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:25.740649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:25.740649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:25.740649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:25.740649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:25.740649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:25.740649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:25.740649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:25.740649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:25.741535 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:25.741535 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:25.741535 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:25.741535 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:25.741771 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff4c79-a0aa-4eee-8c2c-34650d17a174 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:25.745097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 427/818] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:25.746138 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066f9fc-30e6-49e4-a93e-d7904dd548e1 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:25.777740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8b670-bb38-43fe-8ba3-3006737de4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:25.778777 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8b670-bb38-43fe-8ba3-3006737de4ae None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:25.779194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8b670-bb38-43fe-8ba3-3006737de4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:25.779603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8b670-bb38-43fe-8ba3-3006737de4ae None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:25.780489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8b670-bb38-43fe-8ba3-3006737de4ae None admin] RBAC: Adding query filter params (name=network) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:25.780928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8b670-bb38-43fe-8ba3-3006737de4ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:25.782513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8b670-bb38-43fe-8ba3-3006737de4ae None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:25.788010 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 392/819] 10.222.0.61 () {56 vars in 1112 bytes} [Thu May 26 20:55:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:25.789056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8b670-bb38-43fe-8ba3-3006737de4ae None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:25.871493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066f9fc-30e6-49e4-a93e-d7904dd548e1 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:25.893588 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8b670-bb38-43fe-8ba3-3006737de4ae None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:25.899683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:25.908694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924cb09-f82b-48b0-9f38-c2741f224a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:25.909353 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:25.909874 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924cb09-f82b-48b0-9f38-c2741f224a8c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:25.910412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924cb09-f82b-48b0-9f38-c2741f224a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:25.911222 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924cb09-f82b-48b0-9f38-c2741f224a8c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:25.919474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924cb09-f82b-48b0-9f38-c2741f224a8c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:25.921563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924cb09-f82b-48b0-9f38-c2741f224a8c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:25.932085 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b5465-1423-41cb-8ab4-c24a968cb434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:25.933269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b5465-1423-41cb-8ab4-c24a968cb434 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:25.933704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b5465-1423-41cb-8ab4-c24a968cb434 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:25.934157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b5465-1423-41cb-8ab4-c24a968cb434 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:25.935033 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b5465-1423-41cb-8ab4-c24a968cb434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:25.935472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b5465-1423-41cb-8ab4-c24a968cb434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:25.936996 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b5465-1423-41cb-8ab4-c24a968cb434 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:25.938108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-f924cb09-f82b-48b0-9f38-c2741f224a8c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 20:55:25.938108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:25.938108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:25.938108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:25.938108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:25.938108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:25.938108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:25.938108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:25.938108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:25.938108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:25.938108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:25.938108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:25.938108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:25.938108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:25.938108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:25.938108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:25.939239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:25.940156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:25.940156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:25.940156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:25.940156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:25.940156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:25.940156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:25.940156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:25.940156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:25.940156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 20:55:25.940156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:25.945223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 428/820] 10.222.0.61 () {56 vars in 1117 bytes} [Thu May 26 20:55:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:25.946246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924cb09-f82b-48b0-9f38-c2741f224a8c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:25.953980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 393/821] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:25.955133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b5465-1423-41cb-8ab4-c24a968cb434 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:26.054621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924cb09-f82b-48b0-9f38-c2741f224a8c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:26.058732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b5465-1423-41cb-8ab4-c24a968cb434 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:26.095821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f613b1a-9112-4eb2-8fe8-ea9e2eb6b08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:26.096518 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f613b1a-9112-4eb2-8fe8-ea9e2eb6b08c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:26.096805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f613b1a-9112-4eb2-8fe8-ea9e2eb6b08c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:26.097079 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f613b1a-9112-4eb2-8fe8-ea9e2eb6b08c None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:26.097824 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f613b1a-9112-4eb2-8fe8-ea9e2eb6b08c None admin] RBAC: Adding query filter params (type=network) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:26.098175 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f613b1a-9112-4eb2-8fe8-ea9e2eb6b08c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:26.099557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f613b1a-9112-4eb2-8fe8-ea9e2eb6b08c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:26.100023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63424a3-2a32-45ae-8dd0-4fd44d145a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:26.100936 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63424a3-2a32-45ae-8dd0-4fd44d145a34 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:26.101381 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63424a3-2a32-45ae-8dd0-4fd44d145a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:26.101849 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63424a3-2a32-45ae-8dd0-4fd44d145a34 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:26.102861 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63424a3-2a32-45ae-8dd0-4fd44d145a34 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:26.103337 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63424a3-2a32-45ae-8dd0-4fd44d145a34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:26.104948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63424a3-2a32-45ae-8dd0-4fd44d145a34 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:26.109897 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 429/822] 10.222.0.61 () {56 vars in 1112 bytes} [Thu May 26 20:55:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:26.110835 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f613b1a-9112-4eb2-8fe8-ea9e2eb6b08c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:26.124389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 394/823] 10.222.0.61 () {56 vars in 1149 bytes} [Thu May 26 20:55:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:26.125524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63424a3-2a32-45ae-8dd0-4fd44d145a34 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:26.157113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:26.168162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:26.223327 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f613b1a-9112-4eb2-8fe8-ea9e2eb6b08c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:26.231344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63424a3-2a32-45ae-8dd0-4fd44d145a34 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:26.260882 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53416e97-f178-42b9-b2aa-8ecefe1b8683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:26.261709 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53416e97-f178-42b9-b2aa-8ecefe1b8683 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:26.262044 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53416e97-f178-42b9-b2aa-8ecefe1b8683 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:26.262322 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53416e97-f178-42b9-b2aa-8ecefe1b8683 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:26.267369 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e432b2-9036-4c56-a3f6-677abd5049c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:26.268032 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e432b2-9036-4c56-a3f6-677abd5049c3 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:26.268307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e432b2-9036-4c56-a3f6-677abd5049c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:26.268581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e432b2-9036-4c56-a3f6-677abd5049c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:26.269324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e432b2-9036-4c56-a3f6-677abd5049c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:26.269696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53416e97-f178-42b9-b2aa-8ecefe1b8683 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:26.270709 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e432b2-9036-4c56-a3f6-677abd5049c3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:26.271189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53416e97-f178-42b9-b2aa-8ecefe1b8683 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:26.285843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-53416e97-f178-42b9-b2aa-8ecefe1b8683 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:26.285843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:26.285843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:26.285843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:26.285843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:26.285843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:26.285843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:26.285843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:26.285843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:26.285843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:26.285843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:26.285843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:26.285843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:26.285843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:26.285843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:26.287317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:26.287317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:26.287317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:26.287317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:26.287317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:26.287317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:26.287317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:26.287317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:26.287317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:26.287317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:26.287317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:26.287317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:26.287317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:26.287317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:26.287317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:26.287317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:26.287317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:26.288191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:26.288191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:26.288191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:26.288191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:26.288191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:26.288191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:26.288191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:26.288191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:26.292270 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 430/824] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:26.292839 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53416e97-f178-42b9-b2aa-8ecefe1b8683 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:26.297841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 395/825] 10.222.0.61 () {60 vars in 1144 bytes} [Thu May 26 20:55:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:55:26.297841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77741336-38c0-4309-8e56-4fc06cdfae44 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:26.297841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77741336-38c0-4309-8e56-4fc06cdfae44 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:26.297841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77741336-38c0-4309-8e56-4fc06cdfae44 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:26.298687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 396/826] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:26.299421 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77741336-38c0-4309-8e56-4fc06cdfae44 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:26.419859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53416e97-f178-42b9-b2aa-8ecefe1b8683 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:26.432612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:26.435960 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:26.458243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77741336-38c0-4309-8e56-4fc06cdfae44 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:26.465108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5b604-a02c-4c1f-b0d3-8b0ce4052dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:26.466372 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5b604-a02c-4c1f-b0d3-8b0ce4052dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:26.466865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5b604-a02c-4c1f-b0d3-8b0ce4052dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:26.467399 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5b604-a02c-4c1f-b0d3-8b0ce4052dd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:26.479574 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5b604-a02c-4c1f-b0d3-8b0ce4052dd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:26.481462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5b604-a02c-4c1f-b0d3-8b0ce4052dd0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:26.501620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f224f-086a-4170-9fbf-91c95dc94cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:26.502039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-0df5b604-a02c-4c1f-b0d3-8b0ce4052dd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:26.502039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:26.502039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:26.502039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:26.502039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:26.502039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:26.502039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:26.502039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:26.502039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:26.502039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:26.502039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:26.502039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:26.502039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:26.502039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:26.502039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:26.502892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:26.502892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:26.502892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:26.502892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:26.502892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:26.502892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:26.502892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:26.502892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:26.502892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:26.502892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:26.502892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:26.502892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:26.502892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:26.502892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:26.502892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:26.502892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:26.502892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:26.503763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:26.503763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:26.503763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:26.503763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:26.503997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f224f-086a-4170-9fbf-91c95dc94cef None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:26.503997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f224f-086a-4170-9fbf-91c95dc94cef None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:26.503997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f224f-086a-4170-9fbf-91c95dc94cef None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:26.503997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f224f-086a-4170-9fbf-91c95dc94cef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:26.503997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f224f-086a-4170-9fbf-91c95dc94cef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:26.505349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f224f-086a-4170-9fbf-91c95dc94cef None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:26.506941 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 431/827] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:26.508550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a5948-a3f4-48cc-9edb-dcfeb167aae4 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:26.509043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a5948-a3f4-48cc-9edb-dcfeb167aae4 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:26.509543 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a5948-a3f4-48cc-9edb-dcfeb167aae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:26.524548 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 397/828] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:26.526249 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f224f-086a-4170-9fbf-91c95dc94cef None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:26.530784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-837a5948-a3f4-48cc-9edb-dcfeb167aae4 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:26.532683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-837a5948-a3f4-48cc-9edb-dcfeb167aae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:26.619090 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 432/829] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:26.620092 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a5948-a3f4-48cc-9edb-dcfeb167aae4 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:26.664427 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f224f-086a-4170-9fbf-91c95dc94cef None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:26.699138 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e30265-8fa1-4114-823d-79b4c96f4b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:26.699808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e30265-8fa1-4114-823d-79b4c96f4b33 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:26.700087 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e30265-8fa1-4114-823d-79b4c96f4b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:26.700358 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e30265-8fa1-4114-823d-79b4c96f4b33 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:26.701076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e30265-8fa1-4114-823d-79b4c96f4b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:26.701375 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e30265-8fa1-4114-823d-79b4c96f4b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:26.702991 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e30265-8fa1-4114-823d-79b4c96f4b33 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:26.720275 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 398/830] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:26.720275 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e30265-8fa1-4114-823d-79b4c96f4b33 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:26.722755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:26.727584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:26.734823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a5948-a3f4-48cc-9edb-dcfeb167aae4 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:26.774736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6723f56-065e-45c5-8275-20c33935f0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:26.775416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6723f56-065e-45c5-8275-20c33935f0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:26.775702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6723f56-065e-45c5-8275-20c33935f0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:26.775980 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6723f56-065e-45c5-8275-20c33935f0a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:26.776824 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6723f56-065e-45c5-8275-20c33935f0a5 None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=a99b767501244338bc48fb5428a589a1) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:26.777135 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6723f56-065e-45c5-8275-20c33935f0a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:26.778623 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6723f56-065e-45c5-8275-20c33935f0a5 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:26.793822 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 433/831] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:55:26 2022] GET /identity/v3/role_assignments?user.id=a99b767501244338bc48fb5428a589a1&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=aefba81d87bf47258c17064af7d9a05f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:26.793822 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6723f56-065e-45c5-8275-20c33935f0a5 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:26.852476 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e30265-8fa1-4114-823d-79b4c96f4b33 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:26.892864 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8db91-783d-40a3-9697-c44c292758ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:26.893704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8db91-783d-40a3-9697-c44c292758ca None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:26.894385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8db91-783d-40a3-9697-c44c292758ca None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:26.894661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8db91-783d-40a3-9697-c44c292758ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:26.897196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6723f56-065e-45c5-8275-20c33935f0a5 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:26.906423 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8db91-783d-40a3-9697-c44c292758ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:26.914146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-dfc8db91-783d-40a3-9697-c44c292758ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:55:26.914146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:26.914146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:26.914146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:26.914146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:26.914146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:26.914146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:26.914146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:26.914146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:26.914146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:26.914146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:26.914146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:26.914146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:26.914146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:26.914146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:26.914146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:26.915322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:26.915322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:26.915322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:26.915322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:26.915322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:26.915322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:26.915322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:26.915322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:26.915322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:26.915322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:26.915322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:26.915322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:26.915322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:26.915322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:26.915322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:26.915322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:26.916165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:26.916165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:26.916165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:26.916165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:26.916165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:26.916165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:26.916165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:26.916165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:26.916165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:26.916165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:26.916165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:55:26.916165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:26.916165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 399/832] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:55:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:26.916839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abb5f8-54f1-4b7f-b076-a04c65307d0e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:26.916967 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abb5f8-54f1-4b7f-b076-a04c65307d0e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:26.917245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abb5f8-54f1-4b7f-b076-a04c65307d0e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:26.918735 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 400/833] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:26.922882 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abb5f8-54f1-4b7f-b076-a04c65307d0e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:26.946019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632257f9-9a1a-4491-873b-7055a8d7accd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:26.946861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632257f9-9a1a-4491-873b-7055a8d7accd None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:26.947145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632257f9-9a1a-4491-873b-7055a8d7accd None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:26.947430 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632257f9-9a1a-4491-873b-7055a8d7accd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:26.955793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632257f9-9a1a-4491-873b-7055a8d7accd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:26.957219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632257f9-9a1a-4491-873b-7055a8d7accd None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:26.972875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-632257f9-9a1a-4491-873b-7055a8d7accd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:26.972875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:26.972875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:26.972875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:26.972875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:26.972875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:26.972875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:26.972875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:26.972875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:26.972875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:26.972875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:26.972875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:26.972875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:26.972875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:26.972875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:26.973907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:26.973907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:26.973907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:26.973907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:26.973907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:26.973907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:26.973907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:26.973907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:26.973907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:26.973907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:26.973907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:26.973907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:26.973907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:26.973907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:26.973907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:26.973907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:26.973907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:26.974803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:26.974803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:26.974803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:26.974803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:26.974803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:26.974803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:26.974803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:26.974803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:26.978977 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 434/834] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:26.980761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572fd46-25a2-498b-bbdb-6644d6683b04 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:26.980761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572fd46-25a2-498b-bbdb-6644d6683b04 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:26.980929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572fd46-25a2-498b-bbdb-6644d6683b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:26.998964 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:27.002437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0572fd46-25a2-498b-bbdb-6644d6683b04 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:27.003734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0572fd46-25a2-498b-bbdb-6644d6683b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:27.019973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:27.050113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abb5f8-54f1-4b7f-b076-a04c65307d0e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:27.079717 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 435/835] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:27.080385 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572fd46-25a2-498b-bbdb-6644d6683b04 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:27.091088 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c0910-09b1-468e-87ce-8b443b4be47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:27.092501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c0910-09b1-468e-87ce-8b443b4be47b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:27.093381 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c0910-09b1-468e-87ce-8b443b4be47b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:27.093963 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c0910-09b1-468e-87ce-8b443b4be47b None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:27.095119 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c0910-09b1-468e-87ce-8b443b4be47b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:27.096030 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c0910-09b1-468e-87ce-8b443b4be47b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:27.097949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c0910-09b1-468e-87ce-8b443b4be47b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:27.109076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 401/836] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:55:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:27.110263 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c0910-09b1-468e-87ce-8b443b4be47b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:27.185728 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572fd46-25a2-498b-bbdb-6644d6683b04 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:27.221001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1703888-f3c1-4ef6-9e22-b50e19fc6abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:27.221586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1703888-f3c1-4ef6-9e22-b50e19fc6abc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:27.221905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1703888-f3c1-4ef6-9e22-b50e19fc6abc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:27.222184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1703888-f3c1-4ef6-9e22-b50e19fc6abc None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:27.222973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1703888-f3c1-4ef6-9e22-b50e19fc6abc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:27.223284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1703888-f3c1-4ef6-9e22-b50e19fc6abc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:27.224747 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1703888-f3c1-4ef6-9e22-b50e19fc6abc None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:27.229319 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c0910-09b1-468e-87ce-8b443b4be47b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:27.239538 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 436/837] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:27.239538 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1703888-f3c1-4ef6-9e22-b50e19fc6abc None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:27.253144 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:27.270522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:27.281002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaa78c-8c04-44f3-af1e-89f85386ee04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:27.281853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaa78c-8c04-44f3-af1e-89f85386ee04 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:27.282141 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaa78c-8c04-44f3-af1e-89f85386ee04 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:27.282499 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaa78c-8c04-44f3-af1e-89f85386ee04 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:27.283160 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccaa78c-8c04-44f3-af1e-89f85386ee04 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:27.284551 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccaa78c-8c04-44f3-af1e-89f85386ee04 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:27.299017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-1ccaa78c-8c04-44f3-af1e-89f85386ee04 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 20:55:27.299017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:27.299017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:27.299017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:27.299017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:27.299017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:27.299017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:27.299017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:27.299017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 20:55:27.299017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:27.299017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:27.299017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:27.299017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:27.299017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:27.299017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:27.299017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:27.299017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:27.300074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:27.300074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:27.300074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:27.300074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:27.300074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:27.300074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:27.300074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:27.300074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:27.300074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:27.300074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:27.300074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:27.300074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:27.300074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:27.300074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:27.300074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:27.300074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:27.301678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:27.301678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:27.301678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:27.301678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:27.301678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:27.301678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:27.301678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:27.301678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:27.301678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:27.301678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:27.301678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:27.301678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:27.301678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 20:55:27.301678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:27.301678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 402/838] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:55:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:27.302522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaa78c-8c04-44f3-af1e-89f85386ee04 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:27.370146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1703888-f3c1-4ef6-9e22-b50e19fc6abc None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:27.405478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaa78c-8c04-44f3-af1e-89f85386ee04 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:27.406318 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c19ee2-27a5-4904-b7b8-f3b7295736a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:27.407456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c19ee2-27a5-4904-b7b8-f3b7295736a9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:27.408029 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c19ee2-27a5-4904-b7b8-f3b7295736a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:27.408363 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c19ee2-27a5-4904-b7b8-f3b7295736a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:27.419791 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c19ee2-27a5-4904-b7b8-f3b7295736a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:27.421607 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c19ee2-27a5-4904-b7b8-f3b7295736a9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:27.440143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-f5c19ee2-27a5-4904-b7b8-f3b7295736a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:27.440143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:27.440143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:27.440143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:27.440143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:27.440143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:27.440143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:27.440143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:27.440143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:27.440143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:27.440143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:27.440143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:27.440143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:27.440143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:27.440143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:27.441086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:27.441086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:27.441086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:27.441086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:27.441086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:27.441086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:27.441086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:27.441086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:27.441086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:27.441086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:27.441086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:27.441086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:27.441086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:27.441086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:27.441086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:27.441086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:27.441086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:27.442523 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:27.442523 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:27.442523 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:27.442523 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:27.442758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9cf9b-9d57-4633-bcaf-6428f81f4c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:27.442758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9cf9b-9d57-4633-bcaf-6428f81f4c6a None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:27.442758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9cf9b-9d57-4633-bcaf-6428f81f4c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:27.442758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9cf9b-9d57-4633-bcaf-6428f81f4c6a None admin] PATH_INFO: `/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/3953b14656774edb92da1ecdb4bbbb07/roles/6046421464dd48ea8977d7d1481bde10` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:27.446026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 437/839] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:27.446903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c19ee2-27a5-4904-b7b8-f3b7295736a9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:27.458240 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9cf9b-9d57-4633-bcaf-6428f81f4c6a None admin] RBAC: Authorizing `identity:create_grant(project_id=2c23678abd4f4dacaf35d73c5184e72e, user_id=3953b14656774edb92da1ecdb4bbbb07, role_id=6046421464dd48ea8977d7d1481bde10)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:27.459713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9cf9b-9d57-4633-bcaf-6428f81f4c6a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:27.485916 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 403/840] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:55:27 2022] PUT /identity/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/3953b14656774edb92da1ecdb4bbbb07/roles/6046421464dd48ea8977d7d1481bde10 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:55:27.485916 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9cf9b-9d57-4633-bcaf-6428f81f4c6a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:27.533506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:27.535202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:27.585744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c19ee2-27a5-4904-b7b8-f3b7295736a9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:27.611126 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9cf9b-9d57-4633-bcaf-6428f81f4c6a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:27.640164 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf62794-0c93-4d8b-a34b-212dbfef48cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:27.641425 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf62794-0c93-4d8b-a34b-212dbfef48cb None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:27.642101 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf62794-0c93-4d8b-a34b-212dbfef48cb None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:27.642736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf62794-0c93-4d8b-a34b-212dbfef48cb None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:27.644140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf62794-0c93-4d8b-a34b-212dbfef48cb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:27.644848 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf62794-0c93-4d8b-a34b-212dbfef48cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:27.647183 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf62794-0c93-4d8b-a34b-212dbfef48cb None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:27.654337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 438/841] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:55:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:27.659964 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf62794-0c93-4d8b-a34b-212dbfef48cb None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:27.660401 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9b4c4-6170-4ad3-8026-6d7eb5cd8145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:27.661127 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9b4c4-6170-4ad3-8026-6d7eb5cd8145 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:27.661405 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9b4c4-6170-4ad3-8026-6d7eb5cd8145 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:27.661685 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9b4c4-6170-4ad3-8026-6d7eb5cd8145 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:27.662476 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9b4c4-6170-4ad3-8026-6d7eb5cd8145 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:27.662787 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9b4c4-6170-4ad3-8026-6d7eb5cd8145 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:27.664222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9b4c4-6170-4ad3-8026-6d7eb5cd8145 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:27.682974 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 404/842] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:27.683979 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9b4c4-6170-4ad3-8026-6d7eb5cd8145 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:27.789879 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf62794-0c93-4d8b-a34b-212dbfef48cb None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:27.798216 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:27.801631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9b4c4-6170-4ad3-8026-6d7eb5cd8145 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:27.818579 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:27.832164 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5595c-fd90-4e52-b1a3-d63a3f050d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:27.833221 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5595c-fd90-4e52-b1a3-d63a3f050d5e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:27.833573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5595c-fd90-4e52-b1a3-d63a3f050d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:27.834086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5595c-fd90-4e52-b1a3-d63a3f050d5e None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:27.835506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5595c-fd90-4e52-b1a3-d63a3f050d5e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:27.836065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5595c-fd90-4e52-b1a3-d63a3f050d5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:27.837846 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5595c-fd90-4e52-b1a3-d63a3f050d5e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:27.840409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853195a-a88a-4194-baad-eb1e174f2539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:27.841292 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853195a-a88a-4194-baad-eb1e174f2539 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:27.841641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853195a-a88a-4194-baad-eb1e174f2539 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:27.842055 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853195a-a88a-4194-baad-eb1e174f2539 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:27.843716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 439/843] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:55:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:27.852586 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853195a-a88a-4194-baad-eb1e174f2539 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:27.854108 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853195a-a88a-4194-baad-eb1e174f2539 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:27.870162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d853195a-a88a-4194-baad-eb1e174f2539 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 20:55:27.870162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:27.870162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:27.870162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:27.870162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:27.870162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:27.870162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:27.870162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:27.870162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:27.870162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:27.870162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:27.870162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:27.870162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:27.870162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:27.870162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:27.870162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:27.871170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:27.872814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:27.872814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:27.872814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:27.872814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:27.872814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:27.872814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:27.872814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:27.872814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:27.872814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 20:55:27.872814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:27.872814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 405/844] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:55:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:27.877450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5595c-fd90-4e52-b1a3-d63a3f050d5e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:27.994897 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5595c-fd90-4e52-b1a3-d63a3f050d5e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:28.034249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da118c-130d-48eb-b55f-6d0374bb1abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:28.035366 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da118c-130d-48eb-b55f-6d0374bb1abc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:28.035883 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da118c-130d-48eb-b55f-6d0374bb1abc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:28.036407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da118c-130d-48eb-b55f-6d0374bb1abc None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:28.037468 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da118c-130d-48eb-b55f-6d0374bb1abc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:28.038082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da118c-130d-48eb-b55f-6d0374bb1abc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:28.039788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da118c-130d-48eb-b55f-6d0374bb1abc None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:28.059643 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 440/845] 10.222.0.61 () {56 vars in 1135 bytes} [Thu May 26 20:55:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:28.065961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853195a-a88a-4194-baad-eb1e174f2539 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:28.176446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853195a-a88a-4194-baad-eb1e174f2539 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:28.211371 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356049d2-efce-4182-aa11-3c98988e5596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:28.212037 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356049d2-efce-4182-aa11-3c98988e5596 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:28.212318 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356049d2-efce-4182-aa11-3c98988e5596 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:28.212589 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356049d2-efce-4182-aa11-3c98988e5596 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:28.247181 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:28.282555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356049d2-efce-4182-aa11-3c98988e5596 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:28.284850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356049d2-efce-4182-aa11-3c98988e5596 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:28.386476 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 406/846] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:55:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:55:28.392122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da118c-130d-48eb-b55f-6d0374bb1abc None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:28.444067 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:28.501199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da118c-130d-48eb-b55f-6d0374bb1abc None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:28.537637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8291e-6de6-4141-82fb-c4e14eb26c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:28.538512 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8291e-6de6-4141-82fb-c4e14eb26c4a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:28.538769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8291e-6de6-4141-82fb-c4e14eb26c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:28.539044 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8291e-6de6-4141-82fb-c4e14eb26c4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:28.550561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8291e-6de6-4141-82fb-c4e14eb26c4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:28.552122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8291e-6de6-4141-82fb-c4e14eb26c4a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:28.570624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-14d8291e-6de6-4141-82fb-c4e14eb26c4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:28.570624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:28.570624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:28.570624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:28.570624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:28.570624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:28.570624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:28.570624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:28.570624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:28.570624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:28.570624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:28.570624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:28.570624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:28.570624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:28.570624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:28.571726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:28.571726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:28.571726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:28.571726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:28.571726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:28.571726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:28.571726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:28.571726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:28.571726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:28.571726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:28.571726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:28.571726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:28.571726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:28.571726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:28.571726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:28.571726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:28.571726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:28.572867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:28.572867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:28.572867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:28.572867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:28.572867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 441/847] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:28.577993 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356049d2-efce-4182-aa11-3c98988e5596 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:28.639840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:28.682385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356049d2-efce-4182-aa11-3c98988e5596 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:28.718569 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce5b26-b45d-41c9-b34e-5f5b46f51e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:28.719420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5b26-b45d-41c9-b34e-5f5b46f51e7e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:28.719798 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5b26-b45d-41c9-b34e-5f5b46f51e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:28.720172 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5b26-b45d-41c9-b34e-5f5b46f51e7e None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:28.721002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce5b26-b45d-41c9-b34e-5f5b46f51e7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:28.721403 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce5b26-b45d-41c9-b34e-5f5b46f51e7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:28.722938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce5b26-b45d-41c9-b34e-5f5b46f51e7e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:28.737049 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 407/848] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:28.742651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8291e-6de6-4141-82fb-c4e14eb26c4a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:28.854922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:28.859637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8291e-6de6-4141-82fb-c4e14eb26c4a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:28.899870 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd156305-07c1-4d71-b3ff-9584b57c2c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:28.900711 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd156305-07c1-4d71-b3ff-9584b57c2c85 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:28.900996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd156305-07c1-4d71-b3ff-9584b57c2c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:28.901270 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd156305-07c1-4d71-b3ff-9584b57c2c85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:28.913430 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd156305-07c1-4d71-b3ff-9584b57c2c85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:28.915791 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd156305-07c1-4d71-b3ff-9584b57c2c85 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:28.931024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-dd156305-07c1-4d71-b3ff-9584b57c2c85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:28.931024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:28.931024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:28.931024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:28.931024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:28.931024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:28.931024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:28.931024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:28.931024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:28.931024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:28.931024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:28.931024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:28.931024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:28.931024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:28.931024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:28.931922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:28.931922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:28.931922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:28.931922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:28.931922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:28.931922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:28.931922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:28.931922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:28.931922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:28.931922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:28.931922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:28.931922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:28.931922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:28.931922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:28.931922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:28.931922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:28.931922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:28.933638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:28.933638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:28.933638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:28.933638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:28.933638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:28.933638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:28.933638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:28.933638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:28.933638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 442/849] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:28.939113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce5b26-b45d-41c9-b34e-5f5b46f51e7e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:29.051438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce5b26-b45d-41c9-b34e-5f5b46f51e7e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:29.071721 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03a311-9973-4be5-842c-3ca1fc0365a3 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:29.072010 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03a311-9973-4be5-842c-3ca1fc0365a3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:29.072291 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03a311-9973-4be5-842c-3ca1fc0365a3 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:29.073836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 443/850] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:29.077731 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:29.078946 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb6719-263a-4784-af4e-24d3932602ec None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:29.079059 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb6719-263a-4784-af4e-24d3932602ec None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:29.079314 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb6719-263a-4784-af4e-24d3932602ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:29.096073 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da62a6-10f1-4685-b324-07be257d0cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:29.097068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da62a6-10f1-4685-b324-07be257d0cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:29.097345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6dcb6719-263a-4784-af4e-24d3932602ec None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:29.097700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da62a6-10f1-4685-b324-07be257d0cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:29.098165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da62a6-10f1-4685-b324-07be257d0cf9 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:29.098585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6dcb6719-263a-4784-af4e-24d3932602ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:29.099399 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da62a6-10f1-4685-b324-07be257d0cf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:29.099871 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da62a6-10f1-4685-b324-07be257d0cf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:29.101676 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da62a6-10f1-4685-b324-07be257d0cf9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:29.115386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 408/851] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:29.122729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da62a6-10f1-4685-b324-07be257d0cf9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:29.192967 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 444/852] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:55:29.211926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb6719-263a-4784-af4e-24d3932602ec None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:29.255268 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da62a6-10f1-4685-b324-07be257d0cf9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:29.293939 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbda41-f3d3-4d50-b252-725772d71741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:29.295095 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbda41-f3d3-4d50-b252-725772d71741 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:29.295874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbda41-f3d3-4d50-b252-725772d71741 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:29.296345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbda41-f3d3-4d50-b252-725772d71741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:29.297411 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbda41-f3d3-4d50-b252-725772d71741 None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=57a63879ec1242d08bba1ccad6212788) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:29.297938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbda41-f3d3-4d50-b252-725772d71741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:29.299711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbda41-f3d3-4d50-b252-725772d71741 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:29.306933 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:29.307479 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 409/853] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:55:29 2022] GET /identity/v3/role_assignments?user.id=57a63879ec1242d08bba1ccad6212788&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=aefba81d87bf47258c17064af7d9a05f => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:29.319813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb6719-263a-4784-af4e-24d3932602ec None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:29.360401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7212b0-ebee-4d5b-89e4-27c61931f04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:29.361256 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7212b0-ebee-4d5b-89e4-27c61931f04c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:29.361541 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7212b0-ebee-4d5b-89e4-27c61931f04c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:29.361837 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7212b0-ebee-4d5b-89e4-27c61931f04c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:29.362516 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7212b0-ebee-4d5b-89e4-27c61931f04c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:29.363945 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7212b0-ebee-4d5b-89e4-27c61931f04c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:29.377992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-4e7212b0-ebee-4d5b-89e4-27c61931f04c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 20:55:29.377992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:29.377992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:29.377992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:29.377992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:29.377992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:29.377992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:29.377992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:29.377992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 20:55:29.377992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:29.377992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:29.377992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:29.377992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:29.377992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:29.377992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:29.377992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:29.378975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:29.378975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:29.378975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:29.378975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:29.378975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:29.378975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:29.378975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:29.378975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:29.378975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:29.378975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:29.378975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:29.378975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:29.378975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:29.378975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:29.378975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:29.378975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:29.379812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:29.379812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:29.379812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:29.379812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:29.379812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:29.379812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:29.379812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:29.379812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:29.379812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:29.379812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:29.379812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:29.379812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:29.379812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:29.379812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 20:55:29.379812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:29.379812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 445/854] 10.222.0.61 () {56 vars in 1132 bytes} [Thu May 26 20:55:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:29.387021 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbda41-f3d3-4d50-b252-725772d71741 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:29.441891 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:29.503453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbda41-f3d3-4d50-b252-725772d71741 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:29.541188 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc00111-4f0c-40e4-ab9f-b7a8fffbc7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:29.541991 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc00111-4f0c-40e4-ab9f-b7a8fffbc7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:29.542276 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc00111-4f0c-40e4-ab9f-b7a8fffbc7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:29.542552 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc00111-4f0c-40e4-ab9f-b7a8fffbc7d3 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:29.543265 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc00111-4f0c-40e4-ab9f-b7a8fffbc7d3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:29.543574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc00111-4f0c-40e4-ab9f-b7a8fffbc7d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:29.545018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc00111-4f0c-40e4-ab9f-b7a8fffbc7d3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:29.550350 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 410/855] 10.222.0.61 () {56 vars in 1126 bytes} [Thu May 26 20:55:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:29.556029 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7212b0-ebee-4d5b-89e4-27c61931f04c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:29.660768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7212b0-ebee-4d5b-89e4-27c61931f04c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:29.700392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9699db-3424-4fbf-ac5a-534429d3350d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:29.701080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9699db-3424-4fbf-ac5a-534429d3350d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:29.701364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9699db-3424-4fbf-ac5a-534429d3350d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:29.701927 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9699db-3424-4fbf-ac5a-534429d3350d None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:29.703095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9699db-3424-4fbf-ac5a-534429d3350d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:29.703436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9699db-3424-4fbf-ac5a-534429d3350d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:29.704894 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9699db-3424-4fbf-ac5a-534429d3350d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:29.710552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 446/856] 10.222.0.61 () {56 vars in 1126 bytes} [Thu May 26 20:55:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:29.859091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f56f4-1f89-408a-8159-7ae518612b08 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:29.859439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f56f4-1f89-408a-8159-7ae518612b08 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:29.859649 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f56f4-1f89-408a-8159-7ae518612b08 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:29.861377 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 411/857] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:29.867458 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dd2a4-4c9c-4238-b493-01a57c79360f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:29.867793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dd2a4-4c9c-4238-b493-01a57c79360f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:29.868048 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dd2a4-4c9c-4238-b493-01a57c79360f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:29.886053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-572dd2a4-4c9c-4238-b493-01a57c79360f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:29.887264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-572dd2a4-4c9c-4238-b493-01a57c79360f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:29.900047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:29.967466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 447/858] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:29.990781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f56f4-1f89-408a-8159-7ae518612b08 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:30.105868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f56f4-1f89-408a-8159-7ae518612b08 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:30.116452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:30.144311 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd4d63-939b-449b-85fa-7a4969adee3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:30.145127 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd4d63-939b-449b-85fa-7a4969adee3b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:30.145411 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd4d63-939b-449b-85fa-7a4969adee3b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:30.145684 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd4d63-939b-449b-85fa-7a4969adee3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:30.157438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd4d63-939b-449b-85fa-7a4969adee3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:30.165084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-04cd4d63-939b-449b-85fa-7a4969adee3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:30.165084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:30.165084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:30.165084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:30.165084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:30.165084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:30.165084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:30.165084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:30.165084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:30.165084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:30.165084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:30.165084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:30.165084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:30.165084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:30.165084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:30.165084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:30.166035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:30.166035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:30.166035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:30.166035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:30.166035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:30.166035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:30.166035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:30.166035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:30.166035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:30.166035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:30.166035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:30.166035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:30.166035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:30.166035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:30.166035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:30.166035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:30.166998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:30.166998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:30.166998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:30.166998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:30.166998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:30.166998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:30.166998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:30.166998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:30.166998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:30.166998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:30.166998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:55:30.166998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:30.166998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 412/859] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:55:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:30.175172 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dd2a4-4c9c-4238-b493-01a57c79360f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:30.237892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5c7fc-eb2e-46ed-b8fd-1f124f59d6f7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:30.238227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5c7fc-eb2e-46ed-b8fd-1f124f59d6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:30.238390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5c7fc-eb2e-46ed-b8fd-1f124f59d6f7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:30.240030 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 413/860] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:30.245152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9e97d-4777-40f6-8035-e84e012f6bf2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:30.245443 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9e97d-4777-40f6-8035-e84e012f6bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:30.245727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9e97d-4777-40f6-8035-e84e012f6bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:30.266672 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-77a9e97d-4777-40f6-8035-e84e012f6bf2 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:30.268129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-77a9e97d-4777-40f6-8035-e84e012f6bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:30.287266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dd2a4-4c9c-4238-b493-01a57c79360f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:30.323122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad1c5c-7178-4c78-82cc-dd2aeddb7d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:30.323813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad1c5c-7178-4c78-82cc-dd2aeddb7d36 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:30.324098 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad1c5c-7178-4c78-82cc-dd2aeddb7d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:30.324377 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad1c5c-7178-4c78-82cc-dd2aeddb7d36 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:30.325194 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad1c5c-7178-4c78-82cc-dd2aeddb7d36 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:30.325505 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad1c5c-7178-4c78-82cc-dd2aeddb7d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:30.327203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad1c5c-7178-4c78-82cc-dd2aeddb7d36 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:30.336326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 448/861] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:55:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:30.342391 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad1c5c-7178-4c78-82cc-dd2aeddb7d36 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:30.346152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 414/862] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:55:30.357828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:30.373908 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9e97d-4777-40f6-8035-e84e012f6bf2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:30.456407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad1c5c-7178-4c78-82cc-dd2aeddb7d36 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:30.476344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9e97d-4777-40f6-8035-e84e012f6bf2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:30.478234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:30.493876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2b79d-1c36-4ecc-b0c9-a4c02d993ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:30.494734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2b79d-1c36-4ecc-b0c9-a4c02d993ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:30.495071 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2b79d-1c36-4ecc-b0c9-a4c02d993ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:30.495443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2b79d-1c36-4ecc-b0c9-a4c02d993ca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:30.507311 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2b79d-1c36-4ecc-b0c9-a4c02d993ca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:30.508734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2b79d-1c36-4ecc-b0c9-a4c02d993ca6 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:30.516103 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5909b80-e544-4438-a671-ccbb4eadf8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:30.517214 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5909b80-e544-4438-a671-ccbb4eadf8db None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:30.517747 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5909b80-e544-4438-a671-ccbb4eadf8db None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:30.518281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5909b80-e544-4438-a671-ccbb4eadf8db None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:30.519256 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5909b80-e544-4438-a671-ccbb4eadf8db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:30.520972 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5909b80-e544-4438-a671-ccbb4eadf8db None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:30.528740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-cfe2b79d-1c36-4ecc-b0c9-a4c02d993ca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:30.528740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:30.528740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:30.528740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:30.528740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:30.528740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:30.528740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:30.528740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:30.528740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:30.528740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:30.528740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:30.528740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:30.528740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:30.528740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:30.528740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:30.530441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:30.530441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:30.530441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:30.530441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:30.530441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:30.530441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:30.530441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:30.530441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:30.530441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:30.530441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:30.530441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:30.530441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:30.530441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:30.530441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:30.530441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:30.530441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:30.530441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:30.531914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:30.531914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:30.531914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:30.531914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:30.533966 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 449/863] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:30.536313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2b79d-1c36-4ecc-b0c9-a4c02d993ca6 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:30.544130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 415/864] 10.222.0.61 () {60 vars in 1141 bytes} [Thu May 26 20:55:30 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:55:30.609327 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:30.663205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2b79d-1c36-4ecc-b0c9-a4c02d993ca6 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:30.708228 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75070ec2-bd84-4fc0-a0ce-688f6c4b5cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:30.708928 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75070ec2-bd84-4fc0-a0ce-688f6c4b5cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:30.709208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75070ec2-bd84-4fc0-a0ce-688f6c4b5cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:30.709492 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75070ec2-bd84-4fc0-a0ce-688f6c4b5cc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:30.710620 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75070ec2-bd84-4fc0-a0ce-688f6c4b5cc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:30.710930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75070ec2-bd84-4fc0-a0ce-688f6c4b5cc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:30.712362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75070ec2-bd84-4fc0-a0ce-688f6c4b5cc5 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:30.726903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 450/865] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:30.732188 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5909b80-e544-4438-a671-ccbb4eadf8db None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:30.852649 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5909b80-e544-4438-a671-ccbb4eadf8db None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:30.887393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0575d-713c-42fd-9f4f-d3b52d45e42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:30.888228 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0575d-713c-42fd-9f4f-d3b52d45e42b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:30.888513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0575d-713c-42fd-9f4f-d3b52d45e42b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:30.888788 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0575d-713c-42fd-9f4f-d3b52d45e42b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:30.897515 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0575d-713c-42fd-9f4f-d3b52d45e42b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:30.899023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0575d-713c-42fd-9f4f-d3b52d45e42b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:30.913613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-68a0575d-713c-42fd-9f4f-d3b52d45e42b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 20:55:30.913613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:30.913613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:30.913613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:30.913613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:30.913613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:30.913613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:30.913613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:30.913613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:30.913613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:30.913613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:30.913613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:30.913613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:30.913613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:30.913613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:30.913613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:30.914585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:30.916502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:30.916502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:30.916502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:30.916502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:30.916502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:30.916502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:30.916502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:30.916502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:30.916502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 20:55:30.916502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:30.916502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 416/866] 10.222.0.61 () {56 vars in 1117 bytes} [Thu May 26 20:55:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:30.920827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75070ec2-bd84-4fc0-a0ce-688f6c4b5cc5 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:31.028257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75070ec2-bd84-4fc0-a0ce-688f6c4b5cc5 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:31.045766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:31.066988 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f8ff8-0699-45f4-a47d-5a026df22a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:31.067681 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f8ff8-0699-45f4-a47d-5a026df22a56 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:31.067969 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f8ff8-0699-45f4-a47d-5a026df22a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:31.068251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f8ff8-0699-45f4-a47d-5a026df22a56 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:31.069105 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f8ff8-0699-45f4-a47d-5a026df22a56 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:31.069417 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f8ff8-0699-45f4-a47d-5a026df22a56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:31.070927 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f8ff8-0699-45f4-a47d-5a026df22a56 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:31.089366 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 451/867] 10.222.0.61 () {56 vars in 1149 bytes} [Thu May 26 20:55:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:31.097215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0575d-713c-42fd-9f4f-d3b52d45e42b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:31.122462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:31.216372 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0575d-713c-42fd-9f4f-d3b52d45e42b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:31.253850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f254ccf-e007-434d-b9cb-37384886f2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:31.254527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f254ccf-e007-434d-b9cb-37384886f2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:31.254806 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f254ccf-e007-434d-b9cb-37384886f2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:31.255080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f254ccf-e007-434d-b9cb-37384886f2e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:31.324366 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f254ccf-e007-434d-b9cb-37384886f2e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:31.325754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f254ccf-e007-434d-b9cb-37384886f2e2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:31.345127 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:31.432036 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 417/868] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:55:31 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:55:31.437602 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f8ff8-0699-45f4-a47d-5a026df22a56 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:31.549538 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f8ff8-0699-45f4-a47d-5a026df22a56 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:31.584748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f72ae-4e4c-49ae-ae34-f50d23dca715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:31.586357 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f72ae-4e4c-49ae-ae34-f50d23dca715 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:31.586839 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f72ae-4e4c-49ae-ae34-f50d23dca715 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:31.587305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f72ae-4e4c-49ae-ae34-f50d23dca715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:31.598550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f72ae-4e4c-49ae-ae34-f50d23dca715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:31.600312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f72ae-4e4c-49ae-ae34-f50d23dca715 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:31.618364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-1d3f72ae-4e4c-49ae-ae34-f50d23dca715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:31.618364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:31.618364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:31.618364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:31.618364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:31.618364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:31.618364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:31.618364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:31.618364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:31.618364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:31.618364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:31.618364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:31.618364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:31.618364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:31.618364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:31.619718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:31.619718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:31.619718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:31.619718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:31.619718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:31.619718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:31.619718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:31.619718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:31.619718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:31.619718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:31.619718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:31.619718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:31.619718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:31.619718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:31.619718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:31.619718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:31.619718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:31.620612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:31.620612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:31.620612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:31.620612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:31.622937 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 452/869] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:31.631348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f254ccf-e007-434d-b9cb-37384886f2e2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:31.699686 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060e9f8-ea13-47fd-828f-7adb2deeaff3 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:31.700042 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060e9f8-ea13-47fd-828f-7adb2deeaff3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:31.700247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060e9f8-ea13-47fd-828f-7adb2deeaff3 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:31.706169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 453/870] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:55:31.707718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feab80-7d8d-4480-9086-fe896a0f1beb None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:31.708004 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feab80-7d8d-4480-9086-fe896a0f1beb None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:31.708281 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feab80-7d8d-4480-9086-fe896a0f1beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:31.730197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-14feab80-7d8d-4480-9086-fe896a0f1beb None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:31.731665 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-14feab80-7d8d-4480-9086-fe896a0f1beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:31.735891 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f254ccf-e007-434d-b9cb-37384886f2e2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:31.758483 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:31.759358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:31.782543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69beff9a-c9fa-411a-8090-294b64fd5bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:31.783372 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beff9a-c9fa-411a-8090-294b64fd5bde None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:31.783799 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beff9a-c9fa-411a-8090-294b64fd5bde None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:31.784301 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beff9a-c9fa-411a-8090-294b64fd5bde None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:31.785295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69beff9a-c9fa-411a-8090-294b64fd5bde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:31.785670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69beff9a-c9fa-411a-8090-294b64fd5bde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:31.787232 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69beff9a-c9fa-411a-8090-294b64fd5bde None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:31.800785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 418/871] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:31.806086 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69beff9a-c9fa-411a-8090-294b64fd5bde None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:31.834495 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 454/872] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:31 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:55:31.856452 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14feab80-7d8d-4480-9086-fe896a0f1beb None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:31.922202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69beff9a-c9fa-411a-8090-294b64fd5bde None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:31.965708 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc65d01-bbeb-4796-afc4-fcefee7bd4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:31.965950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc65d01-bbeb-4796-afc4-fcefee7bd4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:31.966229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc65d01-bbeb-4796-afc4-fcefee7bd4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:31.966464 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc65d01-bbeb-4796-afc4-fcefee7bd4a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:31.974024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc65d01-bbeb-4796-afc4-fcefee7bd4a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:31.975576 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc65d01-bbeb-4796-afc4-fcefee7bd4a0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:31.990759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-acc65d01-bbeb-4796-afc4-fcefee7bd4a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:31.990759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:31.990759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:31.990759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:31.990759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:31.990759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:31.990759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:31.990759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:31.990759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:31.990759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:31.990759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:31.990759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:31.990759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:31.990759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:31.990759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:31.991707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:31.991707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:31.991707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:31.991707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:31.991707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:31.991707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:31.991707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:31.991707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:31.991707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:31.991707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:31.991707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:31.991707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:31.991707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:31.991707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:31.991707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:31.991707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:31.991707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:31.992575 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:31.992575 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:31.992575 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:31.992575 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:31.992575 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:31.992575 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:31.992575 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:31.992575 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:31.992575 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 419/873] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:31.997565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc65d01-bbeb-4796-afc4-fcefee7bd4a0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:32.006298 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14feab80-7d8d-4480-9086-fe896a0f1beb None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:32.041566 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:32.054268 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516c945-093a-44eb-895f-7de6bce803f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:32.055109 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516c945-093a-44eb-895f-7de6bce803f0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:32.055401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516c945-093a-44eb-895f-7de6bce803f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:32.055679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516c945-093a-44eb-895f-7de6bce803f0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:32.056349 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516c945-093a-44eb-895f-7de6bce803f0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:32.057761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516c945-093a-44eb-895f-7de6bce803f0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:32.070813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-8516c945-093a-44eb-895f-7de6bce803f0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:55:32.070813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:32.070813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:32.070813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:32.070813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:32.070813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:32.070813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:32.070813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:32.070813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:55:32.070813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:32.070813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:32.070813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:32.070813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:32.070813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:32.070813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:32.070813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:32.070813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:32.071901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:32.071901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:32.071901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:32.071901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:32.071901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:32.071901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:32.071901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:32.071901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:32.071901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:32.071901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:32.071901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:32.071901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:32.071901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:32.071901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:32.071901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:32.071901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:32.072729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:32.072729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:32.072729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:32.072729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:32.072729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:32.072729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:32.072729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:32.072729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:32.072729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:32.072729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:32.072729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:32.072729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:32.072729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:55:32.072729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:32.077230 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 455/874] 10.222.0.61 () {56 vars in 1126 bytes} [Thu May 26 20:55:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:32.078236 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516c945-093a-44eb-895f-7de6bce803f0 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:32.102422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:32.123102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc65d01-bbeb-4796-afc4-fcefee7bd4a0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:32.160466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e81bc5-f80e-4805-b2a7-c0992608f248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:32.161138 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e81bc5-f80e-4805-b2a7-c0992608f248 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:32.161422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e81bc5-f80e-4805-b2a7-c0992608f248 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:32.161695 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e81bc5-f80e-4805-b2a7-c0992608f248 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:32.162531 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e81bc5-f80e-4805-b2a7-c0992608f248 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:32.162838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e81bc5-f80e-4805-b2a7-c0992608f248 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:32.164400 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e81bc5-f80e-4805-b2a7-c0992608f248 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:32.177957 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 420/875] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:32.179022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb265c9f-4743-4d2d-9392-7c1ab437e461 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:32.179287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb265c9f-4743-4d2d-9392-7c1ab437e461 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:32.179585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb265c9f-4743-4d2d-9392-7c1ab437e461 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:32.180981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 421/876] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:32.185525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb265c9f-4743-4d2d-9392-7c1ab437e461 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:32.195758 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516c945-093a-44eb-895f-7de6bce803f0 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:32.230381 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847f5ae-4814-4559-8ae3-c7fe6c5fca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:32.231062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847f5ae-4814-4559-8ae3-c7fe6c5fca0e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:32.231341 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847f5ae-4814-4559-8ae3-c7fe6c5fca0e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:32.231613 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847f5ae-4814-4559-8ae3-c7fe6c5fca0e None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:32.232318 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847f5ae-4814-4559-8ae3-c7fe6c5fca0e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:32.232619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847f5ae-4814-4559-8ae3-c7fe6c5fca0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:32.234252 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847f5ae-4814-4559-8ae3-c7fe6c5fca0e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:32.239453 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 456/877] 10.222.0.61 () {56 vars in 1122 bytes} [Thu May 26 20:55:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:32.245574 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1849508-839c-4d5d-9db7-2dd73db41523 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:32.245891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1849508-839c-4d5d-9db7-2dd73db41523 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:32.246280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1849508-839c-4d5d-9db7-2dd73db41523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:32.263762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f1849508-839c-4d5d-9db7-2dd73db41523 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:32.265196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f1849508-839c-4d5d-9db7-2dd73db41523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:32.291273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:32.296744 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb265c9f-4743-4d2d-9392-7c1ab437e461 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:32.333241 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ae810-15ee-403c-b8cc-332edb272cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:32.333938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ae810-15ee-403c-b8cc-332edb272cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:32.334250 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ae810-15ee-403c-b8cc-332edb272cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:32.334486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ae810-15ee-403c-b8cc-332edb272cb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:32.335672 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ae810-15ee-403c-b8cc-332edb272cb0 None admin] RBAC: Adding query filter params (role.id=6046421464dd48ea8977d7d1481bde10, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=3953b14656774edb92da1ecdb4bbbb07) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:32.341849 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ae810-15ee-403c-b8cc-332edb272cb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:32.342017 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 457/878] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:32.342017 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1849508-839c-4d5d-9db7-2dd73db41523 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:32.342239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ae810-15ee-403c-b8cc-332edb272cb0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:32.351540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 422/879] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:55:32 2022] GET /identity/v3/role_assignments?user.id=3953b14656774edb92da1ecdb4bbbb07&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=6046421464dd48ea8977d7d1481bde10 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:32.355296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:32.360823 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ae810-15ee-403c-b8cc-332edb272cb0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:32.485264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1849508-839c-4d5d-9db7-2dd73db41523 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:32.492982 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ae810-15ee-403c-b8cc-332edb272cb0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:32.527052 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f085ccb-915a-4fed-9fbb-f4f252e380c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:32.528064 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f085ccb-915a-4fed-9fbb-f4f252e380c8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:32.528573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f085ccb-915a-4fed-9fbb-f4f252e380c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:32.529115 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f085ccb-915a-4fed-9fbb-f4f252e380c8 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:32.530356 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f085ccb-915a-4fed-9fbb-f4f252e380c8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:32.531221 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f085ccb-915a-4fed-9fbb-f4f252e380c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:32.532744 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375a6d1-1243-431d-8956-55727834e205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:32.533276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f085ccb-915a-4fed-9fbb-f4f252e380c8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:32.533558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375a6d1-1243-431d-8956-55727834e205 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:32.533933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375a6d1-1243-431d-8956-55727834e205 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:32.534291 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375a6d1-1243-431d-8956-55727834e205 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:32.535104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375a6d1-1243-431d-8956-55727834e205 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:32.536577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375a6d1-1243-431d-8956-55727834e205 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:32.540428 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 458/880] 10.222.0.61 () {56 vars in 1122 bytes} [Thu May 26 20:55:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:32.557125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 423/881] 10.222.0.61 () {60 vars in 1141 bytes} [Thu May 26 20:55:32 2022] POST /identity/v3/services => generated 269 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:55:32.957359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b262d-c583-4464-bc6c-267abee98c8c None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:32.957960 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b262d-c583-4464-bc6c-267abee98c8c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:32.957960 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b262d-c583-4464-bc6c-267abee98c8c None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:32.959524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 459/882] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:32.965560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20aa4b-4f23-48f2-bbd8-c080ba0ddb4a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:32.965891 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20aa4b-4f23-48f2-bbd8-c080ba0ddb4a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:32.966177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20aa4b-4f23-48f2-bbd8-c080ba0ddb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:32.984896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6d20aa4b-4f23-48f2-bbd8-c080ba0ddb4a None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:32.986137 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6d20aa4b-4f23-48f2-bbd8-c080ba0ddb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:33.005914 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:33.083051 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 424/883] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:33.114946 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b262d-c583-4464-bc6c-267abee98c8c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:33.226203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:33.249198 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b262d-c583-4464-bc6c-267abee98c8c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:33.285172 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b57407-98ec-46a4-9853-e73a0157d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:33.286290 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b57407-98ec-46a4-9853-e73a0157d6cc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:33.286714 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b57407-98ec-46a4-9853-e73a0157d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:33.287154 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b57407-98ec-46a4-9853-e73a0157d6cc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:33.287954 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b57407-98ec-46a4-9853-e73a0157d6cc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:33.289498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b57407-98ec-46a4-9853-e73a0157d6cc None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:33.307217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-24b57407-98ec-46a4-9853-e73a0157d6cc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 20:55:33.307217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:33.307217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:33.307217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:33.307217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:33.307217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:33.307217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:33.307217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:33.307217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 20:55:33.307217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:33.307217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:33.307217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:33.307217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:33.307217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:33.307217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:33.307217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:33.307217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:33.308432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:33.308432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:33.308432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:33.308432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:33.308432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:33.308432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:33.308432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:33.308432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:33.308432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:33.308432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:33.308432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:33.308432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:33.308432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:33.308432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:33.308432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:33.308432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:33.309308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:33.309308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:33.309308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:33.309308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:33.309308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:33.309308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:33.309308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:33.309308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:33.309308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:33.309308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:33.309308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:33.309308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:33.309308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 20:55:33.309308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:33.311851 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 460/884] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:55:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:33.317446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20aa4b-4f23-48f2-bbd8-c080ba0ddb4a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:33.471791 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20aa4b-4f23-48f2-bbd8-c080ba0ddb4a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:33.559333 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d484be-daad-4b12-9867-aed6451d4603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:33.561898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d484be-daad-4b12-9867-aed6451d4603 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:33.562514 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d484be-daad-4b12-9867-aed6451d4603 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:33.562944 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d484be-daad-4b12-9867-aed6451d4603 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:33.563800 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d484be-daad-4b12-9867-aed6451d4603 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:33.564241 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d484be-daad-4b12-9867-aed6451d4603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:33.565782 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d484be-daad-4b12-9867-aed6451d4603 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:33.575000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 425/885] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:55:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:33.586942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b57407-98ec-46a4-9853-e73a0157d6cc None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:33.753926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b57407-98ec-46a4-9853-e73a0157d6cc None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:33.789206 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab8926-eea1-4db0-adb2-426fdc9d812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:33.790116 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab8926-eea1-4db0-adb2-426fdc9d812c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:33.790393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab8926-eea1-4db0-adb2-426fdc9d812c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:33.790667 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab8926-eea1-4db0-adb2-426fdc9d812c None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:33.791402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab8926-eea1-4db0-adb2-426fdc9d812c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:33.791708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab8926-eea1-4db0-adb2-426fdc9d812c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:33.793142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab8926-eea1-4db0-adb2-426fdc9d812c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:33.799687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 461/886] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:55:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:33.805143 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d484be-daad-4b12-9867-aed6451d4603 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:33.847541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:33.910018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d484be-daad-4b12-9867-aed6451d4603 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:33.945006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c2be8-1c4f-4587-b728-ceba5036498d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:33.945683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c2be8-1c4f-4587-b728-ceba5036498d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:33.945991 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c2be8-1c4f-4587-b728-ceba5036498d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:33.946265 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c2be8-1c4f-4587-b728-ceba5036498d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:33.947057 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c2be8-1c4f-4587-b728-ceba5036498d None admin] RBAC: Adding query filter params (interface=public, service_id=3d08ff5610ca4018ab517c593d44872a, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:33.947367 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c2be8-1c4f-4587-b728-ceba5036498d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:33.948743 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c2be8-1c4f-4587-b728-ceba5036498d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:33.956910 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 426/887] 10.222.0.61 () {56 vars in 1251 bytes} [Thu May 26 20:55:33 2022] GET /identity/v3/endpoints?service_id=3d08ff5610ca4018ab517c593d44872a&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:33.962493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab8926-eea1-4db0-adb2-426fdc9d812c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:33.972329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:34.069996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab8926-eea1-4db0-adb2-426fdc9d812c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:34.107136 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a11d4-a38b-48f0-a7a5-5b8c9729c5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:34.107975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a11d4-a38b-48f0-a7a5-5b8c9729c5cf None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:34.108260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a11d4-a38b-48f0-a7a5-5b8c9729c5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:34.108575 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a11d4-a38b-48f0-a7a5-5b8c9729c5cf None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:34.109259 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a11d4-a38b-48f0-a7a5-5b8c9729c5cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:34.110690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a11d4-a38b-48f0-a7a5-5b8c9729c5cf None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:34.117239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 462/888] 10.222.0.61 () {56 vars in 1087 bytes} [Thu May 26 20:55:33 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:55:34.797945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c693c8-34d8-4bec-aece-6539e8c95a87 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:34.798534 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c693c8-34d8-4bec-aece-6539e8c95a87 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:34.798534 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c693c8-34d8-4bec-aece-6539e8c95a87 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:34.800218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 427/889] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:34.806208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f45be9-33d0-4558-bcb3-7f2a4538836b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:34.806494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f45be9-33d0-4558-bcb3-7f2a4538836b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:34.806780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f45be9-33d0-4558-bcb3-7f2a4538836b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:34.828430 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-38f45be9-33d0-4558-bcb3-7f2a4538836b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:34.829658 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-38f45be9-33d0-4558-bcb3-7f2a4538836b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:34.896333 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:34.901527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 463/890] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:34.922396 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb876-beb9-4ccf-bd46-0cf0bdb19e02 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:34.922737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb876-beb9-4ccf-bd46-0cf0bdb19e02 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:34.922945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb876-beb9-4ccf-bd46-0cf0bdb19e02 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:34.924433 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 428/891] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:34.926016 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f45be9-33d0-4558-bcb3-7f2a4538836b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:34.930898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c70b95-14a5-4366-8940-04eb00541d6a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:34.931190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c70b95-14a5-4366-8940-04eb00541d6a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:34.931459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c70b95-14a5-4366-8940-04eb00541d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:34.949527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e8c70b95-14a5-4366-8940-04eb00541d6a None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:34.950918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e8c70b95-14a5-4366-8940-04eb00541d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:35.026950 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f45be9-33d0-4558-bcb3-7f2a4538836b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:35.027757 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 429/892] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:55:35.029534 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce74cd-97bd-4bd2-98ad-99d27cfbdae8 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:35.029922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce74cd-97bd-4bd2-98ad-99d27cfbdae8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:35.030490 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce74cd-97bd-4bd2-98ad-99d27cfbdae8 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:35.036524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 430/893] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:35.038189 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ee910-a60e-4829-951a-bc25286087bb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:35.038728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ee910-a60e-4829-951a-bc25286087bb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:35.039276 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ee910-a60e-4829-951a-bc25286087bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:35.051782 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:35.058197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bf6ee910-a60e-4829-951a-bc25286087bb None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:35.061200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bf6ee910-a60e-4829-951a-bc25286087bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:35.067292 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505fa72-2de2-413a-87fd-c6084bc3ab74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:35.068132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505fa72-2de2-413a-87fd-c6084bc3ab74 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:35.068412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505fa72-2de2-413a-87fd-c6084bc3ab74 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:35.068679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505fa72-2de2-413a-87fd-c6084bc3ab74 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:35.079751 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505fa72-2de2-413a-87fd-c6084bc3ab74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:35.088531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-e505fa72-2de2-413a-87fd-c6084bc3ab74 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:55:35.088531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:35.088531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:35.088531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:35.088531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:35.088531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:35.088531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:35.088531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:35.088531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:35.088531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:35.088531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:35.088531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:35.088531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:35.088531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:35.088531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:35.088531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:35.089748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:35.089748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:35.089748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:35.089748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:35.089748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:35.089748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:35.089748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:35.089748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:35.089748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:35.089748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:35.089748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:35.089748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:35.089748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:35.089748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:35.089748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:35.089748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:35.090859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:35.090859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:35.090859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:35.090859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:35.090859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:35.090859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:35.090859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:35.090859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:35.090859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:35.090859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:35.090859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:55:35.090859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:35.093299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 464/894] 10.222.0.61 () {56 vars in 1120 bytes} [Thu May 26 20:55:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:35.094259 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505fa72-2de2-413a-87fd-c6084bc3ab74 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:35.139997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 431/895] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:35.141153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ee910-a60e-4829-951a-bc25286087bb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:35.172173 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:35.217166 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505fa72-2de2-413a-87fd-c6084bc3ab74 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:35.256292 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5ca15-67a7-40eb-8ac4-cc5f4cf28e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:35.257126 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5ca15-67a7-40eb-8ac4-cc5f4cf28e5b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:35.257407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5ca15-67a7-40eb-8ac4-cc5f4cf28e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:35.257679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5ca15-67a7-40eb-8ac4-cc5f4cf28e5b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:35.258369 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5ca15-67a7-40eb-8ac4-cc5f4cf28e5b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:35.259760 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5ca15-67a7-40eb-8ac4-cc5f4cf28e5b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:35.261908 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ee910-a60e-4829-951a-bc25286087bb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:35.272015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-b4f5ca15-67a7-40eb-8ac4-cc5f4cf28e5b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 20:55:35.272015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:35.272015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:35.272015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:35.272015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:35.272015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:35.272015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:35.272015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:35.272015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 20:55:35.272015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:35.272015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:35.272015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:35.272015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:35.272015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:35.272015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:35.272015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:35.273019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:35.273019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:35.273019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:35.273019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:35.273019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:35.273019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:35.273019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:35.273019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:35.273019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:35.273019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:35.273019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:35.273019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:35.273019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:35.273019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:35.273019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:35.273019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:35.273880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:35.273880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:35.273880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:35.273880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:35.273880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:35.273880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:35.273880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:35.273880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:35.273880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:35.273880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:35.273880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:35.273880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:35.273880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:35.273880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 20:55:35.273880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:35.273880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 465/896] 10.222.0.61 () {56 vars in 1132 bytes} [Thu May 26 20:55:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:35.274743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5ca15-67a7-40eb-8ac4-cc5f4cf28e5b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:35.302842 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e18a27-b4d3-4ef7-a954-78dd91e0b802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:35.303443 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e18a27-b4d3-4ef7-a954-78dd91e0b802 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:35.303726 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e18a27-b4d3-4ef7-a954-78dd91e0b802 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:35.304004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e18a27-b4d3-4ef7-a954-78dd91e0b802 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:35.304787 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e18a27-b4d3-4ef7-a954-78dd91e0b802 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:35.305058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e18a27-b4d3-4ef7-a954-78dd91e0b802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:35.306473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e18a27-b4d3-4ef7-a954-78dd91e0b802 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:35.309154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:35.321481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 432/897] 10.222.0.61 () {56 vars in 1115 bytes} [Thu May 26 20:55:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:35.321481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e18a27-b4d3-4ef7-a954-78dd91e0b802 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:35.382346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5ca15-67a7-40eb-8ac4-cc5f4cf28e5b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:35.410608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:35.421764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096becd4-0aec-444b-a761-769ef25150a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:35.422532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096becd4-0aec-444b-a761-769ef25150a7 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:35.422815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096becd4-0aec-444b-a761-769ef25150a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:35.423094 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096becd4-0aec-444b-a761-769ef25150a7 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:35.423825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096becd4-0aec-444b-a761-769ef25150a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:35.425225 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096becd4-0aec-444b-a761-769ef25150a7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:35.434987 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e18a27-b4d3-4ef7-a954-78dd91e0b802 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:35.441825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 466/898] 10.222.0.61 () {60 vars in 1141 bytes} [Thu May 26 20:55:35 2022] POST /identity/v3/services => generated 241 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:55:35.442637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096becd4-0aec-444b-a761-769ef25150a7 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:35.479818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a7783-259d-4f28-95aa-ccc76fe7c735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:35.480855 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a7783-259d-4f28-95aa-ccc76fe7c735 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:35.481311 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a7783-259d-4f28-95aa-ccc76fe7c735 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:35.481745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a7783-259d-4f28-95aa-ccc76fe7c735 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:35.482744 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a7783-259d-4f28-95aa-ccc76fe7c735 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:35.483219 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a7783-259d-4f28-95aa-ccc76fe7c735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:35.484787 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a7783-259d-4f28-95aa-ccc76fe7c735 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:35.495355 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 433/899] 10.222.0.61 () {56 vars in 1126 bytes} [Thu May 26 20:55:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:35.496636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a7783-259d-4f28-95aa-ccc76fe7c735 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:35.567123 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:35.594484 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096becd4-0aec-444b-a761-769ef25150a7 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:35.617749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a7783-259d-4f28-95aa-ccc76fe7c735 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:35.650134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9449ce-6714-4f93-8573-810fa6339a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:35.650966 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9449ce-6714-4f93-8573-810fa6339a3c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:35.651246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9449ce-6714-4f93-8573-810fa6339a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:35.651546 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9449ce-6714-4f93-8573-810fa6339a3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:35.665820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9449ce-6714-4f93-8573-810fa6339a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:35.667422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9449ce-6714-4f93-8573-810fa6339a3c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:35.669123 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d90f3f-17c6-416c-8b7a-3e72ca8769d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:35.669841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d90f3f-17c6-416c-8b7a-3e72ca8769d2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:35.670175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d90f3f-17c6-416c-8b7a-3e72ca8769d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:35.670497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d90f3f-17c6-416c-8b7a-3e72ca8769d2 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:35.671331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d90f3f-17c6-416c-8b7a-3e72ca8769d2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:35.671630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d90f3f-17c6-416c-8b7a-3e72ca8769d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:35.672987 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d90f3f-17c6-416c-8b7a-3e72ca8769d2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:35.681171 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 434/900] 10.222.0.61 () {56 vars in 1126 bytes} [Thu May 26 20:55:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:35.687277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-5c9449ce-6714-4f93-8573-810fa6339a3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:35.687277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:35.687277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:35.687277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:35.687277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:35.687277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:35.687277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:35.687277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:35.687277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:35.687277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:35.687277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:35.687277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:35.687277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:35.687277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:35.687277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:35.688174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:35.688174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:35.688174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:35.688174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:35.688174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:35.688174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:35.688174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:35.688174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:35.688174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:35.688174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:35.688174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:35.688174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:35.688174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:35.688174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:35.688174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:35.688174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:35.688174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:35.689130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:35.689130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:35.689130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:35.689130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:35.689365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d90f3f-17c6-416c-8b7a-3e72ca8769d2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:35.690994 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 467/901] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:35.694681 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9449ce-6714-4f93-8573-810fa6339a3c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:35.739190 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:35.816301 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9449ce-6714-4f93-8573-810fa6339a3c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:35.831301 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d90f3f-17c6-416c-8b7a-3e72ca8769d2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:35.854084 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54deabe2-ed7a-4b53-bf8a-5fbf32c2af08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:35.854929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deabe2-ed7a-4b53-bf8a-5fbf32c2af08 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:35.855305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deabe2-ed7a-4b53-bf8a-5fbf32c2af08 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:35.855668 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deabe2-ed7a-4b53-bf8a-5fbf32c2af08 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:35.856491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54deabe2-ed7a-4b53-bf8a-5fbf32c2af08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:35.856886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54deabe2-ed7a-4b53-bf8a-5fbf32c2af08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:35.858887 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54deabe2-ed7a-4b53-bf8a-5fbf32c2af08 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:35.862382 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:35.876671 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 468/902] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:35.876913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caed2b7-abde-4ed1-bec9-8cb3d939c039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:35.877562 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caed2b7-abde-4ed1-bec9-8cb3d939c039 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:35.877871 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caed2b7-abde-4ed1-bec9-8cb3d939c039 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:35.878150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caed2b7-abde-4ed1-bec9-8cb3d939c039 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:35.878298 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54deabe2-ed7a-4b53-bf8a-5fbf32c2af08 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:35.878949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caed2b7-abde-4ed1-bec9-8cb3d939c039 None admin] RBAC: Adding query filter params (interface=public, service_id=0cb5f9d47cde4ff2974e42ddfa9184f4, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:35.879259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caed2b7-abde-4ed1-bec9-8cb3d939c039 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:35.880694 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caed2b7-abde-4ed1-bec9-8cb3d939c039 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:35.888088 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 435/903] 10.222.0.61 () {56 vars in 1251 bytes} [Thu May 26 20:55:35 2022] GET /identity/v3/endpoints?service_id=0cb5f9d47cde4ff2974e42ddfa9184f4&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:35.894276 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caed2b7-abde-4ed1-bec9-8cb3d939c039 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:35.980035 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:35.987179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54deabe2-ed7a-4b53-bf8a-5fbf32c2af08 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:36.004433 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caed2b7-abde-4ed1-bec9-8cb3d939c039 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:36.023590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb87121-9bd8-48de-a234-5e30132e55bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:36.024722 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb87121-9bd8-48de-a234-5e30132e55bd None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:36.025143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb87121-9bd8-48de-a234-5e30132e55bd None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:36.025840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb87121-9bd8-48de-a234-5e30132e55bd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:36.035745 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb87121-9bd8-48de-a234-5e30132e55bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:36.038032 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb87121-9bd8-48de-a234-5e30132e55bd None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:36.044876 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f03ba0-09e2-4e04-ae43-f7fb18805517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:36.045843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f03ba0-09e2-4e04-ae43-f7fb18805517 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:36.046500 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f03ba0-09e2-4e04-ae43-f7fb18805517 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:36.046791 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f03ba0-09e2-4e04-ae43-f7fb18805517 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:36.047624 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f03ba0-09e2-4e04-ae43-f7fb18805517 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:36.049010 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f03ba0-09e2-4e04-ae43-f7fb18805517 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:36.062046 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 436/904] 10.222.0.61 () {56 vars in 1087 bytes} [Thu May 26 20:55:35 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:55:36.062818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-aeb87121-9bd8-48de-a234-5e30132e55bd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 20:55:36.062818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:36.062818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:36.062818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:36.062818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:36.062818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:36.062818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:36.062818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:36.062818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:36.062818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:36.062818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:36.062818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:36.062818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:36.062818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:36.062818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:36.062818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:36.063680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:36.064609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:36.064609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:36.064609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:36.064609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:36.064609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:36.064609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:36.064609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:36.064609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:36.064609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 20:55:36.064609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:36.065677 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 469/905] 10.222.0.61 () {56 vars in 1117 bytes} [Thu May 26 20:55:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:36.069827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f03ba0-09e2-4e04-ae43-f7fb18805517 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:36.142729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:36.190081 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f03ba0-09e2-4e04-ae43-f7fb18805517 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:36.227985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5804e9-f421-4a54-97e0-0501b1450329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:36.228721 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5804e9-f421-4a54-97e0-0501b1450329 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:36.229003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5804e9-f421-4a54-97e0-0501b1450329 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:36.229277 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5804e9-f421-4a54-97e0-0501b1450329 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:36.230176 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5804e9-f421-4a54-97e0-0501b1450329 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:36.230482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5804e9-f421-4a54-97e0-0501b1450329 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:36.231961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5804e9-f421-4a54-97e0-0501b1450329 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:36.257346 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 437/906] 10.222.0.61 () {56 vars in 1149 bytes} [Thu May 26 20:55:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:36.258886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb87121-9bd8-48de-a234-5e30132e55bd None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:36.339632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdc288-f81d-43df-b5c5-b753cdcacb54 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:36.339916 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdc288-f81d-43df-b5c5-b753cdcacb54 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:36.340192 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdc288-f81d-43df-b5c5-b753cdcacb54 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:36.341571 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 438/907] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:36.346888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17459e6-e261-487c-9dea-ffa4a005a70f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:36.347174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17459e6-e261-487c-9dea-ffa4a005a70f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:36.347450 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17459e6-e261-487c-9dea-ffa4a005a70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:36.368408 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c17459e6-e261-487c-9dea-ffa4a005a70f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:36.370264 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c17459e6-e261-487c-9dea-ffa4a005a70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:36.372824 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb87121-9bd8-48de-a234-5e30132e55bd None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:36.416633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ff8be-565c-4061-a2db-6497b16a3e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:36.417218 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ff8be-565c-4061-a2db-6497b16a3e9a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:36.417500 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ff8be-565c-4061-a2db-6497b16a3e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:36.417776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ff8be-565c-4061-a2db-6497b16a3e9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:36.452021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:36.454401 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 439/908] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:55:36.477355 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17459e6-e261-487c-9dea-ffa4a005a70f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:36.508232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ff8be-565c-4061-a2db-6497b16a3e9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:36.510174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ff8be-565c-4061-a2db-6497b16a3e9a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:36.520658 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:36.595928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17459e6-e261-487c-9dea-ffa4a005a70f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:36.633505 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 470/909] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:55:36 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:55:36.634790 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ff8be-565c-4061-a2db-6497b16a3e9a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:36.637300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba878a8-762c-4b6a-9d9a-f2061adce881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:36.638160 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba878a8-762c-4b6a-9d9a-f2061adce881 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:36.638441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba878a8-762c-4b6a-9d9a-f2061adce881 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:36.638713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba878a8-762c-4b6a-9d9a-f2061adce881 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:36.639423 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba878a8-762c-4b6a-9d9a-f2061adce881 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:36.640797 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba878a8-762c-4b6a-9d9a-f2061adce881 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:36.653304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-5ba878a8-762c-4b6a-9d9a-f2061adce881 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 20:55:36.653304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:36.653304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:36.653304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:36.653304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:36.653304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:36.653304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:36.653304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:36.653304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 20:55:36.653304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:36.653304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:36.653304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:36.653304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:36.653304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:36.653304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:36.653304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:36.653304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:36.655740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:36.655740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:36.655740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:36.655740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:36.655740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:36.655740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:36.655740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:36.655740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:36.655740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:36.655740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:36.655740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:36.655740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:36.655740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:36.655740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:36.655740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:36.655740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:36.657670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:36.657670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:36.657670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:36.657670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:36.657670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:36.657670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:36.657670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:36.657670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:36.657670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:36.657670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:36.657670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:36.657670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:36.657670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 20:55:36.657670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:36.659400 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 440/910] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:55:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:36.665829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba878a8-762c-4b6a-9d9a-f2061adce881 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:36.703425 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:36.758535 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ff8be-565c-4061-a2db-6497b16a3e9a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:36.790288 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba878a8-762c-4b6a-9d9a-f2061adce881 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:36.791996 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:36.814497 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367709b-281e-45ea-a3dc-f356217352c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:36.815302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367709b-281e-45ea-a3dc-f356217352c8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:36.815581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367709b-281e-45ea-a3dc-f356217352c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:36.815822 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367709b-281e-45ea-a3dc-f356217352c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:36.835162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367709b-281e-45ea-a3dc-f356217352c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:36.836295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62060851-4407-4236-af8a-5f88839f1008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:36.836977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62060851-4407-4236-af8a-5f88839f1008 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:36.837256 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62060851-4407-4236-af8a-5f88839f1008 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:36.837530 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62060851-4407-4236-af8a-5f88839f1008 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:36.838277 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62060851-4407-4236-af8a-5f88839f1008 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:36.838582 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62060851-4407-4236-af8a-5f88839f1008 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:36.838683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367709b-281e-45ea-a3dc-f356217352c8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:36.839944 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62060851-4407-4236-af8a-5f88839f1008 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:36.850328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 441/911] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:55:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:36.852409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62060851-4407-4236-af8a-5f88839f1008 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:36.863313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-0367709b-281e-45ea-a3dc-f356217352c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:36.863313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:36.863313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:36.863313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:36.863313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:36.863313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:36.863313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:36.863313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:36.863313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:36.863313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:36.863313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:36.863313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:36.863313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:36.863313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:36.863313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:36.864273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:36.864273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:36.864273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:36.864273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:36.864273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:36.864273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:36.864273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:36.864273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:36.864273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:36.864273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:36.864273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:36.864273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:36.864273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:36.864273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:36.864273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:36.864273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:36.864273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:36.865140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:36.865140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:36.865140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:36.865140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:36.865140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 471/912] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:36.871630 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367709b-281e-45ea-a3dc-f356217352c8 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:36.975444 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367709b-281e-45ea-a3dc-f356217352c8 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:36.984786 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62060851-4407-4236-af8a-5f88839f1008 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:36.987745 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:37.020567 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752592ba-b342-491c-8468-f27651d29677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:37.021599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752592ba-b342-491c-8468-f27651d29677 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:37.022052 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752592ba-b342-491c-8468-f27651d29677 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:37.022270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f1dcf-1612-4716-a0a5-775b7660b218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:37.022644 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752592ba-b342-491c-8468-f27651d29677 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:37.023146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f1dcf-1612-4716-a0a5-775b7660b218 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:37.023511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f1dcf-1612-4716-a0a5-775b7660b218 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:37.023819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752592ba-b342-491c-8468-f27651d29677 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:37.023933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f1dcf-1612-4716-a0a5-775b7660b218 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:37.024362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752592ba-b342-491c-8468-f27651d29677 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:37.024820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f1dcf-1612-4716-a0a5-775b7660b218 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:37.025212 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f1dcf-1612-4716-a0a5-775b7660b218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:37.026266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752592ba-b342-491c-8468-f27651d29677 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:37.026783 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f1dcf-1612-4716-a0a5-775b7660b218 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:37.036884 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 442/913] 10.222.0.61 () {56 vars in 1114 bytes} [Thu May 26 20:55:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:37.038163 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f1dcf-1612-4716-a0a5-775b7660b218 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:37.044557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 472/914] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:37.053288 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752592ba-b342-491c-8468-f27651d29677 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:37.075320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:37.158625 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f1dcf-1612-4716-a0a5-775b7660b218 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:37.180662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752592ba-b342-491c-8468-f27651d29677 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:37.199611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a195f2-2e9b-4969-b8f5-af9a32a28472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:37.200616 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a195f2-2e9b-4969-b8f5-af9a32a28472 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:37.201081 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a195f2-2e9b-4969-b8f5-af9a32a28472 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:37.201684 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a195f2-2e9b-4969-b8f5-af9a32a28472 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:37.202758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a195f2-2e9b-4969-b8f5-af9a32a28472 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:37.204368 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a195f2-2e9b-4969-b8f5-af9a32a28472 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:37.224598 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e3391-f216-4e40-8ac9-0370299ce7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:37.225550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e3391-f216-4e40-8ac9-0370299ce7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:37.225773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e3391-f216-4e40-8ac9-0370299ce7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:37.226130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e3391-f216-4e40-8ac9-0370299ce7c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:37.231216 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 443/915] 10.222.0.61 () {60 vars in 1144 bytes} [Thu May 26 20:55:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:55:37.244801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e3391-f216-4e40-8ac9-0370299ce7c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:37.246945 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e3391-f216-4e40-8ac9-0370299ce7c2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:37.264362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-ff4e3391-f216-4e40-8ac9-0370299ce7c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:37.264362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:37.264362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:37.264362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:37.264362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:37.264362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:37.264362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:37.264362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:37.264362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:37.264362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:37.264362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:37.264362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:37.264362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:37.264362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:37.264362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:37.265319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:37.265319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:37.265319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:37.265319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:37.265319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:37.265319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:37.265319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:37.265319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:37.265319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:37.265319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:37.265319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:37.265319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:37.265319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:37.265319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:37.265319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:37.265319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:37.265319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:37.266666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:37.266666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:37.266666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:37.266666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:37.266666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:37.266666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:37.266666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:37.266666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:37.273938 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 473/916] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:37.275785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a195f2-2e9b-4969-b8f5-af9a32a28472 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:37.386240 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:37.402910 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a195f2-2e9b-4969-b8f5-af9a32a28472 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:37.442595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a259e6b-b200-4a82-9931-86e0f82d2670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:37.443523 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a259e6b-b200-4a82-9931-86e0f82d2670 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:37.443953 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a259e6b-b200-4a82-9931-86e0f82d2670 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:37.444227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a259e6b-b200-4a82-9931-86e0f82d2670 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:37.445024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a259e6b-b200-4a82-9931-86e0f82d2670 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:37.445329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a259e6b-b200-4a82-9931-86e0f82d2670 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:37.446920 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a259e6b-b200-4a82-9931-86e0f82d2670 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:37.469108 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 444/917] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:37.470555 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e3391-f216-4e40-8ac9-0370299ce7c2 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:37.503662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:37.578603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e3391-f216-4e40-8ac9-0370299ce7c2 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:37.617699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d9f67-386c-4ed9-a55a-11191a55b6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:37.618444 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d9f67-386c-4ed9-a55a-11191a55b6dc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:37.618722 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d9f67-386c-4ed9-a55a-11191a55b6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:37.618992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d9f67-386c-4ed9-a55a-11191a55b6dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:37.619871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d9f67-386c-4ed9-a55a-11191a55b6dc None admin] RBAC: Adding query filter params (role.id=043685c168c24e0f890ef4479ad74e90, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=3953b14656774edb92da1ecdb4bbbb07) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:37.620174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d9f67-386c-4ed9-a55a-11191a55b6dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:37.621697 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d9f67-386c-4ed9-a55a-11191a55b6dc None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:37.634006 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 474/918] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:55:37 2022] GET /identity/v3/role_assignments?user.id=3953b14656774edb92da1ecdb4bbbb07&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=043685c168c24e0f890ef4479ad74e90 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:37.804398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a3f6e-0d7a-4baf-9bdb-28845c8e136f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:37.804742 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a3f6e-0d7a-4baf-9bdb-28845c8e136f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:37.804969 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a3f6e-0d7a-4baf-9bdb-28845c8e136f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:37.806735 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 445/919] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:37.813259 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665d421-cb2a-4dc4-a2d9-ee76ff5b08d3 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:37.813544 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665d421-cb2a-4dc4-a2d9-ee76ff5b08d3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:37.813858 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665d421-cb2a-4dc4-a2d9-ee76ff5b08d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:37.831111 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1665d421-cb2a-4dc4-a2d9-ee76ff5b08d3 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:37.832316 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1665d421-cb2a-4dc4-a2d9-ee76ff5b08d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:37.903496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 475/920] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:37.926746 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a3f6e-0d7a-4baf-9bdb-28845c8e136f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:38.034934 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a3f6e-0d7a-4baf-9bdb-28845c8e136f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:38.070785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f81339-ac29-4f3e-9771-5fb16b7b4ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:38.071862 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81339-ac29-4f3e-9771-5fb16b7b4ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:38.072307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81339-ac29-4f3e-9771-5fb16b7b4ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:38.072716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81339-ac29-4f3e-9771-5fb16b7b4ea6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:38.073525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f81339-ac29-4f3e-9771-5fb16b7b4ea6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:38.075083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f81339-ac29-4f3e-9771-5fb16b7b4ea6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:38.088074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b4f81339-ac29-4f3e-9771-5fb16b7b4ea6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:55:38.088074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:38.088074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:38.088074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:38.088074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:38.088074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:38.088074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:38.088074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:38.088074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:55:38.088074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:38.088074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:38.088074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:38.088074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:38.088074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:38.088074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:38.088074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:38.088074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:38.089287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:38.089287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:38.089287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:38.089287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:38.089287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:38.089287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:38.089287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:38.089287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:38.089287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:38.089287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:38.089287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:38.089287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:38.089287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:38.089287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:38.089287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:38.089287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:38.090345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:38.090345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:38.090345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:38.090345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:38.090345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:38.090345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:38.090345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:38.090345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:38.090345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:38.090345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:38.090345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:38.090345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:38.090345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:55:38.090345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:38.092870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 446/921] 10.222.0.61 () {56 vars in 1126 bytes} [Thu May 26 20:55:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:38.098802 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665d421-cb2a-4dc4-a2d9-ee76ff5b08d3 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:38.125004 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:38.208551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665d421-cb2a-4dc4-a2d9-ee76ff5b08d3 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:38.244271 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17f5ce-929c-47a8-8205-393f7f09efd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:38.244951 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17f5ce-929c-47a8-8205-393f7f09efd7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:38.245230 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17f5ce-929c-47a8-8205-393f7f09efd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:38.245502 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17f5ce-929c-47a8-8205-393f7f09efd7 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:38.246241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17f5ce-929c-47a8-8205-393f7f09efd7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:38.246543 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17f5ce-929c-47a8-8205-393f7f09efd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:38.247940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17f5ce-929c-47a8-8205-393f7f09efd7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:38.253247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 476/922] 10.222.0.61 () {56 vars in 1122 bytes} [Thu May 26 20:55:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:38.258687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f81339-ac29-4f3e-9771-5fb16b7b4ea6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:38.269763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:38.343208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a86e04-adaf-4dc1-b3a3-26aeb7cf207a None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:38.343424 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a86e04-adaf-4dc1-b3a3-26aeb7cf207a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:38.343785 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a86e04-adaf-4dc1-b3a3-26aeb7cf207a None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:38.345587 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 477/923] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:38.351034 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dd93f-f4a5-4a55-8970-542299cbdc4e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:38.351328 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dd93f-f4a5-4a55-8970-542299cbdc4e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:38.351615 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dd93f-f4a5-4a55-8970-542299cbdc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:38.367465 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f81339-ac29-4f3e-9771-5fb16b7b4ea6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:38.369285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3d4dd93f-f4a5-4a55-8970-542299cbdc4e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:38.370647 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3d4dd93f-f4a5-4a55-8970-542299cbdc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:38.405152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefd85a-061d-4cd0-8531-a27fba63b6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:38.405860 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefd85a-061d-4cd0-8531-a27fba63b6ef None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:38.406150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefd85a-061d-4cd0-8531-a27fba63b6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:38.406428 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefd85a-061d-4cd0-8531-a27fba63b6ef None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:38.407178 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefd85a-061d-4cd0-8531-a27fba63b6ef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:38.407448 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefd85a-061d-4cd0-8531-a27fba63b6ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:38.408960 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefd85a-061d-4cd0-8531-a27fba63b6ef None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:38.417947 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 447/924] 10.222.0.61 () {56 vars in 1122 bytes} [Thu May 26 20:55:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:38.421275 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefd85a-061d-4cd0-8531-a27fba63b6ef None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:38.466143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 478/925] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:38.483364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dd93f-f4a5-4a55-8970-542299cbdc4e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:38.506059 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:38.508506 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:38.557613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefd85a-061d-4cd0-8531-a27fba63b6ef None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:38.603083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764deb4-42d2-4d6b-aafc-24f793970899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:38.603677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764deb4-42d2-4d6b-aafc-24f793970899 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:38.603957 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764deb4-42d2-4d6b-aafc-24f793970899 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:38.604484 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764deb4-42d2-4d6b-aafc-24f793970899 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:38.605031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764deb4-42d2-4d6b-aafc-24f793970899 None admin] RBAC: Adding query filter params (interface=public, service_id=de6413316f964b21b7ece975b8287cb5, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:38.605344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764deb4-42d2-4d6b-aafc-24f793970899 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:38.606777 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764deb4-42d2-4d6b-aafc-24f793970899 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:38.612956 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 448/926] 10.222.0.61 () {56 vars in 1251 bytes} [Thu May 26 20:55:38 2022] GET /identity/v3/endpoints?service_id=de6413316f964b21b7ece975b8287cb5&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:38.616937 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dd93f-f4a5-4a55-8970-542299cbdc4e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:38.620204 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764deb4-42d2-4d6b-aafc-24f793970899 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:38.662179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f6896-75bc-484e-a779-a1473675119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:38.663310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f6896-75bc-484e-a779-a1473675119e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:38.663741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f6896-75bc-484e-a779-a1473675119e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:38.664153 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f6896-75bc-484e-a779-a1473675119e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:38.665438 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f6896-75bc-484e-a779-a1473675119e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:38.667390 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f6896-75bc-484e-a779-a1473675119e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:38.683442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-265f6896-75bc-484e-a779-a1473675119e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 20:55:38.683442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:38.683442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:38.683442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:38.683442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:38.683442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:38.683442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:38.683442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:38.683442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 20:55:38.683442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:38.683442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:38.683442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:38.683442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:38.683442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:38.683442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:38.683442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:38.684629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:38.684629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:38.684629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:38.684629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:38.684629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:38.684629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:38.684629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:38.684629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:38.684629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:38.684629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:38.684629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:38.684629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:38.684629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:38.684629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:38.684629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:38.684629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:38.685847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:38.685847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:38.685847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:38.685847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:38.685847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:38.685847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:38.685847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:38.685847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:38.685847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:38.685847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:38.685847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:38.685847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:38.685847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:38.685847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 20:55:38.685847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:38.689363 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 479/927] 10.222.0.61 () {56 vars in 1132 bytes} [Thu May 26 20:55:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:38.694895 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f6896-75bc-484e-a779-a1473675119e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:38.735036 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764deb4-42d2-4d6b-aafc-24f793970899 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:38.788200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c4d13-b05e-4039-a991-391e90d9c5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:38.788885 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c4d13-b05e-4039-a991-391e90d9c5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:38.789168 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c4d13-b05e-4039-a991-391e90d9c5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:38.789441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c4d13-b05e-4039-a991-391e90d9c5f8 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:38.790358 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c4d13-b05e-4039-a991-391e90d9c5f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:38.791601 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c4d13-b05e-4039-a991-391e90d9c5f8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:38.798153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:38.801733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 449/928] 10.222.0.61 () {56 vars in 1087 bytes} [Thu May 26 20:55:38 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:55:38.807510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:38.836639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f6896-75bc-484e-a779-a1473675119e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:38.875586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4386c6-ebc6-40fd-b5e7-2ddbc34496af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:38.876375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4386c6-ebc6-40fd-b5e7-2ddbc34496af None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:38.876745 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4386c6-ebc6-40fd-b5e7-2ddbc34496af None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:38.877122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4386c6-ebc6-40fd-b5e7-2ddbc34496af None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:38.877977 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4386c6-ebc6-40fd-b5e7-2ddbc34496af None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:38.878380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4386c6-ebc6-40fd-b5e7-2ddbc34496af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:38.879895 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4386c6-ebc6-40fd-b5e7-2ddbc34496af None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:38.886278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 480/929] 10.222.0.61 () {56 vars in 1126 bytes} [Thu May 26 20:55:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:38.891973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c4d13-b05e-4039-a991-391e90d9c5f8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:39.012699 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c4d13-b05e-4039-a991-391e90d9c5f8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:39.049746 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c2f25-2cbb-42b3-837d-2e8eb6cd6d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:39.050869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c2f25-2cbb-42b3-837d-2e8eb6cd6d9a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:39.051342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c2f25-2cbb-42b3-837d-2e8eb6cd6d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:39.051805 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c2f25-2cbb-42b3-837d-2e8eb6cd6d9a None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:39.052749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c2f25-2cbb-42b3-837d-2e8eb6cd6d9a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:39.053240 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c2f25-2cbb-42b3-837d-2e8eb6cd6d9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:39.054840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c2f25-2cbb-42b3-837d-2e8eb6cd6d9a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:39.060820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 450/930] 10.222.0.61 () {56 vars in 1126 bytes} [Thu May 26 20:55:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:39.066308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4386c6-ebc6-40fd-b5e7-2ddbc34496af None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:39.168786 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4386c6-ebc6-40fd-b5e7-2ddbc34496af None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:39.203449 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51d6bd-4f30-48b0-b3f4-37f9413f5688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:39.204130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51d6bd-4f30-48b0-b3f4-37f9413f5688 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:39.204415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51d6bd-4f30-48b0-b3f4-37f9413f5688 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:39.204695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51d6bd-4f30-48b0-b3f4-37f9413f5688 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:39.205458 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51d6bd-4f30-48b0-b3f4-37f9413f5688 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:39.207095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51d6bd-4f30-48b0-b3f4-37f9413f5688 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:39.225045 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:39.231803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 481/931] 10.222.0.61 () {60 vars in 1144 bytes} [Thu May 26 20:55:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:55:39.666081 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5cbe6-2ed7-4af9-a5e1-27ebfd5d7ae2 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:39.666470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5cbe6-2ed7-4af9-a5e1-27ebfd5d7ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:39.666645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5cbe6-2ed7-4af9-a5e1-27ebfd5d7ae2 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:39.668247 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 451/932] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:39.674075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f64140-972d-4374-8093-2a8044deab6f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:39.674367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f64140-972d-4374-8093-2a8044deab6f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:39.674649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f64140-972d-4374-8093-2a8044deab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:39.691911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-66f64140-972d-4374-8093-2a8044deab6f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:39.693096 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-66f64140-972d-4374-8093-2a8044deab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:39.779409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 482/933] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:39.802913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5cbe6-2ed7-4af9-a5e1-27ebfd5d7ae2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:39.873940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:39.915320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5cbe6-2ed7-4af9-a5e1-27ebfd5d7ae2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:39.924065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140deb38-7c83-4dde-a94e-c208a17b33e9 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:39.924705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140deb38-7c83-4dde-a94e-c208a17b33e9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:39.925188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140deb38-7c83-4dde-a94e-c208a17b33e9 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:39.927153 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 483/934] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:55:39.932271 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac650d-0d29-46db-aedb-f5efe0e7f4dd None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:39.932772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac650d-0d29-46db-aedb-f5efe0e7f4dd None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:39.933318 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac650d-0d29-46db-aedb-f5efe0e7f4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:39.950454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00135b-c028-4636-a1d5-0150549fac47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:39.951160 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00135b-c028-4636-a1d5-0150549fac47 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:39.951489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00135b-c028-4636-a1d5-0150549fac47 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:39.951767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00135b-c028-4636-a1d5-0150549fac47 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:39.952482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00135b-c028-4636-a1d5-0150549fac47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:39.954000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00135b-c028-4636-a1d5-0150549fac47 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:39.954871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f9ac650d-0d29-46db-aedb-f5efe0e7f4dd None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:39.955434 dv-cinder-828806-3-smb devstack@keystone.service[80323]: WARNING keystone.server.flask.common [None req-af00135b-c028-4636-a1d5-0150549fac47 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 20:55:39.956635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f9ac650d-0d29-46db-aedb-f5efe0e7f4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:39.978107 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.sql.core [None req-af00135b-c028-4636-a1d5-0150549fac47 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 20:55:39.978107 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 20:55:39.978107 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [parameters: {'id': 'ac69886bcda84cf2bc0e73d92ae52682', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 20:55:39.978107 dv-cinder-828806-3-smb devstack@keystone.service[80323]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80323) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 20:55:40.000729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-af00135b-c028-4636-a1d5-0150549fac47 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac69886bcda84cf2bc0e73d92ae52682.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac69886bcda84cf2bc0e73d92ae52682. May 26 20:55:40.000729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:40.000729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 20:55:40.000729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 20:55:40.000729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 20:55:40.000729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 20:55:40.000729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 20:55:40.000729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application result = self._query(query) May 26 20:55:40.000729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 20:55:40.000729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application conn.query(q) May 26 20:55:40.000729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 20:55:40.000729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 20:55:40.000729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application result.read() May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 20:55:40.001619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 20:55:40.002984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 20:55:40.002984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application next(self.gen) May 26 20:55:40.002984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 20:55:40.002984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application yield resource May 26 20:55:40.002984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 20:55:40.002984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application next(self.gen) May 26 20:55:40.002984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 20:55:40.002984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.session.rollback() May 26 20:55:40.002984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 20:55:40.002984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.force_reraise() May 26 20:55:40.002984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 20:55:40.002984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise self.value May 26 20:55:40.002984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 20:55:40.002984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 20:55:40.002984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 20:55:40.002984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application session.commit() May 26 20:55:40.002984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 20:55:40.003872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 20:55:40.003872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 20:55:40.003872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._prepare_impl() May 26 20:55:40.003872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 20:55:40.003872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.session.flush() May 26 20:55:40.003872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 20:55:40.003872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._flush(objects) May 26 20:55:40.003872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 20:55:40.003872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 20:55:40.003872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 20:55:40.003872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application compat.raise_( May 26 20:55:40.003872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 20:55:40.003872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception May 26 20:55:40.003872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 20:55:40.003872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application flush_context.execute() May 26 20:55:40.003872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 20:55:40.003872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rec.execute(self) May 26 20:55:40.004810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 20:55:40.004810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 20:55:40.004810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 20:55:40.004810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 20:55:40.004810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 20:55:40.004810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 20:55:40.004810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 20:55:40.004810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 20:55:40.004810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 20:55:40.004810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 20:55:40.004810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 20:55:40.004810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 20:55:40.004810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 20:55:40.004810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 20:55:40.004810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 20:55:40.005581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 20:55:40.005581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 20:55:40.005581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception May 26 20:55:40.005581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 20:55:40.005581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 20:55:40.005581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 20:55:40.005581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 20:55:40.005581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 20:55:40.005581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application result = self._query(query) May 26 20:55:40.005581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 20:55:40.005581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application conn.query(q) May 26 20:55:40.005581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 20:55:40.005581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 20:55:40.005581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 20:55:40.005581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application result.read() May 26 20:55:40.005581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 20:55:40.005581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 20:55:40.006472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 20:55:40.006472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 20:55:40.006472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 20:55:40.006472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 20:55:40.006472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 20:55:40.006472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 20:55:40.006472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 20:55:40.006472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 20:55:40.006472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [parameters: {'id': 'ac69886bcda84cf2bc0e73d92ae52682', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 20:55:40.006472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 20:55:40.006472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:40.006472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:40.006472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:40.006472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:40.006472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 20:55:40.009018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 20:55:40.009018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 20:55:40.009018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 20:55:40.009018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 20:55:40.009018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:40.009018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:40.009018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:40.009018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:40.009018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:40.009018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:40.009018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:40.009018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:40.009018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:40.009018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:40.009018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:40.009018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:40.009018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:40.011261 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:40.011261 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 20:55:40.011261 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 20:55:40.011261 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:40.011261 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:40.011261 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 20:55:40.011261 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 20:55:40.011261 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac69886bcda84cf2bc0e73d92ae52682. May 26 20:55:40.011261 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:40.011261 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 452/935] 10.222.0.61 () {60 vars in 1140 bytes} [Thu May 26 20:55:39 2022] POST /identity/v3/projects => generated 262 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:40.012617 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00135b-c028-4636-a1d5-0150549fac47 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:40.049903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 484/936] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:40.070010 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac650d-0d29-46db-aedb-f5efe0e7f4dd None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:40.120398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00135b-c028-4636-a1d5-0150549fac47 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:40.130638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:40.150355 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:40.158966 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2a999-8bbc-41f6-a384-2fce6fcfbb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:40.159913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2a999-8bbc-41f6-a384-2fce6fcfbb29 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:40.160133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2a999-8bbc-41f6-a384-2fce6fcfbb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:40.160406 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2a999-8bbc-41f6-a384-2fce6fcfbb29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:40.167965 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2a999-8bbc-41f6-a384-2fce6fcfbb29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:40.169343 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2a999-8bbc-41f6-a384-2fce6fcfbb29 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:40.180493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac650d-0d29-46db-aedb-f5efe0e7f4dd None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:40.184056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-aac2a999-8bbc-41f6-a384-2fce6fcfbb29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:40.184056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:40.184056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:40.184056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:40.184056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:40.184056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:40.184056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:40.184056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:40.184056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:40.184056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:40.184056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:40.184056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:40.184056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:40.184056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:40.184056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:40.184917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:40.184917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:40.184917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:40.184917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:40.184917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:40.184917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:40.184917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:40.184917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:40.184917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:40.184917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:40.184917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:40.184917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:40.184917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:40.184917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:40.184917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:40.184917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:40.184917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:40.185961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:40.185961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:40.185961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:40.185961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:40.185961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:40.185961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:40.185961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:40.185961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:40.185961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 453/937] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:40.191630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2a999-8bbc-41f6-a384-2fce6fcfbb29 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:40.220462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f16953-9fa5-43af-a223-903b3348f18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:40.221645 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f16953-9fa5-43af-a223-903b3348f18b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:40.222146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f16953-9fa5-43af-a223-903b3348f18b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:40.222607 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f16953-9fa5-43af-a223-903b3348f18b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:40.234316 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f16953-9fa5-43af-a223-903b3348f18b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:40.242890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-54f16953-9fa5-43af-a223-903b3348f18b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:55:40.242890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:40.242890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:40.242890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:40.242890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:40.242890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:40.242890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:40.242890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:40.242890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:40.242890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:40.242890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:40.242890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:40.242890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:40.242890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:40.242890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:40.242890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:40.243775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:40.243775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:40.243775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:40.243775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:40.243775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:40.243775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:40.243775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:40.243775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:40.243775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:40.243775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:40.243775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:40.243775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:40.243775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:40.243775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:40.243775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:40.243775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:40.244590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:40.244590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:40.244590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:40.244590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:40.244590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:40.244590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:40.244590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:40.244590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:40.244590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:40.244590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:40.244590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:55:40.244590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:40.250120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 485/938] 10.222.0.61 () {56 vars in 1120 bytes} [Thu May 26 20:55:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:40.254205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f16953-9fa5-43af-a223-903b3348f18b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:40.322202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2a999-8bbc-41f6-a384-2fce6fcfbb29 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:40.359000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b272bee-132c-4151-b0fd-3343c1358180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:40.360094 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b272bee-132c-4151-b0fd-3343c1358180 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:40.360577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b272bee-132c-4151-b0fd-3343c1358180 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:40.361050 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b272bee-132c-4151-b0fd-3343c1358180 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:40.362033 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b272bee-132c-4151-b0fd-3343c1358180 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:40.362549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b272bee-132c-4151-b0fd-3343c1358180 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:40.364230 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b272bee-132c-4151-b0fd-3343c1358180 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:40.373495 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f16953-9fa5-43af-a223-903b3348f18b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:40.391570 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 454/939] 10.222.0.61 () {56 vars in 1112 bytes} [Thu May 26 20:55:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:40.392594 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:40.417074 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b355ef-4dc1-4ed2-80d8-1383d60f444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:40.417818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b355ef-4dc1-4ed2-80d8-1383d60f444e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:40.418115 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b355ef-4dc1-4ed2-80d8-1383d60f444e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:40.418391 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b355ef-4dc1-4ed2-80d8-1383d60f444e None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:40.419199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b355ef-4dc1-4ed2-80d8-1383d60f444e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:40.419508 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b355ef-4dc1-4ed2-80d8-1383d60f444e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:40.421071 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b355ef-4dc1-4ed2-80d8-1383d60f444e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:40.431869 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 486/940] 10.222.0.61 () {56 vars in 1115 bytes} [Thu May 26 20:55:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:40.437866 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b272bee-132c-4151-b0fd-3343c1358180 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:40.489897 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:40.561591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b272bee-132c-4151-b0fd-3343c1358180 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:40.599345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b0ffa-3620-4d64-8ed2-dc1a45c6661b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:40.600177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b0ffa-3620-4d64-8ed2-dc1a45c6661b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:40.600462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b0ffa-3620-4d64-8ed2-dc1a45c6661b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:40.600745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b0ffa-3620-4d64-8ed2-dc1a45c6661b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:40.612120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b0ffa-3620-4d64-8ed2-dc1a45c6661b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:40.613607 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b0ffa-3620-4d64-8ed2-dc1a45c6661b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:40.632068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d34b0ffa-3620-4d64-8ed2-dc1a45c6661b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:40.632068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:40.632068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:40.632068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:40.632068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:40.632068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:40.632068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:40.632068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:40.632068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:40.632068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:40.632068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:40.632068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:40.632068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:40.632068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:40.632068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:40.633174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:40.633174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:40.633174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:40.633174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:40.633174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:40.633174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:40.633174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:40.633174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:40.633174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:40.633174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:40.633174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:40.633174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:40.633174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:40.633174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:40.633174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:40.633174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:40.633174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:40.634307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:40.634307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:40.634307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:40.634307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:40.634307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 455/941] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:40.640965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b355ef-4dc1-4ed2-80d8-1383d60f444e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:40.749525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b355ef-4dc1-4ed2-80d8-1383d60f444e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:40.786665 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f7e5b-9712-4d96-ab7f-e638de0386c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:40.787515 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f7e5b-9712-4d96-ab7f-e638de0386c6 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:40.787899 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f7e5b-9712-4d96-ab7f-e638de0386c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:40.788278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f7e5b-9712-4d96-ab7f-e638de0386c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:40.789121 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f7e5b-9712-4d96-ab7f-e638de0386c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:40.789531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f7e5b-9712-4d96-ab7f-e638de0386c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:40.791090 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f7e5b-9712-4d96-ab7f-e638de0386c6 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:40.803941 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 487/942] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:40.809499 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b0ffa-3620-4d64-8ed2-dc1a45c6661b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:40.908287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:40.925081 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b0ffa-3620-4d64-8ed2-dc1a45c6661b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:40.961553 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3085d59-137b-414e-8b30-e53dfb3f60b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:40.965892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3085d59-137b-414e-8b30-e53dfb3f60b1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:40.965892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3085d59-137b-414e-8b30-e53dfb3f60b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:40.965892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3085d59-137b-414e-8b30-e53dfb3f60b1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:40.973538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3085d59-137b-414e-8b30-e53dfb3f60b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:40.975209 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3085d59-137b-414e-8b30-e53dfb3f60b1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:40.990513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e3085d59-137b-414e-8b30-e53dfb3f60b1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 20:55:40.990513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:40.990513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:40.990513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:40.990513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:40.990513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:40.990513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:40.990513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:40.990513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:40.990513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:40.990513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:40.990513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:40.990513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:40.990513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:40.990513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:40.990513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:40.991674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:40.992817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:40.992817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:40.992817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:40.992817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:40.992817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:40.992817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:40.992817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:40.992817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:40.992817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 20:55:40.992817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:40.995167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 456/943] 10.222.0.61 () {56 vars in 1117 bytes} [Thu May 26 20:55:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:41.003223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f7e5b-9712-4d96-ab7f-e638de0386c6 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:41.046743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:41.104775 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc3602-3254-41a7-8cd8-2b71858cf7ac None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:41.105061 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc3602-3254-41a7-8cd8-2b71858cf7ac None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:41.105332 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc3602-3254-41a7-8cd8-2b71858cf7ac None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:41.107766 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 457/944] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:55:41.112844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f7e5b-9712-4d96-ab7f-e638de0386c6 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:41.118447 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8f173-95d1-4abc-8e33-21e212f475de None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:41.119006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8f173-95d1-4abc-8e33-21e212f475de None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:41.119487 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8f173-95d1-4abc-8e33-21e212f475de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:41.139071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-74b8f173-95d1-4abc-8e33-21e212f475de None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:41.141444 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-74b8f173-95d1-4abc-8e33-21e212f475de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:41.155255 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045b7cc-c00f-4b80-92d7-996b8f6a42c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:41.155951 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045b7cc-c00f-4b80-92d7-996b8f6a42c1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:41.156257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045b7cc-c00f-4b80-92d7-996b8f6a42c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:41.156777 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045b7cc-c00f-4b80-92d7-996b8f6a42c1 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:41.157636 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045b7cc-c00f-4b80-92d7-996b8f6a42c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:41.157973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045b7cc-c00f-4b80-92d7-996b8f6a42c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:41.159960 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045b7cc-c00f-4b80-92d7-996b8f6a42c1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:41.183283 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 488/945] 10.222.0.61 () {56 vars in 1149 bytes} [Thu May 26 20:55:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:41.187937 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045b7cc-c00f-4b80-92d7-996b8f6a42c1 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:41.224670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 458/946] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:55:41.246673 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8f173-95d1-4abc-8e33-21e212f475de None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:41.312871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:41.318363 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045b7cc-c00f-4b80-92d7-996b8f6a42c1 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:41.354291 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:41.354851 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e611b0-bcab-4e94-84c4-6e6978b43134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:41.356050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e611b0-bcab-4e94-84c4-6e6978b43134 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:41.356611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e611b0-bcab-4e94-84c4-6e6978b43134 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:41.356611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e611b0-bcab-4e94-84c4-6e6978b43134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:41.368768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e611b0-bcab-4e94-84c4-6e6978b43134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:41.370452 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e611b0-bcab-4e94-84c4-6e6978b43134 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:41.380684 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8f173-95d1-4abc-8e33-21e212f475de None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:41.390319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-74e611b0-bcab-4e94-84c4-6e6978b43134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:41.390319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:41.390319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:41.390319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:41.390319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:41.390319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:41.390319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:41.390319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:41.390319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:41.390319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:41.390319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:41.390319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:41.390319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:41.390319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:41.390319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:41.391312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:41.391312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:41.391312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:41.391312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:41.391312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:41.391312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:41.391312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:41.391312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:41.391312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:41.391312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:41.391312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:41.391312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:41.391312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:41.391312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:41.391312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:41.391312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:41.391312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:41.392201 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:41.392201 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:41.392201 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:41.392201 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:41.396205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 489/947] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:41.397326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e611b0-bcab-4e94-84c4-6e6978b43134 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:41.424345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72410c4-a662-4796-94b2-23d67faa14df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:41.425662 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72410c4-a662-4796-94b2-23d67faa14df None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:41.426301 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72410c4-a662-4796-94b2-23d67faa14df None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:41.426779 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72410c4-a662-4796-94b2-23d67faa14df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:41.427638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72410c4-a662-4796-94b2-23d67faa14df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:41.429406 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72410c4-a662-4796-94b2-23d67faa14df None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:41.442999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c72410c4-a662-4796-94b2-23d67faa14df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:55:41.442999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:41.442999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:41.442999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:41.442999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:41.442999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:41.442999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:41.442999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:41.442999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:55:41.442999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:41.442999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:41.442999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:41.442999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:41.442999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:41.442999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:41.442999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:41.442999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:41.443988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:41.443988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:41.443988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:41.443988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:41.443988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:41.443988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:41.443988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:41.443988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:41.443988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:41.443988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:41.443988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:41.443988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:41.443988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:41.443988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:41.443988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:41.443988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:41.444820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:41.444820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:41.444820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:41.444820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:41.444820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:41.444820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:41.444820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:41.444820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:41.444820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:41.444820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:41.444820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:41.444820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:41.444820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:55:41.444820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:41.452917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 459/948] 10.222.0.61 () {56 vars in 1126 bytes} [Thu May 26 20:55:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:41.454211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72410c4-a662-4796-94b2-23d67faa14df None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:41.502390 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e611b0-bcab-4e94-84c4-6e6978b43134 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:41.538562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136a8b2-2c03-46ef-b8d3-bf5188d075e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:41.539300 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136a8b2-2c03-46ef-b8d3-bf5188d075e0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:41.539635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136a8b2-2c03-46ef-b8d3-bf5188d075e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:41.539947 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136a8b2-2c03-46ef-b8d3-bf5188d075e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:41.540605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136a8b2-2c03-46ef-b8d3-bf5188d075e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:41.540905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136a8b2-2c03-46ef-b8d3-bf5188d075e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:41.542381 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136a8b2-2c03-46ef-b8d3-bf5188d075e0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:41.555293 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 490/949] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:41.560714 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136a8b2-2c03-46ef-b8d3-bf5188d075e0 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:41.572792 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:41.578202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72410c4-a662-4796-94b2-23d67faa14df None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:41.614519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1a136-9c0d-4df4-b93f-ee2dc079d12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:41.615191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1a136-9c0d-4df4-b93f-ee2dc079d12f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:41.615478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1a136-9c0d-4df4-b93f-ee2dc079d12f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:41.615756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1a136-9c0d-4df4-b93f-ee2dc079d12f None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:41.616464 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1a136-9c0d-4df4-b93f-ee2dc079d12f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:41.617066 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1a136-9c0d-4df4-b93f-ee2dc079d12f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:41.618396 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1a136-9c0d-4df4-b93f-ee2dc079d12f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:41.623712 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 460/950] 10.222.0.61 () {56 vars in 1122 bytes} [Thu May 26 20:55:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:41.629907 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131cfc7-8d52-4d7f-8cb2-349e7d42ee71 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:41.630204 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131cfc7-8d52-4d7f-8cb2-349e7d42ee71 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:41.630531 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131cfc7-8d52-4d7f-8cb2-349e7d42ee71 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:41.632252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 461/951] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:41.632702 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131cfc7-8d52-4d7f-8cb2-349e7d42ee71 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:41.647172 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:41.673105 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136a8b2-2c03-46ef-b8d3-bf5188d075e0 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:41.711337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0280117-cf34-4e81-8c8b-c61f31cc5e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:41.712601 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0280117-cf34-4e81-8c8b-c61f31cc5e70 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:41.712898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0280117-cf34-4e81-8c8b-c61f31cc5e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:41.713154 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0280117-cf34-4e81-8c8b-c61f31cc5e70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:41.720881 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0280117-cf34-4e81-8c8b-c61f31cc5e70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:41.722446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0280117-cf34-4e81-8c8b-c61f31cc5e70 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:41.737654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-c0280117-cf34-4e81-8c8b-c61f31cc5e70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:41.737654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:41.737654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:41.737654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:41.737654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:41.737654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:41.737654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:41.737654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:41.737654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:41.737654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:41.737654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:41.737654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:41.737654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:41.737654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:41.737654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:41.738687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:41.738687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:41.738687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:41.738687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:41.738687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:41.738687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:41.738687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:41.738687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:41.738687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:41.738687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:41.738687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:41.738687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:41.738687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:41.738687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:41.738687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:41.738687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:41.738687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:41.739640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:41.739640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:41.739640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:41.739640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:41.739640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:41.739640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:41.739640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:41.739640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:41.739640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 491/952] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:41.740131 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858645c-68d2-4e66-af28-f9703474fb14 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:41.740515 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858645c-68d2-4e66-af28-f9703474fb14 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:41.740635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858645c-68d2-4e66-af28-f9703474fb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:41.754674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131cfc7-8d52-4d7f-8cb2-349e7d42ee71 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:41.761918 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-7858645c-68d2-4e66-af28-f9703474fb14 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:41.763242 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7858645c-68d2-4e66-af28-f9703474fb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:41.794340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00209232-eb7c-4aff-80c1-d4232c4c09f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:41.795132 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00209232-eb7c-4aff-80c1-d4232c4c09f5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:41.795412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00209232-eb7c-4aff-80c1-d4232c4c09f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:41.795692 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00209232-eb7c-4aff-80c1-d4232c4c09f5 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:41.796396 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00209232-eb7c-4aff-80c1-d4232c4c09f5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:41.796701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00209232-eb7c-4aff-80c1-d4232c4c09f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:41.798103 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00209232-eb7c-4aff-80c1-d4232c4c09f5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:41.803518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 462/953] 10.222.0.61 () {56 vars in 1122 bytes} [Thu May 26 20:55:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:41.808331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00209232-eb7c-4aff-80c1-d4232c4c09f5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:41.830775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:41.842231 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 492/954] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:41.842779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858645c-68d2-4e66-af28-f9703474fb14 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:41.884948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:41.918241 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00209232-eb7c-4aff-80c1-d4232c4c09f5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:41.947652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858645c-68d2-4e66-af28-f9703474fb14 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:41.955110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db76dd-bbf5-4c24-846e-e0a22905349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:41.955789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db76dd-bbf5-4c24-846e-e0a22905349c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:41.956074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db76dd-bbf5-4c24-846e-e0a22905349c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:41.956353 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db76dd-bbf5-4c24-846e-e0a22905349c None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:41.957150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db76dd-bbf5-4c24-846e-e0a22905349c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:41.957459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db76dd-bbf5-4c24-846e-e0a22905349c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:41.958959 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db76dd-bbf5-4c24-846e-e0a22905349c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:41.976903 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 463/955] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:41.976903 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db76dd-bbf5-4c24-846e-e0a22905349c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:41.988794 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde1e28-f97a-44ef-bfb4-c6a99bb580e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:41.989476 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde1e28-f97a-44ef-bfb4-c6a99bb580e2 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:41.989760 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde1e28-f97a-44ef-bfb4-c6a99bb580e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:41.990072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde1e28-f97a-44ef-bfb4-c6a99bb580e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:41.990817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde1e28-f97a-44ef-bfb4-c6a99bb580e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:41.992213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde1e28-f97a-44ef-bfb4-c6a99bb580e2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:42.015621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 493/956] 10.222.0.61 () {60 vars in 1144 bytes} [Thu May 26 20:55:41 2022] POST /identity/v3/endpoints => generated 349 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:55:42.016527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde1e28-f97a-44ef-bfb4-c6a99bb580e2 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:42.104780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db76dd-bbf5-4c24-846e-e0a22905349c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:42.116503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:42.148623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:42.163107 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d832e5-b16c-424a-8ed6-451ba2be49f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:42.164363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d832e5-b16c-424a-8ed6-451ba2be49f8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:42.164865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d832e5-b16c-424a-8ed6-451ba2be49f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:42.165343 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d832e5-b16c-424a-8ed6-451ba2be49f8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:42.166274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d832e5-b16c-424a-8ed6-451ba2be49f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:42.168061 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d832e5-b16c-424a-8ed6-451ba2be49f8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:42.179219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde1e28-f97a-44ef-bfb4-c6a99bb580e2 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:42.182303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-86d832e5-b16c-424a-8ed6-451ba2be49f8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:55:42.182303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:42.182303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:42.182303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:42.182303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:42.182303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:42.182303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:42.182303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:42.182303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:55:42.182303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:42.182303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:42.182303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:42.182303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:42.182303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:42.182303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:42.182303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:42.182303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:42.183486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:42.183486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:42.183486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:42.183486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:42.183486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:42.183486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:42.183486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:42.183486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:42.183486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:42.183486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:42.183486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:42.183486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:42.183486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:42.183486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:42.183486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:42.183486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:42.184324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:42.184324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:42.184324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:42.184324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:42.184324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:42.184324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:42.184324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:42.184324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:42.184324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:42.184324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:42.184324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:42.184324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:42.184324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:55:42.184324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:42.192560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 464/957] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:42.193935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d832e5-b16c-424a-8ed6-451ba2be49f8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:42.225710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b7173-f115-4374-a712-b867c8c5de14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:42.227120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b7173-f115-4374-a712-b867c8c5de14 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:42.227404 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b7173-f115-4374-a712-b867c8c5de14 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:42.227681 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b7173-f115-4374-a712-b867c8c5de14 None admin] PATH_INFO: `/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/3953b14656774edb92da1ecdb4bbbb07/roles/043685c168c24e0f890ef4479ad74e90` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:42.230062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b7173-f115-4374-a712-b867c8c5de14 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c23678abd4f4dacaf35d73c5184e72e, user_id=3953b14656774edb92da1ecdb4bbbb07, role_id=043685c168c24e0f890ef4479ad74e90)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:42.231516 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b7173-f115-4374-a712-b867c8c5de14 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:42.254706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 494/958] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:55:42 2022] PUT /identity/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/3953b14656774edb92da1ecdb4bbbb07/roles/043685c168c24e0f890ef4479ad74e90 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:55:42.325911 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d832e5-b16c-424a-8ed6-451ba2be49f8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:42.375315 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07ce45-6e2c-4f51-bfa5-534bf7e7f38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:42.376447 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07ce45-6e2c-4f51-bfa5-534bf7e7f38d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:42.376932 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07ce45-6e2c-4f51-bfa5-534bf7e7f38d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:42.377408 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07ce45-6e2c-4f51-bfa5-534bf7e7f38d None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:42.378387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07ce45-6e2c-4f51-bfa5-534bf7e7f38d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:42.378919 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07ce45-6e2c-4f51-bfa5-534bf7e7f38d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:42.380554 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07ce45-6e2c-4f51-bfa5-534bf7e7f38d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:42.387299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 465/959] 10.222.0.61 () {56 vars in 1112 bytes} [Thu May 26 20:55:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:42.393704 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b7173-f115-4374-a712-b867c8c5de14 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:42.507906 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b7173-f115-4374-a712-b867c8c5de14 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:42.524422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:42.547565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62733517-c5f0-4719-9c68-49e65738983e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:42.548269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62733517-c5f0-4719-9c68-49e65738983e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:42.548536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62733517-c5f0-4719-9c68-49e65738983e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:42.548807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62733517-c5f0-4719-9c68-49e65738983e None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:42.549550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62733517-c5f0-4719-9c68-49e65738983e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:42.549885 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62733517-c5f0-4719-9c68-49e65738983e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:42.551332 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62733517-c5f0-4719-9c68-49e65738983e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:42.557417 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 495/960] 10.222.0.61 () {56 vars in 1112 bytes} [Thu May 26 20:55:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:42.753233 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f85f2-44e7-4d59-84de-9b5cc4b473fa None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:42.753594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f85f2-44e7-4d59-84de-9b5cc4b473fa None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:42.753782 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f85f2-44e7-4d59-84de-9b5cc4b473fa None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:42.755348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 466/961] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:42.762411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbdf23-54be-4549-8889-bc6521b9f12d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:42.762701 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbdf23-54be-4549-8889-bc6521b9f12d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:42.762978 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbdf23-54be-4549-8889-bc6521b9f12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:42.784770 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-cfbbdf23-54be-4549-8889-bc6521b9f12d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:42.786392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cfbbdf23-54be-4549-8889-bc6521b9f12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:42.858164 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 496/962] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:42.882157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f85f2-44e7-4d59-84de-9b5cc4b473fa None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:42.946146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:42.992175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f85f2-44e7-4d59-84de-9b5cc4b473fa None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:43.026736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b671907-dfe0-4f6b-a634-ebfdf5008159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:43.027338 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b671907-dfe0-4f6b-a634-ebfdf5008159 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:43.027617 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b671907-dfe0-4f6b-a634-ebfdf5008159 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:43.027888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b671907-dfe0-4f6b-a634-ebfdf5008159 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:43.028598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b671907-dfe0-4f6b-a634-ebfdf5008159 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:43.030254 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b671907-dfe0-4f6b-a634-ebfdf5008159 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:43.045420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.sql.core [None req-3b671907-dfe0-4f6b-a634-ebfdf5008159 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 20:55:43.045420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 20:55:43.045420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [parameters: {'user_id': '143650667f1c4503843877abb4b761c9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 20:55:43.045420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80323) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 20:55:43.053238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3b671907-dfe0-4f6b-a634-ebfdf5008159 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 20:55:43.053238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:43.053238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 20:55:43.053238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 20:55:43.053238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 20:55:43.053238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 20:55:43.053238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 20:55:43.053238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application result = self._query(query) May 26 20:55:43.053238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 20:55:43.053238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application conn.query(q) May 26 20:55:43.053238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 20:55:43.053238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 20:55:43.053238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 20:55:43.053238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application result.read() May 26 20:55:43.053238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 20:55:43.054167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application next(self.gen) May 26 20:55:43.055120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 20:55:43.055120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application yield resource May 26 20:55:43.055120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 20:55:43.055120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application next(self.gen) May 26 20:55:43.055120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 20:55:43.055120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.session.rollback() May 26 20:55:43.055120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 20:55:43.055120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.force_reraise() May 26 20:55:43.055120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 20:55:43.055120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise self.value May 26 20:55:43.055120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 20:55:43.055120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 20:55:43.055120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 20:55:43.055120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application session.commit() May 26 20:55:43.055120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 20:55:43.055120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 20:55:43.055120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 20:55:43.056023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._prepare_impl() May 26 20:55:43.056023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 20:55:43.056023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.session.flush() May 26 20:55:43.056023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 20:55:43.056023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._flush(objects) May 26 20:55:43.056023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 20:55:43.056023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 20:55:43.056023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 20:55:43.056023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application compat.raise_( May 26 20:55:43.056023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 20:55:43.056023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception May 26 20:55:43.056023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 20:55:43.056023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application flush_context.execute() May 26 20:55:43.056023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 20:55:43.056023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rec.execute(self) May 26 20:55:43.056023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 20:55:43.056023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 20:55:43.056922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 20:55:43.056922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 20:55:43.056922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 20:55:43.056922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 20:55:43.056922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 20:55:43.056922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 20:55:43.056922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 20:55:43.056922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 20:55:43.056922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 20:55:43.056922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 20:55:43.056922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 20:55:43.056922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 20:55:43.056922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 20:55:43.056922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 20:55:43.056922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 20:55:43.056922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception May 26 20:55:43.057763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 20:55:43.057763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 20:55:43.057763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 20:55:43.057763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 20:55:43.057763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 20:55:43.057763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application result = self._query(query) May 26 20:55:43.057763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 20:55:43.057763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application conn.query(q) May 26 20:55:43.057763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 20:55:43.057763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 20:55:43.057763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 20:55:43.057763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application result.read() May 26 20:55:43.057763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 20:55:43.057763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 20:55:43.057763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 20:55:43.057763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 20:55:43.060631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 20:55:43.060631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 20:55:43.060631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 20:55:43.060631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 20:55:43.060631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 20:55:43.060631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 20:55:43.060631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [parameters: {'user_id': '143650667f1c4503843877abb4b761c9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 20:55:43.060631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 20:55:43.060631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:43.060631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:43.060631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:43.060631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:43.060631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:43.060631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:43.060631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:43.062555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:43.062555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:43.062555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:43.062555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:43.062555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:43.062555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:43.062555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:43.062555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 20:55:43.062555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 20:55:43.062555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:43.062555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:43.062555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:43.062555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:43.062555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:43.062555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:43.062555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 20:55:43.062555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 20:55:43.063835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 20:55:43.063835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 20:55:43.063835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 20:55:43.063835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 20:55:43.063835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 20:55:43.063835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:43.063835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 467/963] 10.222.0.61 () {60 vars in 1131 bytes} [Thu May 26 20:55:42 2022] POST /identity/v3/users => generated 160 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:43.064313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbdf23-54be-4549-8889-bc6521b9f12d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:43.175515 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbdf23-54be-4549-8889-bc6521b9f12d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:43.185479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:43.215892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d99f4-b5cd-48f1-8ba4-e57fa02db895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:43.216774 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d99f4-b5cd-48f1-8ba4-e57fa02db895 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:43.217073 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d99f4-b5cd-48f1-8ba4-e57fa02db895 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:43.217427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d99f4-b5cd-48f1-8ba4-e57fa02db895 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:43.224910 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d99f4-b5cd-48f1-8ba4-e57fa02db895 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:43.226434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d99f4-b5cd-48f1-8ba4-e57fa02db895 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:43.242133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-209d99f4-b5cd-48f1-8ba4-e57fa02db895 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 20:55:43.242133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:43.242133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:43.242133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:43.242133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:43.242133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:43.242133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:43.242133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:43.242133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:43.242133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:43.242133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:43.242133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:43.242133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:43.242133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:43.242133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:43.242133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:43.244287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:43.246266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:43.246266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:43.246266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:43.246266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:43.246266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:43.246266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:43.246266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:43.246266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:43.246266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 20:55:43.246266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:43.246266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 497/964] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:55:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:43.250387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b671907-dfe0-4f6b-a634-ebfdf5008159 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:43.356308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b671907-dfe0-4f6b-a634-ebfdf5008159 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:43.378356 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:43.392970 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b4204-dd2d-4ff7-941f-75b9e964e67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:43.394042 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4204-dd2d-4ff7-941f-75b9e964e67a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:43.394322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4204-dd2d-4ff7-941f-75b9e964e67a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:43.394670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4204-dd2d-4ff7-941f-75b9e964e67a None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:43.395488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b4204-dd2d-4ff7-941f-75b9e964e67a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:43.395792 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b4204-dd2d-4ff7-941f-75b9e964e67a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:43.397428 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b4204-dd2d-4ff7-941f-75b9e964e67a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:43.436612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 468/965] 10.222.0.61 () {56 vars in 1101 bytes} [Thu May 26 20:55:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:44.339620 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17deca5-9113-4dc9-aa93-7edeb5012d9b None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:44.340207 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17deca5-9113-4dc9-aa93-7edeb5012d9b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:44.340207 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17deca5-9113-4dc9-aa93-7edeb5012d9b None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:44.341786 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 498/966] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:44.347307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf58589-6bad-4dc9-9a02-8bacdfb54c35 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:44.347760 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf58589-6bad-4dc9-9a02-8bacdfb54c35 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:44.347848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf58589-6bad-4dc9-9a02-8bacdfb54c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:44.366164 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4bf58589-6bad-4dc9-9a02-8bacdfb54c35 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:44.367765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4bf58589-6bad-4dc9-9a02-8bacdfb54c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:44.444815 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 469/967] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:44.467126 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17deca5-9113-4dc9-aa93-7edeb5012d9b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:44.562738 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ce76a-0739-4fc5-a31d-ed63df64c898 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:44.563077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ce76a-0739-4fc5-a31d-ed63df64c898 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:44.563340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ce76a-0739-4fc5-a31d-ed63df64c898 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:44.564871 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 470/968] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:55:44.569607 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81e5ea-734d-4572-bbfb-176e3e4bea92 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:44.569905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81e5ea-734d-4572-bbfb-176e3e4bea92 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:44.570191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81e5ea-734d-4572-bbfb-176e3e4bea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:44.577489 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17deca5-9113-4dc9-aa93-7edeb5012d9b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:44.587288 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4b81e5ea-734d-4572-bbfb-176e3e4bea92 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:44.588481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4b81e5ea-734d-4572-bbfb-176e3e4bea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:44.613130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cab5df-5cca-46b0-a298-711ab03f656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:44.613907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cab5df-5cca-46b0-a298-711ab03f656a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:44.614190 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cab5df-5cca-46b0-a298-711ab03f656a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:44.614464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cab5df-5cca-46b0-a298-711ab03f656a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:44.615128 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cab5df-5cca-46b0-a298-711ab03f656a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:44.616559 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cab5df-5cca-46b0-a298-711ab03f656a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:44.629199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-b8cab5df-5cca-46b0-a298-711ab03f656a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:55:44.629199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:44.629199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:44.629199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:44.629199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:44.629199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:44.629199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:44.629199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:44.629199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:55:44.629199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:44.629199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:44.629199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:44.629199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:44.629199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:44.629199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:44.629199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:44.629199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:44.630350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:44.630350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:44.630350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:44.630350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:44.630350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:44.630350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:44.630350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:44.630350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:44.630350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:44.630350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:44.630350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:44.630350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:44.630350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:44.630350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:44.630350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:44.630350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:44.631203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:44.631203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:44.631203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:44.631203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:44.631203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:44.631203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:44.631203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:44.631203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:44.631203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:44.631203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:44.631203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:44.631203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:44.631203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:55:44.631203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:44.631203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 499/969] 10.222.0.61 () {56 vars in 1126 bytes} [Thu May 26 20:55:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:44.636919 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cab5df-5cca-46b0-a298-711ab03f656a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:44.672090 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:44.674171 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 471/970] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:55:44.697703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81e5ea-734d-4572-bbfb-176e3e4bea92 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:44.735490 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:44.747334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cab5df-5cca-46b0-a298-711ab03f656a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:44.788506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c020f-74d8-4a96-9b88-9212dede42d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:44.789351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c020f-74d8-4a96-9b88-9212dede42d5 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:44.789641 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c020f-74d8-4a96-9b88-9212dede42d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:44.789970 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c020f-74d8-4a96-9b88-9212dede42d5 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:44.790714 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c020f-74d8-4a96-9b88-9212dede42d5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:44.791006 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c020f-74d8-4a96-9b88-9212dede42d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:44.792414 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c020f-74d8-4a96-9b88-9212dede42d5 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:44.797845 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 500/971] 10.222.0.61 () {56 vars in 1122 bytes} [Thu May 26 20:55:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:44.803369 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c020f-74d8-4a96-9b88-9212dede42d5 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:44.811361 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81e5ea-734d-4572-bbfb-176e3e4bea92 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:44.845590 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009a1e9-79b9-4d03-96b1-7d51b611003f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:44.846454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009a1e9-79b9-4d03-96b1-7d51b611003f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:44.846734 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009a1e9-79b9-4d03-96b1-7d51b611003f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:44.847004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009a1e9-79b9-4d03-96b1-7d51b611003f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:44.857147 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009a1e9-79b9-4d03-96b1-7d51b611003f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:44.865632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a009a1e9-79b9-4d03-96b1-7d51b611003f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:55:44.865632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:44.865632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:44.865632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:44.865632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:44.865632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:44.865632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:44.865632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:44.865632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:44.865632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:44.865632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:44.865632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:44.865632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:44.865632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:44.865632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:44.865632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:44.866622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:44.866622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:44.866622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:44.866622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:44.866622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:44.866622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:44.866622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:44.866622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:44.866622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:44.866622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:44.866622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:44.866622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:44.866622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:44.866622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:44.866622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:44.866622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:44.867456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:44.867456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:44.867456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:44.867456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:44.867456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:44.867456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:44.867456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:44.867456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:44.867456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:44.867456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:44.867456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:55:44.867456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:44.867456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 472/972] 10.222.0.61 () {56 vars in 1120 bytes} [Thu May 26 20:55:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:44.868151 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5a4fa-12f9-43b6-86f2-19402ff7d3d3 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:44.868689 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5a4fa-12f9-43b6-86f2-19402ff7d3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:44.868689 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5a4fa-12f9-43b6-86f2-19402ff7d3d3 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:44.869832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 473/973] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:44.872550 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5a4fa-12f9-43b6-86f2-19402ff7d3d3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:44.902650 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:44.908912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c020f-74d8-4a96-9b88-9212dede42d5 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:44.944179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f04aa-da0b-40ec-919c-6ee3fb7ed171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:44.944868 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f04aa-da0b-40ec-919c-6ee3fb7ed171 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:44.945149 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f04aa-da0b-40ec-919c-6ee3fb7ed171 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:44.945422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f04aa-da0b-40ec-919c-6ee3fb7ed171 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:44.946201 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f04aa-da0b-40ec-919c-6ee3fb7ed171 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:44.946541 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f04aa-da0b-40ec-919c-6ee3fb7ed171 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:44.948350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f04aa-da0b-40ec-919c-6ee3fb7ed171 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:44.953996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 501/974] 10.222.0.61 () {56 vars in 1122 bytes} [Thu May 26 20:55:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:44.955283 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceecd7-3095-42b1-9e18-114878ca8253 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:44.955585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceecd7-3095-42b1-9e18-114878ca8253 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:44.955864 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceecd7-3095-42b1-9e18-114878ca8253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:44.973708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a3ceecd7-3095-42b1-9e18-114878ca8253 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:44.973898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:44.975297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a3ceecd7-3095-42b1-9e18-114878ca8253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:44.981602 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5a4fa-12f9-43b6-86f2-19402ff7d3d3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:45.016306 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba516ce-6e7f-4299-bfa0-929c31216899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:45.016989 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba516ce-6e7f-4299-bfa0-929c31216899 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:45.017267 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba516ce-6e7f-4299-bfa0-929c31216899 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:45.017539 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba516ce-6e7f-4299-bfa0-929c31216899 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:45.018320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba516ce-6e7f-4299-bfa0-929c31216899 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:45.018625 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba516ce-6e7f-4299-bfa0-929c31216899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:45.020004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba516ce-6e7f-4299-bfa0-929c31216899 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:45.029174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 474/975] 10.222.0.61 () {56 vars in 1115 bytes} [Thu May 26 20:55:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:45.029924 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba516ce-6e7f-4299-bfa0-929c31216899 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:45.043564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 502/976] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:45.044406 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceecd7-3095-42b1-9e18-114878ca8253 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:45.132546 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:45.141342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba516ce-6e7f-4299-bfa0-929c31216899 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:45.143246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceecd7-3095-42b1-9e18-114878ca8253 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:45.176564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923c332-9176-4fa7-b505-55eb7fc60717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:45.177236 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c332-9176-4fa7-b505-55eb7fc60717 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:45.177455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74053c-c723-4fa6-87b2-1d57736f9aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:45.177585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c332-9176-4fa7-b505-55eb7fc60717 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:45.177781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c332-9176-4fa7-b505-55eb7fc60717 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:45.178240 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74053c-c723-4fa6-87b2-1d57736f9aaa None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:45.178520 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74053c-c723-4fa6-87b2-1d57736f9aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:45.178619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923c332-9176-4fa7-b505-55eb7fc60717 None admin] RBAC: Adding query filter params (interface=admin, service_id=de6413316f964b21b7ece975b8287cb5, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:45.178796 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74053c-c723-4fa6-87b2-1d57736f9aaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:45.178895 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923c332-9176-4fa7-b505-55eb7fc60717 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:45.180263 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923c332-9176-4fa7-b505-55eb7fc60717 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:45.185649 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 475/977] 10.222.0.61 () {56 vars in 1249 bytes} [Thu May 26 20:55:45 2022] GET /identity/v3/endpoints?service_id=de6413316f964b21b7ece975b8287cb5&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:45.186311 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923c332-9176-4fa7-b505-55eb7fc60717 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:45.192489 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74053c-c723-4fa6-87b2-1d57736f9aaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:45.193997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74053c-c723-4fa6-87b2-1d57736f9aaa None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:45.210504 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:45.212854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-7c74053c-c723-4fa6-87b2-1d57736f9aaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:45.212854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:45.212854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:45.212854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:45.212854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:45.212854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:45.212854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:45.212854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:45.212854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:45.212854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:45.212854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:45.212854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:45.212854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:45.212854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:45.212854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:45.213787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:45.213787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:45.213787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:45.213787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:45.213787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:45.213787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:45.213787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:45.213787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:45.213787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:45.213787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:45.213787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:45.213787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:45.213787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:45.213787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:45.213787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:45.213787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:45.213787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:45.214702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:45.214702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:45.214702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:45.214702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:45.214702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 503/978] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:45.215336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74053c-c723-4fa6-87b2-1d57736f9aaa None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:45.290156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923c332-9176-4fa7-b505-55eb7fc60717 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:45.318078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74053c-c723-4fa6-87b2-1d57736f9aaa None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:45.325248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6921e8-a4e4-4dbb-b528-e78c91a8b0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:45.326088 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6921e8-a4e4-4dbb-b528-e78c91a8b0ee None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:45.326686 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6921e8-a4e4-4dbb-b528-e78c91a8b0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:45.326923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6921e8-a4e4-4dbb-b528-e78c91a8b0ee None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:45.327653 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6921e8-a4e4-4dbb-b528-e78c91a8b0ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:45.329040 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6921e8-a4e4-4dbb-b528-e78c91a8b0ee None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:45.344643 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 476/979] 10.222.0.61 () {60 vars in 1141 bytes} [Thu May 26 20:55:45 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:55:45.345515 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6921e8-a4e4-4dbb-b528-e78c91a8b0ee None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:45.362986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6833f3-0398-451d-aa4d-56e2b7ef09e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:45.363693 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6833f3-0398-451d-aa4d-56e2b7ef09e6 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:45.363982 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6833f3-0398-451d-aa4d-56e2b7ef09e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:45.364261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6833f3-0398-451d-aa4d-56e2b7ef09e6 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:45.364974 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6833f3-0398-451d-aa4d-56e2b7ef09e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:45.366519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6833f3-0398-451d-aa4d-56e2b7ef09e6 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:45.374121 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 504/980] 10.222.0.61 () {56 vars in 1087 bytes} [Thu May 26 20:55:45 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:55:45.466383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:45.496306 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6921e8-a4e4-4dbb-b528-e78c91a8b0ee None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:45.539070 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd69d8-959b-4f25-9732-7b7d76f16378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:45.539780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd69d8-959b-4f25-9732-7b7d76f16378 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:45.540056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd69d8-959b-4f25-9732-7b7d76f16378 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:45.540388 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd69d8-959b-4f25-9732-7b7d76f16378 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:45.541131 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd69d8-959b-4f25-9732-7b7d76f16378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:45.541449 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd69d8-959b-4f25-9732-7b7d76f16378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:45.543020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd69d8-959b-4f25-9732-7b7d76f16378 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:45.557585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 477/981] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:45.563721 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6833f3-0398-451d-aa4d-56e2b7ef09e6 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:45.566967 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:45.673103 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6833f3-0398-451d-aa4d-56e2b7ef09e6 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:45.709174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c6a94-719e-455e-9878-b615d5fe8db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:45.710380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c6a94-719e-455e-9878-b615d5fe8db3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:45.710673 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c6a94-719e-455e-9878-b615d5fe8db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:45.710943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c6a94-719e-455e-9878-b615d5fe8db3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:45.718546 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c6a94-719e-455e-9878-b615d5fe8db3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:45.719958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c6a94-719e-455e-9878-b615d5fe8db3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:45.735338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-3f5c6a94-719e-455e-9878-b615d5fe8db3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 20:55:45.735338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:45.735338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:45.735338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:45.735338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:45.735338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:45.735338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:45.735338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:45.735338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:45.735338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:45.735338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:45.735338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:45.735338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:45.735338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:45.735338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:45.735338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:45.736326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:45.737305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:45.737305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:45.737305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:45.737305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:45.737305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:45.737305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:45.737305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:45.737305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:45.737305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 20:55:45.737305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:45.737305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 505/982] 10.222.0.61 () {56 vars in 1117 bytes} [Thu May 26 20:55:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:45.743810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd69d8-959b-4f25-9732-7b7d76f16378 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:45.856713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd69d8-959b-4f25-9732-7b7d76f16378 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:45.894982 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33829560-387c-452b-8eeb-54bead05790e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:45.895677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33829560-387c-452b-8eeb-54bead05790e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:45.895955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33829560-387c-452b-8eeb-54bead05790e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:45.896207 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33829560-387c-452b-8eeb-54bead05790e None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:45.897056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33829560-387c-452b-8eeb-54bead05790e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:45.897362 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33829560-387c-452b-8eeb-54bead05790e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:45.898830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33829560-387c-452b-8eeb-54bead05790e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:45.914473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:45.923452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 478/983] 10.222.0.61 () {56 vars in 1149 bytes} [Thu May 26 20:55:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:45.925100 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c6a94-719e-455e-9878-b615d5fe8db3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:45.990619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:46.031295 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c6a94-719e-455e-9878-b615d5fe8db3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:46.066451 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc0cf2-aca8-4168-8c7d-edcf2f7c6c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:46.067114 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc0cf2-aca8-4168-8c7d-edcf2f7c6c01 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:46.067397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc0cf2-aca8-4168-8c7d-edcf2f7c6c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:46.067670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc0cf2-aca8-4168-8c7d-edcf2f7c6c01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:46.136075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc0cf2-aca8-4168-8c7d-edcf2f7c6c01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:46.137553 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc0cf2-aca8-4168-8c7d-edcf2f7c6c01 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:46.198405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:46.242329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 506/984] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:55:45 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:55:46.247903 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33829560-387c-452b-8eeb-54bead05790e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:46.349939 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33829560-387c-452b-8eeb-54bead05790e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:46.385079 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020ffec-efd4-469a-bf7a-7e9d17e59d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:46.385908 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020ffec-efd4-469a-bf7a-7e9d17e59d1b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:46.386191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020ffec-efd4-469a-bf7a-7e9d17e59d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:46.386440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020ffec-efd4-469a-bf7a-7e9d17e59d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:46.396752 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020ffec-efd4-469a-bf7a-7e9d17e59d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:46.398239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020ffec-efd4-469a-bf7a-7e9d17e59d1b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:46.415819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-9020ffec-efd4-469a-bf7a-7e9d17e59d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:46.415819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:46.415819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:46.415819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:46.415819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:46.415819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:46.415819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:46.415819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:46.415819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:46.415819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:46.415819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:46.415819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:46.415819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:46.415819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:46.415819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:46.416749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:46.416749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:46.416749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:46.416749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:46.416749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:46.416749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:46.416749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:46.416749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:46.416749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:46.416749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:46.416749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:46.416749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:46.416749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:46.416749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:46.416749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:46.416749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:46.416749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:46.417628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:46.417628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:46.417628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:46.417628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:46.421850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 479/985] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:46.422741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc0cf2-aca8-4168-8c7d-edcf2f7c6c01 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:46.537938 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc0cf2-aca8-4168-8c7d-edcf2f7c6c01 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:46.572024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68072315-9507-494a-8bd6-53359a582f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:46.572711 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68072315-9507-494a-8bd6-53359a582f6f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:46.572995 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68072315-9507-494a-8bd6-53359a582f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:46.573278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68072315-9507-494a-8bd6-53359a582f6f None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:46.574040 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68072315-9507-494a-8bd6-53359a582f6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:46.574351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68072315-9507-494a-8bd6-53359a582f6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:46.575884 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68072315-9507-494a-8bd6-53359a582f6f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:46.588261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 507/986] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:46.593758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020ffec-efd4-469a-bf7a-7e9d17e59d1b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:46.649543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:46.702626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020ffec-efd4-469a-bf7a-7e9d17e59d1b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:46.738157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb45794-b121-458a-843f-d027d4c1879f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:46.738966 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb45794-b121-458a-843f-d027d4c1879f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:46.739222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb45794-b121-458a-843f-d027d4c1879f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:46.739522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb45794-b121-458a-843f-d027d4c1879f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:46.746654 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb45794-b121-458a-843f-d027d4c1879f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:46.748649 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb45794-b121-458a-843f-d027d4c1879f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:46.762843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-7bb45794-b121-458a-843f-d027d4c1879f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:46.762843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:46.762843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:46.762843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:46.762843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:46.762843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:46.762843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:46.762843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:46.762843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:46.762843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:46.762843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:46.762843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:46.762843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:46.762843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:46.762843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:46.763780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:46.763780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:46.763780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:46.763780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:46.763780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:46.763780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:46.763780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:46.763780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:46.763780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:46.763780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:46.763780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:46.763780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:46.763780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:46.763780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:46.763780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:46.763780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:46.763780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:46.770440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:46.770440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:46.770440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:46.770440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:46.770440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:46.770440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:46.770440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:46.770440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:46.770440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 480/987] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:46.771982 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68072315-9507-494a-8bd6-53359a582f6f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:46.799128 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:46.881074 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68072315-9507-494a-8bd6-53359a582f6f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:46.916691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d1aef-a07d-4302-bdd5-a430a0172dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:46.917368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d1aef-a07d-4302-bdd5-a430a0172dfc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:46.917651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d1aef-a07d-4302-bdd5-a430a0172dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:46.917971 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d1aef-a07d-4302-bdd5-a430a0172dfc None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:46.918762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d1aef-a07d-4302-bdd5-a430a0172dfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:46.919071 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d1aef-a07d-4302-bdd5-a430a0172dfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:46.921181 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d1aef-a07d-4302-bdd5-a430a0172dfc None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:46.939322 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 508/988] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:46.940652 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb45794-b121-458a-843f-d027d4c1879f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:47.052228 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb45794-b121-458a-843f-d027d4c1879f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:47.066623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:47.090817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f600277-c7b6-4a1b-8a26-0b7ec5c8f297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:47.091519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f600277-c7b6-4a1b-8a26-0b7ec5c8f297 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:47.091980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f600277-c7b6-4a1b-8a26-0b7ec5c8f297 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:47.092782 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f600277-c7b6-4a1b-8a26-0b7ec5c8f297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:47.093627 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f600277-c7b6-4a1b-8a26-0b7ec5c8f297 None admin] RBAC: Adding query filter params (role.id=043685c168c24e0f890ef4479ad74e90, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=3953b14656774edb92da1ecdb4bbbb07) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:47.093982 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f600277-c7b6-4a1b-8a26-0b7ec5c8f297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:47.095464 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f600277-c7b6-4a1b-8a26-0b7ec5c8f297 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:47.110090 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 481/989] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:55:46 2022] GET /identity/v3/role_assignments?user.id=3953b14656774edb92da1ecdb4bbbb07&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=043685c168c24e0f890ef4479ad74e90 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:47.598548 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7640e9c-f268-4768-9110-9ef08111723b None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:47.599097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7640e9c-f268-4768-9110-9ef08111723b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:47.599097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7640e9c-f268-4768-9110-9ef08111723b None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:47.600669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 509/990] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:47.605033 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7a755-7e7c-4b29-88d5-7e57158c0721 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:47.605458 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7a755-7e7c-4b29-88d5-7e57158c0721 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:47.605599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a3482-8f59-424a-8df9-085176de3e1a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:47.605694 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7a755-7e7c-4b29-88d5-7e57158c0721 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:47.605900 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a3482-8f59-424a-8df9-085176de3e1a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:47.606164 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a3482-8f59-424a-8df9-085176de3e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:47.608057 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 482/991] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:47.612564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8264dd-1bb5-4430-ad5b-affdc3bf0578 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:47.612856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8264dd-1bb5-4430-ad5b-affdc3bf0578 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:47.613148 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8264dd-1bb5-4430-ad5b-affdc3bf0578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:47.623569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ca9a3482-8f59-424a-8df9-085176de3e1a None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:47.624776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ca9a3482-8f59-424a-8df9-085176de3e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:47.631440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fe8264dd-1bb5-4430-ad5b-affdc3bf0578 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:47.632635 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fe8264dd-1bb5-4430-ad5b-affdc3bf0578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:47.704323 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 510/992] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:55:47.710104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 483/993] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:55:47.727276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a3482-8f59-424a-8df9-085176de3e1a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:47.728894 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8264dd-1bb5-4430-ad5b-affdc3bf0578 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:47.744975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:47.839635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a3482-8f59-424a-8df9-085176de3e1a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:47.846839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8264dd-1bb5-4430-ad5b-affdc3bf0578 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:47.855167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:47.877648 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e4e0b-5954-4770-a1ec-2169c26ee37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:47.878714 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4e0b-5954-4770-a1ec-2169c26ee37b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:47.879001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4e0b-5954-4770-a1ec-2169c26ee37b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:47.879278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4e0b-5954-4770-a1ec-2169c26ee37b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:47.879938 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e4e0b-5954-4770-a1ec-2169c26ee37b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:47.881338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e4e0b-5954-4770-a1ec-2169c26ee37b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:47.885001 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb3426-813d-42e1-abb5-6e10b708301e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:47.886106 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb3426-813d-42e1-abb5-6e10b708301e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:47.886571 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb3426-813d-42e1-abb5-6e10b708301e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:47.887025 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb3426-813d-42e1-abb5-6e10b708301e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:47.887862 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb3426-813d-42e1-abb5-6e10b708301e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:47.889549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb3426-813d-42e1-abb5-6e10b708301e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:47.893531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-506e4e0b-5954-4770-a1ec-2169c26ee37b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:55:47.893531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:47.893531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:47.893531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:47.893531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:47.893531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:47.893531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:47.893531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:47.893531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:55:47.893531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:47.893531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:47.893531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:47.893531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:47.893531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:47.893531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:47.893531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:47.893531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:47.894710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:47.894710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:47.894710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:47.894710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:47.894710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:47.894710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:47.894710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:47.894710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:47.894710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:47.894710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:47.894710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:47.894710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:47.894710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:47.894710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:47.894710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:47.894710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:47.895773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:47.895773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:47.895773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:47.895773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:47.895773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:47.895773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:47.895773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:47.895773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:47.895773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:47.895773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:47.895773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:47.895773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:47.895773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:55:47.895773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:47.899642 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 511/994] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:47.900849 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e4e0b-5954-4770-a1ec-2169c26ee37b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:47.906101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b8eb3426-813d-42e1-abb5-6e10b708301e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:55:47.906101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:47.906101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:47.906101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:47.906101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:47.906101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:47.906101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:47.906101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:47.906101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:55:47.906101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:47.906101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:47.906101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:47.906101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:47.906101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:47.906101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:47.906101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:47.906101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:47.907273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:47.907273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:47.907273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:47.907273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:47.907273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:47.907273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:47.907273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:47.907273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:47.907273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:47.907273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:47.907273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:47.907273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:47.907273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:47.907273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:47.907273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:47.907273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:47.908300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:47.908300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:47.908300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:47.908300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:47.908300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:47.908300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:47.908300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:47.908300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:47.908300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:47.908300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:47.908300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:47.908300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:47.908300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:55:47.908300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:47.910604 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 484/995] 10.222.0.61 () {56 vars in 1126 bytes} [Thu May 26 20:55:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:47.916476 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb3426-813d-42e1-abb5-6e10b708301e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:47.986863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:48.012330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e4e0b-5954-4770-a1ec-2169c26ee37b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:48.027396 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb3426-813d-42e1-abb5-6e10b708301e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:48.047949 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2d78d-61ca-43a1-a8ad-3d9b39008a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:48.048639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2d78d-61ca-43a1-a8ad-3d9b39008a61 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:48.048924 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2d78d-61ca-43a1-a8ad-3d9b39008a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:48.049205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2d78d-61ca-43a1-a8ad-3d9b39008a61 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:48.049953 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2d78d-61ca-43a1-a8ad-3d9b39008a61 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:48.050264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2d78d-61ca-43a1-a8ad-3d9b39008a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:48.051671 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2d78d-61ca-43a1-a8ad-3d9b39008a61 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:48.056823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 512/996] 10.222.0.61 () {56 vars in 1112 bytes} [Thu May 26 20:55:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:48.062571 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2d78d-61ca-43a1-a8ad-3d9b39008a61 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:48.062846 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c58f6f-ea49-4357-bd33-6e5b57c3aba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:48.063519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58f6f-ea49-4357-bd33-6e5b57c3aba6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:48.063799 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58f6f-ea49-4357-bd33-6e5b57c3aba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:48.064071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58f6f-ea49-4357-bd33-6e5b57c3aba6 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:48.064769 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c58f6f-ea49-4357-bd33-6e5b57c3aba6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:48.065069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c58f6f-ea49-4357-bd33-6e5b57c3aba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:48.067517 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c58f6f-ea49-4357-bd33-6e5b57c3aba6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:48.077457 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 485/997] 10.222.0.61 () {56 vars in 1122 bytes} [Thu May 26 20:55:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:48.079052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c58f6f-ea49-4357-bd33-6e5b57c3aba6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:48.113612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:48.168130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2d78d-61ca-43a1-a8ad-3d9b39008a61 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:48.184336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c58f6f-ea49-4357-bd33-6e5b57c3aba6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:48.203386 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a8693-47db-4177-80c9-47443797a0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:48.204071 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a8693-47db-4177-80c9-47443797a0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:48.204355 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a8693-47db-4177-80c9-47443797a0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:48.204633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a8693-47db-4177-80c9-47443797a0d9 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:48.205469 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a8693-47db-4177-80c9-47443797a0d9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:48.205781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a8693-47db-4177-80c9-47443797a0d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:48.207202 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a8693-47db-4177-80c9-47443797a0d9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:48.218026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 513/998] 10.222.0.61 () {56 vars in 1112 bytes} [Thu May 26 20:55:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:48.219005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a8693-47db-4177-80c9-47443797a0d9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:48.219511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba4f58-eb0d-402f-be49-74ace2f580ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:48.220311 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba4f58-eb0d-402f-be49-74ace2f580ed None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:48.220598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba4f58-eb0d-402f-be49-74ace2f580ed None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:48.220876 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba4f58-eb0d-402f-be49-74ace2f580ed None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:48.221593 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba4f58-eb0d-402f-be49-74ace2f580ed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:48.221932 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba4f58-eb0d-402f-be49-74ace2f580ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:48.223307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba4f58-eb0d-402f-be49-74ace2f580ed None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:48.223474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:48.228898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 486/999] 10.222.0.61 () {56 vars in 1122 bytes} [Thu May 26 20:55:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:48.235343 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba4f58-eb0d-402f-be49-74ace2f580ed None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:48.338481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a8693-47db-4177-80c9-47443797a0d9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:48.339182 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:48.343839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba4f58-eb0d-402f-be49-74ace2f580ed None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:48.374530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3b1d4-3e4d-4550-872f-c1ec7a1cb9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:48.375225 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3b1d4-3e4d-4550-872f-c1ec7a1cb9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:48.375576 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3b1d4-3e4d-4550-872f-c1ec7a1cb9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:48.375980 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3b1d4-3e4d-4550-872f-c1ec7a1cb9e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:48.376625 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3b1d4-3e4d-4550-872f-c1ec7a1cb9e2 None admin] RBAC: Adding query filter params (interface=public, service_id=b699d66832614e43ac0b4eef1e730792, region_id=RegionOne) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:48.376932 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3b1d4-3e4d-4550-872f-c1ec7a1cb9e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:48.378440 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3b1d4-3e4d-4550-872f-c1ec7a1cb9e2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:48.382068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bc941-9603-4d4b-82dd-7c2baf055687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:48.382741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bc941-9603-4d4b-82dd-7c2baf055687 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:48.383026 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bc941-9603-4d4b-82dd-7c2baf055687 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:48.383303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bc941-9603-4d4b-82dd-7c2baf055687 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:48.388623 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 514/1000] 10.222.0.61 () {56 vars in 1251 bytes} [Thu May 26 20:55:48 2022] GET /identity/v3/endpoints?service_id=b699d66832614e43ac0b4eef1e730792&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:48.388771 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bc941-9603-4d4b-82dd-7c2baf055687 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:48.388771 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bc941-9603-4d4b-82dd-7c2baf055687 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:48.390566 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3b1d4-3e4d-4550-872f-c1ec7a1cb9e2 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:48.405828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 487/1001] 10.222.0.61 () {60 vars in 1144 bytes} [Thu May 26 20:55:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:55:48.475189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:48.516057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3b1d4-3e4d-4550-872f-c1ec7a1cb9e2 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:48.563722 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043b948-4740-4691-8661-dd7ca7479218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:48.564414 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043b948-4740-4691-8661-dd7ca7479218 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:48.564695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043b948-4740-4691-8661-dd7ca7479218 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:48.564965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043b948-4740-4691-8661-dd7ca7479218 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:48.565711 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043b948-4740-4691-8661-dd7ca7479218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:48.567152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043b948-4740-4691-8661-dd7ca7479218 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:48.579161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 515/1002] 10.222.0.61 () {56 vars in 1087 bytes} [Thu May 26 20:55:48 2022] GET /identity/v3/services => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:55:49.371948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f716e5-5cad-4588-9f9b-f62fbea6f194 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:49.372509 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f716e5-5cad-4588-9f9b-f62fbea6f194 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:49.372509 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f716e5-5cad-4588-9f9b-f62fbea6f194 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:49.374426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 488/1003] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:49.380101 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2012ca-d02a-4530-a063-273f1605c7d9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:49.380644 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2012ca-d02a-4530-a063-273f1605c7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:49.380644 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2012ca-d02a-4530-a063-273f1605c7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:49.398005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ee2012ca-d02a-4530-a063-273f1605c7d9 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:49.399186 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ee2012ca-d02a-4530-a063-273f1605c7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:49.465409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 516/1004] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:49 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:49.487297 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f716e5-5cad-4588-9f9b-f62fbea6f194 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:49.610738 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f716e5-5cad-4588-9f9b-f62fbea6f194 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:49.645783 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb949946-8abe-4f78-a0ed-303fa10c8f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:49.646535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb949946-8abe-4f78-a0ed-303fa10c8f8d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:49.646815 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb949946-8abe-4f78-a0ed-303fa10c8f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:49.647086 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb949946-8abe-4f78-a0ed-303fa10c8f8d None admin] PATH_INFO: `/v3/services/image` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:49.647730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb949946-8abe-4f78-a0ed-303fa10c8f8d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:49.649109 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb949946-8abe-4f78-a0ed-303fa10c8f8d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:49.660843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-cb949946-8abe-4f78-a0ed-303fa10c8f8d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:55:49.660843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:49.660843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:49.660843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:49.660843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:49.660843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:49.660843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:49.660843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:49.660843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:55:49.660843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:49.660843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:49.660843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:49.660843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:49.660843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:49.660843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:49.660843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:49.660843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:49.667317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:49.667317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:49.667317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:49.667317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:49.667317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:49.667317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:49.667317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:49.667317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:49.667317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:49.667317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:49.667317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:49.667317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:49.667317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:49.667317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:49.667317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:49.667317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:49.668387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:49.668387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:49.668387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:49.668387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:49.668387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:49.668387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:49.668387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:49.668387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:49.668387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:49.668387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:49.668387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:49.668387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:49.668387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:55:49.668387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:49.668387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 489/1005] 10.222.0.61 () {56 vars in 1105 bytes} [Thu May 26 20:55:49 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:49.671634 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2012ca-d02a-4530-a063-273f1605c7d9 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:49.736446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:49.785615 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2012ca-d02a-4530-a063-273f1605c7d9 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:49.821457 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a25cc-1c19-4e24-81f2-d887f121c906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:49.822158 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a25cc-1c19-4e24-81f2-d887f121c906 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:49.822440 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a25cc-1c19-4e24-81f2-d887f121c906 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:49.822710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a25cc-1c19-4e24-81f2-d887f121c906 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:49.823410 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a25cc-1c19-4e24-81f2-d887f121c906 None admin] RBAC: Adding query filter params (name=image) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:49.823708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a25cc-1c19-4e24-81f2-d887f121c906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:49.825090 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a25cc-1c19-4e24-81f2-d887f121c906 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:49.830408 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 517/1006] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:49.836326 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb949946-8abe-4f78-a0ed-303fa10c8f8d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:49.863607 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:49.946181 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb949946-8abe-4f78-a0ed-303fa10c8f8d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:49.980643 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7728109-1d4e-48a4-bec4-a9f2b3859f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:49.981318 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7728109-1d4e-48a4-bec4-a9f2b3859f43 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:49.981603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7728109-1d4e-48a4-bec4-a9f2b3859f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:49.981899 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7728109-1d4e-48a4-bec4-a9f2b3859f43 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:49.982795 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7728109-1d4e-48a4-bec4-a9f2b3859f43 None admin] RBAC: Adding query filter params (type=image) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:49.983169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7728109-1d4e-48a4-bec4-a9f2b3859f43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:49.984488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7728109-1d4e-48a4-bec4-a9f2b3859f43 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:49.989438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 490/1007] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:50.624004 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c79650-b0ca-4477-80a9-ab7fc422b78c None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:50.624586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c79650-b0ca-4477-80a9-ab7fc422b78c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:50.624586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c79650-b0ca-4477-80a9-ab7fc422b78c None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:50.626159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 518/1008] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:50.631721 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4835526-991c-407b-a7a3-033a14bad834 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:50.632160 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4835526-991c-407b-a7a3-033a14bad834 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:50.632239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4835526-991c-407b-a7a3-033a14bad834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:50.650206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b4835526-991c-407b-a7a3-033a14bad834 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:50.651384 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b4835526-991c-407b-a7a3-033a14bad834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:50.725281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 491/1009] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:50 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:50.748499 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c79650-b0ca-4477-80a9-ab7fc422b78c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:50.804630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75bea9-13bc-48b0-865e-fb871e501a1f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:50.805191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75bea9-13bc-48b0-865e-fb871e501a1f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:50.805475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75bea9-13bc-48b0-865e-fb871e501a1f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:50.807180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 492/1010] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:50.812736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979fd74-8bda-489e-a4ed-dae801447dcc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:50.813022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979fd74-8bda-489e-a4ed-dae801447dcc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:50.813299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979fd74-8bda-489e-a4ed-dae801447dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:50.830003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0979fd74-8bda-489e-a4ed-dae801447dcc None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:50.831208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0979fd74-8bda-489e-a4ed-dae801447dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:50.844236 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:50.867296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c79650-b0ca-4477-80a9-ab7fc422b78c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:50.891466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:50.904686 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a5d25-4324-494f-8aa6-37e21e029fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:50.905498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a5d25-4324-494f-8aa6-37e21e029fab None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:50.905781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a5d25-4324-494f-8aa6-37e21e029fab None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:50.906090 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a5d25-4324-494f-8aa6-37e21e029fab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:50.907273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a5d25-4324-494f-8aa6-37e21e029fab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:50.908743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a5d25-4324-494f-8aa6-37e21e029fab None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:50.915305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 519/1011] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:50.916597 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a5d25-4324-494f-8aa6-37e21e029fab None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:50.917917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 493/1012] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:50 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:50.941276 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979fd74-8bda-489e-a4ed-dae801447dcc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:51.025444 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a5d25-4324-494f-8aa6-37e21e029fab None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:51.048226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979fd74-8bda-489e-a4ed-dae801447dcc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:51.063790 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd641e-d693-4596-aa63-a0fd836f74b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:51.064464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd641e-d693-4596-aa63-a0fd836f74b6 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:51.064741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd641e-d693-4596-aa63-a0fd836f74b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:51.065017 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd641e-d693-4596-aa63-a0fd836f74b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:51.065734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd641e-d693-4596-aa63-a0fd836f74b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:51.067243 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd641e-d693-4596-aa63-a0fd836f74b6 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:51.087327 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395158c-1788-4158-afe3-bd5a263969d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:51.088137 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395158c-1788-4158-afe3-bd5a263969d5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:51.088428 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395158c-1788-4158-afe3-bd5a263969d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:51.088705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395158c-1788-4158-afe3-bd5a263969d5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:51.089378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395158c-1788-4158-afe3-bd5a263969d5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:51.090878 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395158c-1788-4158-afe3-bd5a263969d5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:51.102987 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 520/1013] 10.222.0.61 () {60 vars in 1141 bytes} [Thu May 26 20:55:50 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:55:51.103322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3395158c-1788-4158-afe3-bd5a263969d5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:55:51.103322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:51.103322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:51.103322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:51.103322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:51.103322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:51.103322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:51.103322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:51.103322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:55:51.103322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:51.103322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:51.103322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:51.103322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:51.103322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:51.103322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:51.103322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:51.103322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:51.104496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:51.104496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:51.104496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:51.104496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:51.104496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:51.104496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:51.104496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:51.104496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:51.104496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:51.104496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:51.104496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:51.104496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:51.104496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:51.104496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:51.104496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:51.104496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:51.105390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:51.105390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:51.105390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:51.105390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:51.105390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:51.105390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:51.105390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:51.105390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:51.105390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:51.105390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:51.105390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:51.105390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:51.105390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:55:51.105390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:51.105390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 494/1014] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:51.112097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd641e-d693-4596-aa63-a0fd836f74b6 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:51.166022 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:51.235318 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd641e-d693-4596-aa63-a0fd836f74b6 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:51.272841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682e037-fc49-4776-83b9-012644171c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:51.273586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682e037-fc49-4776-83b9-012644171c5b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:51.273900 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682e037-fc49-4776-83b9-012644171c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:51.274178 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682e037-fc49-4776-83b9-012644171c5b None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:51.274904 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682e037-fc49-4776-83b9-012644171c5b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:51.275209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682e037-fc49-4776-83b9-012644171c5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:51.276626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682e037-fc49-4776-83b9-012644171c5b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:51.282645 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 521/1015] 10.222.0.61 () {56 vars in 1112 bytes} [Thu May 26 20:55:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:51.288288 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395158c-1788-4158-afe3-bd5a263969d5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:51.302585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:51.400971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395158c-1788-4158-afe3-bd5a263969d5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:51.436886 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a87207-c9b8-4486-a5c8-ec68a8fb9a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:51.437567 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a87207-c9b8-4486-a5c8-ec68a8fb9a16 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:51.437875 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a87207-c9b8-4486-a5c8-ec68a8fb9a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:51.438154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a87207-c9b8-4486-a5c8-ec68a8fb9a16 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:51.438874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a87207-c9b8-4486-a5c8-ec68a8fb9a16 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:51.439176 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a87207-c9b8-4486-a5c8-ec68a8fb9a16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:51.440568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a87207-c9b8-4486-a5c8-ec68a8fb9a16 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:51.445935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 495/1016] 10.222.0.61 () {56 vars in 1112 bytes} [Thu May 26 20:55:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:51.451506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682e037-fc49-4776-83b9-012644171c5b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:51.557836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682e037-fc49-4776-83b9-012644171c5b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:51.566039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:51.595649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25f1d1-79c2-4b10-a5d7-1d5f5bb52d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:51.596329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f1d1-79c2-4b10-a5d7-1d5f5bb52d50 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:51.596613 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f1d1-79c2-4b10-a5d7-1d5f5bb52d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:51.596881 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f1d1-79c2-4b10-a5d7-1d5f5bb52d50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:51.597650 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25f1d1-79c2-4b10-a5d7-1d5f5bb52d50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:51.599068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25f1d1-79c2-4b10-a5d7-1d5f5bb52d50 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:51.629826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 522/1017] 10.222.0.61 () {60 vars in 1144 bytes} [Thu May 26 20:55:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:55:52.190586 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab5493-0f54-4ff4-af9e-daf24e484b30 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:52.191152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab5493-0f54-4ff4-af9e-daf24e484b30 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:52.191152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab5493-0f54-4ff4-af9e-daf24e484b30 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:52.192732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 496/1018] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:52.197966 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566ecd5-1a64-4963-b02f-3abbd5ab129f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:52.198340 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566ecd5-1a64-4963-b02f-3abbd5ab129f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:52.198695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566ecd5-1a64-4963-b02f-3abbd5ab129f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:52.216956 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-5566ecd5-1a64-4963-b02f-3abbd5ab129f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:52.218214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5566ecd5-1a64-4963-b02f-3abbd5ab129f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:52.299016 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 523/1019] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:52 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:52.322212 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab5493-0f54-4ff4-af9e-daf24e484b30 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:52.404989 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:52.432818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab5493-0f54-4ff4-af9e-daf24e484b30 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:52.467957 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f74ce4-e4b0-48f5-a372-92c9f2da12dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:52.468556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f74ce4-e4b0-48f5-a372-92c9f2da12dc None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:52.468835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f74ce4-e4b0-48f5-a372-92c9f2da12dc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:52.469113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f74ce4-e4b0-48f5-a372-92c9f2da12dc None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:52.469875 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f74ce4-e4b0-48f5-a372-92c9f2da12dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:52.471259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f74ce4-e4b0-48f5-a372-92c9f2da12dc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:52.495389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 497/1020] 10.222.0.61 () {60 vars in 1141 bytes} [Thu May 26 20:55:52 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:55:53.366180 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e73f4-b424-4163-a3eb-6b03796f152b None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:53.366764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e73f4-b424-4163-a3eb-6b03796f152b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:53.366764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e73f4-b424-4163-a3eb-6b03796f152b None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:53.368279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 524/1021] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:53.373448 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d89ad-f2ca-490d-9d89-4eacc6281f74 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:53.373942 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d89ad-f2ca-490d-9d89-4eacc6281f74 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:53.374040 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d89ad-f2ca-490d-9d89-4eacc6281f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:53.390931 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b10d89ad-f2ca-490d-9d89-4eacc6281f74 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:53.392101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b10d89ad-f2ca-490d-9d89-4eacc6281f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:53.465176 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 498/1022] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:53.489197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e73f4-b424-4163-a3eb-6b03796f152b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:53.582371 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:53.604838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e73f4-b424-4163-a3eb-6b03796f152b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:53.640959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462d660-3da0-4da5-b6eb-4cbca6366e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:53.641682 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462d660-3da0-4da5-b6eb-4cbca6366e2c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:53.641986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462d660-3da0-4da5-b6eb-4cbca6366e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:53.642256 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462d660-3da0-4da5-b6eb-4cbca6366e2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:53.643488 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462d660-3da0-4da5-b6eb-4cbca6366e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:53.645031 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462d660-3da0-4da5-b6eb-4cbca6366e2c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:53.655035 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 525/1023] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:53.655250 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d89ad-f2ca-490d-9d89-4eacc6281f74 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:53.721206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:53.777872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d89ad-f2ca-490d-9d89-4eacc6281f74 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:53.813054 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9164cda-b112-48b2-9fa5-533a542991f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:53.813747 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9164cda-b112-48b2-9fa5-533a542991f6 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:53.814069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9164cda-b112-48b2-9fa5-533a542991f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:53.814347 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9164cda-b112-48b2-9fa5-533a542991f6 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:53.815064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9164cda-b112-48b2-9fa5-533a542991f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:53.816506 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9164cda-b112-48b2-9fa5-533a542991f6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:53.838842 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 499/1024] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:55:53 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:55:53.919327 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa45367-dcce-4795-9a47-fa03a020f681 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:53.919926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa45367-dcce-4795-9a47-fa03a020f681 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:53.920211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa45367-dcce-4795-9a47-fa03a020f681 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:53.921867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 526/1025] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:53.927574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba7d2b-6e76-4721-bfc1-ef2bfa273078 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:53.927886 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba7d2b-6e76-4721-bfc1-ef2bfa273078 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:53.928145 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba7d2b-6e76-4721-bfc1-ef2bfa273078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:53.946882 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f0ba7d2b-6e76-4721-bfc1-ef2bfa273078 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:53.948203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f0ba7d2b-6e76-4721-bfc1-ef2bfa273078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:54.023251 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 500/1026] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:55:54.046729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa45367-dcce-4795-9a47-fa03a020f681 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:54.155341 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa45367-dcce-4795-9a47-fa03a020f681 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:54.191361 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4322d5d-090b-4e6b-b1a5-a4b8f956e493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:54.192194 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4322d5d-090b-4e6b-b1a5-a4b8f956e493 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:54.192473 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4322d5d-090b-4e6b-b1a5-a4b8f956e493 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:54.192744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4322d5d-090b-4e6b-b1a5-a4b8f956e493 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:54.203626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4322d5d-090b-4e6b-b1a5-a4b8f956e493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:54.212037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-e4322d5d-090b-4e6b-b1a5-a4b8f956e493 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:55:54.212037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:54.212037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:54.212037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:54.212037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:54.212037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:54.212037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:54.212037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:54.212037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:54.212037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:54.212037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:54.212037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:54.212037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:54.212037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:54.212037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:54.212037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:54.212965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:54.212965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:54.212965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:54.212965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:54.212965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:54.212965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:54.212965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:54.212965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:54.212965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:54.212965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:54.212965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:54.212965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:54.212965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:54.212965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:54.212965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:54.212965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:54.213876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:54.213876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:54.213876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:54.213876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:54.213876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:54.213876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:54.213876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:54.213876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:54.213876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:54.213876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:54.213876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:55:54.213876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:54.213876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 527/1027] 10.222.0.61 () {56 vars in 1120 bytes} [Thu May 26 20:55:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:54.221036 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba7d2b-6e76-4721-bfc1-ef2bfa273078 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:54.269429 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:54.327187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba7d2b-6e76-4721-bfc1-ef2bfa273078 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:54.364418 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528c4b8-ec3a-4d53-9c23-2f64fe97f083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:54.365105 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528c4b8-ec3a-4d53-9c23-2f64fe97f083 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:54.365387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528c4b8-ec3a-4d53-9c23-2f64fe97f083 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:54.365673 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528c4b8-ec3a-4d53-9c23-2f64fe97f083 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:54.366466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528c4b8-ec3a-4d53-9c23-2f64fe97f083 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:54.366772 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528c4b8-ec3a-4d53-9c23-2f64fe97f083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:54.368166 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528c4b8-ec3a-4d53-9c23-2f64fe97f083 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:54.381702 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 501/1028] 10.222.0.61 () {56 vars in 1115 bytes} [Thu May 26 20:55:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:54.382706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4322d5d-090b-4e6b-b1a5-a4b8f956e493 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:54.402011 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:54.490492 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4322d5d-090b-4e6b-b1a5-a4b8f956e493 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:54.525519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33e739-6970-4696-8124-c2a61e1adef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:54.526378 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33e739-6970-4696-8124-c2a61e1adef1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:54.526662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33e739-6970-4696-8124-c2a61e1adef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:54.526929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33e739-6970-4696-8124-c2a61e1adef1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:54.538027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33e739-6970-4696-8124-c2a61e1adef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:54.539498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33e739-6970-4696-8124-c2a61e1adef1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:54.556504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-ba33e739-6970-4696-8124-c2a61e1adef1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:54.556504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:54.556504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:54.556504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:54.556504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:54.556504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:54.556504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:54.556504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:54.556504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:54.556504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:54.556504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:54.556504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:54.556504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:54.556504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:54.556504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:54.557498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:54.557498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:54.557498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:54.557498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:54.557498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:54.557498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:54.557498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:54.557498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:54.557498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:54.557498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:54.557498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:54.557498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:54.557498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:54.557498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:54.557498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:54.557498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:54.557498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:54.558435 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:54.558435 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:54.558435 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:54.558435 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:54.561877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 528/1029] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:54.563735 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528c4b8-ec3a-4d53-9c23-2f64fe97f083 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:54.672697 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528c4b8-ec3a-4d53-9c23-2f64fe97f083 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:54.681896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:54.708750 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d80482-d3b4-4e0e-9a3e-04cf2646623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:54.709426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80482-d3b4-4e0e-9a3e-04cf2646623d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:54.710063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80482-d3b4-4e0e-9a3e-04cf2646623d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:54.710330 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80482-d3b4-4e0e-9a3e-04cf2646623d None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:54.711049 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d80482-d3b4-4e0e-9a3e-04cf2646623d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:54.711352 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d80482-d3b4-4e0e-9a3e-04cf2646623d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:54.712718 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d80482-d3b4-4e0e-9a3e-04cf2646623d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:54.726873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 502/1030] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:54.732624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33e739-6970-4696-8124-c2a61e1adef1 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:54.777624 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071788a6-b3d0-4ab0-b67f-515590611d60 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:54.777946 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071788a6-b3d0-4ab0-b67f-515590611d60 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:54.778230 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071788a6-b3d0-4ab0-b67f-515590611d60 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:54.779957 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 503/1031] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:54.786017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97a154-8c62-45fc-b78a-0a2a0fbf237d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:54.786306 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97a154-8c62-45fc-b78a-0a2a0fbf237d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:54.786578 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97a154-8c62-45fc-b78a-0a2a0fbf237d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:54.803289 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ed97a154-8c62-45fc-b78a-0a2a0fbf237d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:54.804478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ed97a154-8c62-45fc-b78a-0a2a0fbf237d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:54.819838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:54.855962 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33e739-6970-4696-8124-c2a61e1adef1 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:54.884138 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 504/1032] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:55:54.891567 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d34829-d1bb-4c96-a525-86eaf5d26822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:54.892490 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d34829-d1bb-4c96-a525-86eaf5d26822 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:54.892832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d34829-d1bb-4c96-a525-86eaf5d26822 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:54.893171 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d34829-d1bb-4c96-a525-86eaf5d26822 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:54.901116 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d34829-d1bb-4c96-a525-86eaf5d26822 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:54.902733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d34829-d1bb-4c96-a525-86eaf5d26822 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:54.906564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97a154-8c62-45fc-b78a-0a2a0fbf237d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:54.918159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-a5d34829-d1bb-4c96-a525-86eaf5d26822 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 20:55:54.918159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:54.918159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:54.918159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:54.918159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:54.918159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:54.918159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:54.918159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:54.918159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:54.918159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:54.918159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:54.918159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:54.918159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:54.918159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:54.918159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:54.918159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:54.919302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:54.920264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:54.920264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:54.920264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:54.920264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:54.920264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:54.920264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:54.920264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:54.920264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:54.920264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 20:55:54.920264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:54.920264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 529/1033] 10.222.0.61 () {56 vars in 1093 bytes} [Thu May 26 20:55:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:54.925078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d34829-d1bb-4c96-a525-86eaf5d26822 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:55.016463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:55.019922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97a154-8c62-45fc-b78a-0a2a0fbf237d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:55.034364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d34829-d1bb-4c96-a525-86eaf5d26822 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:55.060615 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3c922-d8bc-4db1-98f7-1d050836d7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:55.061423 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3c922-d8bc-4db1-98f7-1d050836d7fc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:55.061702 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3c922-d8bc-4db1-98f7-1d050836d7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:55.062005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3c922-d8bc-4db1-98f7-1d050836d7fc None admin] PATH_INFO: `/v3/services/image` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:55.062663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3c922-d8bc-4db1-98f7-1d050836d7fc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:55.064043 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3c922-d8bc-4db1-98f7-1d050836d7fc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:55.066128 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:55.074890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b06004-8f95-4001-bde1-27c9138b44a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:55.075618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b06004-8f95-4001-bde1-27c9138b44a5 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:55.075913 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b06004-8f95-4001-bde1-27c9138b44a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:55.076014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-6fe3c922-d8bc-4db1-98f7-1d050836d7fc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:55:55.076014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:55.076014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:55.076014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:55.076014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:55.076014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:55.076014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:55.076014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:55.076014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:55:55.076014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:55.076014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:55.076014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:55.076014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:55.076014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:55.076014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:55.076014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:55.076014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:55.076913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:55.076913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:55.076913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:55.076913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:55.076913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:55.076913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:55.076913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:55.076913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:55.076913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:55.076913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:55.076913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:55.076913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:55.076913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:55.076913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:55.076913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:55.076913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:55.077737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:55.077737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:55.077737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:55.077737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:55.077737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:55.077737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:55.077737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:55.077737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:55.077737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:55.077737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:55.077737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:55.077737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:55.077737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:55:55.077737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:55.078606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b06004-8f95-4001-bde1-27c9138b44a5 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:55.078606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b06004-8f95-4001-bde1-27c9138b44a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:55.078730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 505/1034] 10.222.0.61 () {56 vars in 1105 bytes} [Thu May 26 20:55:54 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:55.081984 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b06004-8f95-4001-bde1-27c9138b44a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:55.083462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3c922-d8bc-4db1-98f7-1d050836d7fc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:55.083796 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b06004-8f95-4001-bde1-27c9138b44a5 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:55.111059 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 530/1035] 10.222.0.61 () {56 vars in 1133 bytes} [Thu May 26 20:55:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:55.112728 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b06004-8f95-4001-bde1-27c9138b44a5 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:55.191346 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3c922-d8bc-4db1-98f7-1d050836d7fc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:55.221213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b06004-8f95-4001-bde1-27c9138b44a5 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:55.230790 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8477d57-bd97-42c1-affa-09f0d27aebfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:55.231485 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8477d57-bd97-42c1-affa-09f0d27aebfc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:55.231742 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8477d57-bd97-42c1-affa-09f0d27aebfc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:55.232083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8477d57-bd97-42c1-affa-09f0d27aebfc None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:55.232795 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8477d57-bd97-42c1-affa-09f0d27aebfc None admin] RBAC: Adding query filter params (name=image) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:55.233225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8477d57-bd97-42c1-affa-09f0d27aebfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:55.234531 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8477d57-bd97-42c1-affa-09f0d27aebfc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:55.240229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 506/1036] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:55.246589 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8477d57-bd97-42c1-affa-09f0d27aebfc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:55.261971 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64408d2-3ebc-4f90-b5ea-59fa936b5d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:55.263006 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64408d2-3ebc-4f90-b5ea-59fa936b5d87 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:55.263620 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64408d2-3ebc-4f90-b5ea-59fa936b5d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:55.263909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64408d2-3ebc-4f90-b5ea-59fa936b5d87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:55.274050 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:55.328050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:55.343592 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64408d2-3ebc-4f90-b5ea-59fa936b5d87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:55.345258 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64408d2-3ebc-4f90-b5ea-59fa936b5d87 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:55.349135 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8477d57-bd97-42c1-affa-09f0d27aebfc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:55.386107 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fe0b9-95e8-47f0-b229-2720a1374678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:55.386769 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fe0b9-95e8-47f0-b229-2720a1374678 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:55.387044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fe0b9-95e8-47f0-b229-2720a1374678 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:55.387579 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fe0b9-95e8-47f0-b229-2720a1374678 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:55.388009 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9fe0b9-95e8-47f0-b229-2720a1374678 None admin] RBAC: Adding query filter params (type=image) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:55.388359 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9fe0b9-95e8-47f0-b229-2720a1374678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:55.389727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9fe0b9-95e8-47f0-b229-2720a1374678 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:55.394934 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 507/1037] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:55.400732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fe0b9-95e8-47f0-b229-2720a1374678 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:55.455741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 531/1038] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:55:55 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 20:55:55.461664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64408d2-3ebc-4f90-b5ea-59fa936b5d87 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:55.496475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:55.507636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fe0b9-95e8-47f0-b229-2720a1374678 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:55.544146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cd164-73d9-4a9c-8a5d-d8320433363d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:55.544804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cd164-73d9-4a9c-8a5d-d8320433363d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:55.545093 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cd164-73d9-4a9c-8a5d-d8320433363d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:55.545397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cd164-73d9-4a9c-8a5d-d8320433363d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:55.546180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cd164-73d9-4a9c-8a5d-d8320433363d None admin] RBAC: Adding query filter params (interface=public, service_id=b1eea44afcb6467b831a59d8ebc39cb7, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:55.546519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cd164-73d9-4a9c-8a5d-d8320433363d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:55.547887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cd164-73d9-4a9c-8a5d-d8320433363d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:55.548789 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:55.553467 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 508/1039] 10.222.0.61 () {56 vars in 1251 bytes} [Thu May 26 20:55:55 2022] GET /identity/v3/endpoints?service_id=b1eea44afcb6467b831a59d8ebc39cb7&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:55.558816 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cd164-73d9-4a9c-8a5d-d8320433363d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:55.570932 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64408d2-3ebc-4f90-b5ea-59fa936b5d87 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:55.609506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9c29e-3d99-4f01-9e25-aabbd0202b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:55.610359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9c29e-3d99-4f01-9e25-aabbd0202b3d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:55.610635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9c29e-3d99-4f01-9e25-aabbd0202b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:55.610902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9c29e-3d99-4f01-9e25-aabbd0202b3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:55.621702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9c29e-3d99-4f01-9e25-aabbd0202b3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:55.623701 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9c29e-3d99-4f01-9e25-aabbd0202b3d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:55.646504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-aec9c29e-3d99-4f01-9e25-aabbd0202b3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:55.646504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:55.646504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:55.646504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:55.646504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:55.646504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:55.646504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:55.646504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:55.646504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:55.646504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:55.646504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:55.646504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:55.646504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:55.646504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:55.646504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:55.647436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:55.647436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:55.647436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:55.647436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:55.647436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:55.647436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:55.647436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:55.647436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:55.647436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:55.647436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:55.647436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:55.647436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:55.647436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:55.647436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:55.647436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:55.647436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:55.647436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:55.653234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:55.653234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:55.653234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:55.653234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:55.653234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 532/1040] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:55.654030 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9c29e-3d99-4f01-9e25-aabbd0202b3d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:55.662636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cd164-73d9-4a9c-8a5d-d8320433363d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:55.700385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb85ca-bf0a-4b14-891f-37356b0c7f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:55.701218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb85ca-bf0a-4b14-891f-37356b0c7f4e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:55.701944 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb85ca-bf0a-4b14-891f-37356b0c7f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:55.702345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb85ca-bf0a-4b14-891f-37356b0c7f4e None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:55.702925 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb85ca-bf0a-4b14-891f-37356b0c7f4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:55.704319 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb85ca-bf0a-4b14-891f-37356b0c7f4e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:55.721829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 509/1041] 10.222.0.61 () {56 vars in 1087 bytes} [Thu May 26 20:55:55 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:55:55.783145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9c29e-3d99-4f01-9e25-aabbd0202b3d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:55.823517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e9c13-ca12-4bcc-b832-f2014066bdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:55.824123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e9c13-ca12-4bcc-b832-f2014066bdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:55.824408 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e9c13-ca12-4bcc-b832-f2014066bdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:55.824679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e9c13-ca12-4bcc-b832-f2014066bdc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:55.825424 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e9c13-ca12-4bcc-b832-f2014066bdc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:55.825867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e9c13-ca12-4bcc-b832-f2014066bdc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:55.827309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e9c13-ca12-4bcc-b832-f2014066bdc8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:55.835351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:55.848280 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb85ca-bf0a-4b14-891f-37356b0c7f4e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:55.849408 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 533/1042] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:55.871878 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:55.965902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb85ca-bf0a-4b14-891f-37356b0c7f4e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:56.002972 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddd2bd-8284-42bc-9ca9-147ad5c79ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:56.003785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddd2bd-8284-42bc-9ca9-147ad5c79ffe None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:56.004062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddd2bd-8284-42bc-9ca9-147ad5c79ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:56.004310 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddd2bd-8284-42bc-9ca9-147ad5c79ffe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:56.011661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddd2bd-8284-42bc-9ca9-147ad5c79ffe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:56.013161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddd2bd-8284-42bc-9ca9-147ad5c79ffe None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:56.027948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-cdddd2bd-8284-42bc-9ca9-147ad5c79ffe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:56.027948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:56.027948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:56.027948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:56.027948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:56.027948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:56.027948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:56.027948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:56.027948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:56.027948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:56.027948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:56.027948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:56.027948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:55:56.027948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:55:56.027948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:55:56.028869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:55:56.028869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:56.028869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:56.028869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:56.028869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:56.028869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:56.028869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:56.028869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:56.028869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:56.028869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:56.028869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:56.028869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:56.028869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:56.028869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:56.028869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:56.028869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:56.028869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:56.030245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:55:56.030245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:55:56.030245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:55:56.030245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:55:56.030245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:55:56.030245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:55:56.030245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:55:56.030245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:56.030245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 510/1043] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:55:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:56.035325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e9c13-ca12-4bcc-b832-f2014066bdc8 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:56.143545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e9c13-ca12-4bcc-b832-f2014066bdc8 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:56.152784 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7df8c-fe02-4882-b386-86b22e0651cb None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:56.153094 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7df8c-fe02-4882-b386-86b22e0651cb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:56.153373 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7df8c-fe02-4882-b386-86b22e0651cb None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:56.155265 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 511/1044] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:56.160199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86cb54-bfe7-41e2-82f5-56c8aa29831a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:56.160497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86cb54-bfe7-41e2-82f5-56c8aa29831a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:56.160756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86cb54-bfe7-41e2-82f5-56c8aa29831a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:56.178542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2b86cb54-bfe7-41e2-82f5-56c8aa29831a None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:56.178956 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811f189-ee07-48dd-88e9-395df0b974d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:56.179634 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811f189-ee07-48dd-88e9-395df0b974d5 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:56.179735 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2b86cb54-bfe7-41e2-82f5-56c8aa29831a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:56.179916 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811f189-ee07-48dd-88e9-395df0b974d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:56.180190 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811f189-ee07-48dd-88e9-395df0b974d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:56.180984 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811f189-ee07-48dd-88e9-395df0b974d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:56.181289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811f189-ee07-48dd-88e9-395df0b974d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:56.182810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811f189-ee07-48dd-88e9-395df0b974d5 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:56.196003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 534/1045] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:55:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:56.202392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811f189-ee07-48dd-88e9-395df0b974d5 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:56.255420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 512/1046] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:55:56.271258 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:56.278818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86cb54-bfe7-41e2-82f5-56c8aa29831a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:56.288882 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:56.319357 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811f189-ee07-48dd-88e9-395df0b974d5 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:56.356255 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a1415-1dd0-4618-b33b-abbd2c2a44db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:56.357272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a1415-1dd0-4618-b33b-abbd2c2a44db None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:56.357835 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a1415-1dd0-4618-b33b-abbd2c2a44db None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:56.358270 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a1415-1dd0-4618-b33b-abbd2c2a44db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:56.359266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a1415-1dd0-4618-b33b-abbd2c2a44db None admin] RBAC: Adding query filter params (role.id=043685c168c24e0f890ef4479ad74e90, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=a99b767501244338bc48fb5428a589a1) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:56.359583 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a1415-1dd0-4618-b33b-abbd2c2a44db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:56.361533 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a1415-1dd0-4618-b33b-abbd2c2a44db None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:56.377828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 535/1047] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:55:56 2022] GET /identity/v3/role_assignments?user.id=a99b767501244338bc48fb5428a589a1&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=043685c168c24e0f890ef4479ad74e90 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:56.393390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86cb54-bfe7-41e2-82f5-56c8aa29831a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:56.432421 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ef08a-ced1-4051-8ee8-d05aa6ee8295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:56.433266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ef08a-ced1-4051-8ee8-d05aa6ee8295 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:56.433551 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ef08a-ced1-4051-8ee8-d05aa6ee8295 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:56.433827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ef08a-ced1-4051-8ee8-d05aa6ee8295 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:56.446778 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ef08a-ced1-4051-8ee8-d05aa6ee8295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:56.454856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-032ef08a-ced1-4051-8ee8-d05aa6ee8295 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:55:56.454856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:56.454856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:56.454856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:56.454856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:56.454856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:56.454856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:56.454856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:56.454856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:56.454856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:56.454856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:56.454856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:56.454856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:56.454856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:56.454856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:56.454856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:56.455902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:56.455902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:56.455902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:56.455902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:56.455902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:56.455902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:56.455902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:56.455902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:56.455902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:56.455902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:56.455902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:56.455902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:56.455902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:56.455902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:56.455902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:56.455902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:56.456763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:56.456763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:56.456763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:56.456763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:56.456763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:56.456763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:56.456763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:56.456763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:56.456763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:56.456763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:56.456763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:55:56.456763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:56.456763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 513/1048] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:55:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:56.462640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a1415-1dd0-4618-b33b-abbd2c2a44db None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:56.577610 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a1415-1dd0-4618-b33b-abbd2c2a44db None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:56.601013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:56.613781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9921ca-86fe-440b-89dc-fde475dbbed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:56.614560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9921ca-86fe-440b-89dc-fde475dbbed5 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:56.614820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9921ca-86fe-440b-89dc-fde475dbbed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:56.615110 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9921ca-86fe-440b-89dc-fde475dbbed5 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:56.615856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9921ca-86fe-440b-89dc-fde475dbbed5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:56.616155 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9921ca-86fe-440b-89dc-fde475dbbed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:56.617561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9921ca-86fe-440b-89dc-fde475dbbed5 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:56.627058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 536/1049] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:55:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:56.632649 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ef08a-ced1-4051-8ee8-d05aa6ee8295 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:56.702495 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:56.739549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ef08a-ced1-4051-8ee8-d05aa6ee8295 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:56.781050 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826f938-93c8-438a-894d-69b1c3c48214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:56.781969 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826f938-93c8-438a-894d-69b1c3c48214 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:56.782251 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826f938-93c8-438a-894d-69b1c3c48214 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:56.782521 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826f938-93c8-438a-894d-69b1c3c48214 None admin] PATH_INFO: `/v3/users/60a5692a86784918bfbcf2b4708c9e05` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:56.796425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826f938-93c8-438a-894d-69b1c3c48214 None admin] RBAC: Authorizing `identity:get_user(user_id=60a5692a86784918bfbcf2b4708c9e05)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:56.797920 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826f938-93c8-438a-894d-69b1c3c48214 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:56.799846 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 514/1050] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:55:56 2022] GET /identity/v3/users/60a5692a86784918bfbcf2b4708c9e05 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:56.805370 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9921ca-86fe-440b-89dc-fde475dbbed5 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:56.910478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9921ca-86fe-440b-89dc-fde475dbbed5 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:56.944719 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6da4c-7d57-4ea7-b94a-518aa1e677a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:56.945380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6da4c-7d57-4ea7-b94a-518aa1e677a3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:56.945661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6da4c-7d57-4ea7-b94a-518aa1e677a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:56.945959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6da4c-7d57-4ea7-b94a-518aa1e677a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:56.997612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:57.014722 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6da4c-7d57-4ea7-b94a-518aa1e677a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:57.016264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6da4c-7d57-4ea7-b94a-518aa1e677a3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:57.123110 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 537/1051] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:55:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:55:57.125001 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826f938-93c8-438a-894d-69b1c3c48214 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:57.230532 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826f938-93c8-438a-894d-69b1c3c48214 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:57.257242 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:57.270109 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af468bae-a206-441e-a43a-f4b52513de14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:57.270994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af468bae-a206-441e-a43a-f4b52513de14 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:57.271276 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af468bae-a206-441e-a43a-f4b52513de14 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:57.271552 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af468bae-a206-441e-a43a-f4b52513de14 None admin] PATH_INFO: `/v3/projects/9104ad147e8e411a90de4639d9ecf17f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:57.272731 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af468bae-a206-441e-a43a-f4b52513de14 None admin] RBAC: Authorizing `identity:get_project(project_id=9104ad147e8e411a90de4639d9ecf17f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:57.274203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af468bae-a206-441e-a43a-f4b52513de14 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:57.281007 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 515/1052] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:55:57 2022] GET /identity/v3/projects/9104ad147e8e411a90de4639d9ecf17f => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:57.282750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6da4c-7d57-4ea7-b94a-518aa1e677a3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:57.375179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:57.393385 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6da4c-7d57-4ea7-b94a-518aa1e677a3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:57.428188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dd6c7-8074-4143-9b6c-a72e7c2cb0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:57.428862 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dd6c7-8074-4143-9b6c-a72e7c2cb0ac None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:57.429149 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dd6c7-8074-4143-9b6c-a72e7c2cb0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:57.429427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dd6c7-8074-4143-9b6c-a72e7c2cb0ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:57.430303 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775dd6c7-8074-4143-9b6c-a72e7c2cb0ac None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=9104ad147e8e411a90de4639d9ecf17f, user.id=60a5692a86784918bfbcf2b4708c9e05) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:57.430618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775dd6c7-8074-4143-9b6c-a72e7c2cb0ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:57.432073 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775dd6c7-8074-4143-9b6c-a72e7c2cb0ac None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:57.438242 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 538/1053] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:55:57 2022] GET /identity/v3/role_assignments?user.id=60a5692a86784918bfbcf2b4708c9e05&scope.project.id=9104ad147e8e411a90de4639d9ecf17f&role.id=aefba81d87bf47258c17064af7d9a05f => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:57.923129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ffd1d-c731-434b-ab4f-aab700db64d5 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:57.923674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ffd1d-c731-434b-ab4f-aab700db64d5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:57.923674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ffd1d-c731-434b-ab4f-aab700db64d5 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:57.925833 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 516/1054] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:57.930750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87648c93-4ecc-4acd-ab23-a11e5273b7c2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:57.931161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87648c93-4ecc-4acd-ab23-a11e5273b7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:57.931357 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87648c93-4ecc-4acd-ab23-a11e5273b7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:57.949039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-87648c93-4ecc-4acd-ab23-a11e5273b7c2 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:57.950269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-87648c93-4ecc-4acd-ab23-a11e5273b7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:58.017940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 539/1055] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:58.040638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ffd1d-c731-434b-ab4f-aab700db64d5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:58.147377 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ffd1d-c731-434b-ab4f-aab700db64d5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:58.182039 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c0b66-9645-4f42-8f82-aaf7c4de6110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:58.182846 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c0b66-9645-4f42-8f82-aaf7c4de6110 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:58.183125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c0b66-9645-4f42-8f82-aaf7c4de6110 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:58.183394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c0b66-9645-4f42-8f82-aaf7c4de6110 None admin] PATH_INFO: `/v3/services/image` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:58.184047 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c0b66-9645-4f42-8f82-aaf7c4de6110 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:58.185470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c0b66-9645-4f42-8f82-aaf7c4de6110 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:58.197222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-825c0b66-9645-4f42-8f82-aaf7c4de6110 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:55:58.197222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:58.197222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:55:58.197222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:55:58.197222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:55:58.197222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:55:58.197222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:55:58.197222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:58.197222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:55:58.197222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:58.197222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:55:58.197222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:58.197222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:58.197222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:58.197222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:58.197222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:58.197222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:58.198461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:58.198461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:58.198461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:58.198461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:58.198461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:58.198461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:58.198461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:55:58.198461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:55:58.198461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:55:58.198461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:55:58.198461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:58.198461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:58.198461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:58.198461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:58.198461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:58.198461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:58.199295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:58.199295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:58.199295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:58.199295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:58.199295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:58.199295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:58.199295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:58.199295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:58.199295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:58.199295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:58.199295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:55:58.199295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:55:58.199295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:55:58.199295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:58.201905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 517/1056] 10.222.0.61 () {56 vars in 1105 bytes} [Thu May 26 20:55:58 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:58.205160 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87648c93-4ecc-4acd-ab23-a11e5273b7c2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:58.286311 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:58.310167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87648c93-4ecc-4acd-ab23-a11e5273b7c2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:58.346109 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ebc5f-41cf-4d78-ad8d-7e675fd57309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:58.346785 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ebc5f-41cf-4d78-ad8d-7e675fd57309 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:58.347069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ebc5f-41cf-4d78-ad8d-7e675fd57309 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:58.347347 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ebc5f-41cf-4d78-ad8d-7e675fd57309 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:58.348054 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ebc5f-41cf-4d78-ad8d-7e675fd57309 None admin] RBAC: Adding query filter params (name=image) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:58.348357 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ebc5f-41cf-4d78-ad8d-7e675fd57309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:58.349748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ebc5f-41cf-4d78-ad8d-7e675fd57309 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:58.354968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 540/1057] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:58.360800 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c0b66-9645-4f42-8f82-aaf7c4de6110 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:58.426651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:58.472183 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c0b66-9645-4f42-8f82-aaf7c4de6110 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:58.506034 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a6d5d-d286-49d2-88fd-2d8fae900241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:58.506715 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a6d5d-d286-49d2-88fd-2d8fae900241 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:58.506999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a6d5d-d286-49d2-88fd-2d8fae900241 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:58.507596 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a6d5d-d286-49d2-88fd-2d8fae900241 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:58.508340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a6d5d-d286-49d2-88fd-2d8fae900241 None admin] RBAC: Adding query filter params (type=image) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:58.508646 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a6d5d-d286-49d2-88fd-2d8fae900241 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:58.510096 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a6d5d-d286-49d2-88fd-2d8fae900241 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:58.516628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 518/1058] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:58.522670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ebc5f-41cf-4d78-ad8d-7e675fd57309 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:58.582812 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33f9ed-c5f4-448f-beda-bebf211b5ebd None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:58.583010 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33f9ed-c5f4-448f-beda-bebf211b5ebd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:58.583287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33f9ed-c5f4-448f-beda-bebf211b5ebd None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:58.585003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 519/1059] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:55:58.590548 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c0af5-0f39-412e-bb60-b566b0bff329 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:58.590829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c0af5-0f39-412e-bb60-b566b0bff329 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:58.591160 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c0af5-0f39-412e-bb60-b566b0bff329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:58.609454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8d8c0af5-0f39-412e-bb60-b566b0bff329 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:58.610910 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8d8c0af5-0f39-412e-bb60-b566b0bff329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:58.634711 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ebc5f-41cf-4d78-ad8d-7e675fd57309 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:58.675267 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418770ad-b77f-4593-bea7-f932b094b06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:58.676724 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418770ad-b77f-4593-bea7-f932b094b06b None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:58.677309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418770ad-b77f-4593-bea7-f932b094b06b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:58.677892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418770ad-b77f-4593-bea7-f932b094b06b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:58.678985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418770ad-b77f-4593-bea7-f932b094b06b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:58.681126 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418770ad-b77f-4593-bea7-f932b094b06b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:58.686999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 520/1060] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:55:58.703037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:58.710075 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c0af5-0f39-412e-bb60-b566b0bff329 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:58.711269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 541/1061] 10.222.0.61 () {60 vars in 1144 bytes} [Thu May 26 20:55:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:55:58.781297 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:58.833933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c0af5-0f39-412e-bb60-b566b0bff329 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:58.880502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89548e2f-a54a-4d41-8896-55e1e462b2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:58.881343 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89548e2f-a54a-4d41-8896-55e1e462b2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:58.881627 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89548e2f-a54a-4d41-8896-55e1e462b2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:58.881931 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89548e2f-a54a-4d41-8896-55e1e462b2c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:58.893609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89548e2f-a54a-4d41-8896-55e1e462b2c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:58.901928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-89548e2f-a54a-4d41-8896-55e1e462b2c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:55:58.901928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:58.901928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:58.901928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:58.901928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:58.901928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:58.901928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:58.901928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:58.901928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:58.901928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:58.901928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:58.901928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:58.901928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:58.901928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:58.901928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:58.901928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:58.902848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:58.902848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:58.902848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:58.902848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:58.902848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:58.902848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:58.902848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:58.902848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:58.902848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:58.902848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:58.902848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:58.902848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:58.902848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:58.902848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:58.902848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:58.902848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:58.903808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:58.903808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:58.903808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:58.903808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:58.903808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:58.903808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:58.903808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:58.903808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:58.903808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:58.903808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:58.903808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:55:58.903808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:58.903808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 521/1062] 10.222.0.61 () {56 vars in 1120 bytes} [Thu May 26 20:55:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:58.910382 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418770ad-b77f-4593-bea7-f932b094b06b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:59.018862 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418770ad-b77f-4593-bea7-f932b094b06b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:59.053529 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01945fe4-4306-4bbd-b839-971d97f3f0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:59.054251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01945fe4-4306-4bbd-b839-971d97f3f0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:59.054535 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01945fe4-4306-4bbd-b839-971d97f3f0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:59.054810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01945fe4-4306-4bbd-b839-971d97f3f0c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:59.055565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01945fe4-4306-4bbd-b839-971d97f3f0c1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:59.055870 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01945fe4-4306-4bbd-b839-971d97f3f0c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:59.057328 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01945fe4-4306-4bbd-b839-971d97f3f0c1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:59.070638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 542/1063] 10.222.0.61 () {56 vars in 1115 bytes} [Thu May 26 20:55:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:55:59.071659 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89548e2f-a54a-4d41-8896-55e1e462b2c5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:59.176598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89548e2f-a54a-4d41-8896-55e1e462b2c5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:59.186418 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:59.213348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27bb03-a1e2-4b02-a349-21db0385f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:59.214185 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27bb03-a1e2-4b02-a349-21db0385f6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:59.214468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27bb03-a1e2-4b02-a349-21db0385f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:59.214739 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27bb03-a1e2-4b02-a349-21db0385f6a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:59.226200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27bb03-a1e2-4b02-a349-21db0385f6a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:59.227671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27bb03-a1e2-4b02-a349-21db0385f6a7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:59.246115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8c27bb03-a1e2-4b02-a349-21db0385f6a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:59.246115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:59.246115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:59.246115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:59.246115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:59.246115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:59.246115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:59.246115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:59.246115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:59.246115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:59.246115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:59.246115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:59.246115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:59.246115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:59.246115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:59.247064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:59.247064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:59.247064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:59.247064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:59.247064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:59.247064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:59.247064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:59.247064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:59.247064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:59.247064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:59.247064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:59.247064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:59.247064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:59.247064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:59.247064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:59.247064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:59.247064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:59.248173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:59.248173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:59.248173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:59.248173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:59.248173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 522/1064] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:59.254566 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01945fe4-4306-4bbd-b839-971d97f3f0c1 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:59.318436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:59.362531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01945fe4-4306-4bbd-b839-971d97f3f0c1 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:59.397907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea775e5-a6f3-4703-9b46-d328edcd9f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:59.398587 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea775e5-a6f3-4703-9b46-d328edcd9f4c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:59.398870 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea775e5-a6f3-4703-9b46-d328edcd9f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:59.399142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea775e5-a6f3-4703-9b46-d328edcd9f4c None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:59.399864 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea775e5-a6f3-4703-9b46-d328edcd9f4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:59.400169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea775e5-a6f3-4703-9b46-d328edcd9f4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:59.401562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea775e5-a6f3-4703-9b46-d328edcd9f4c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:59.419101 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 543/1065] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:59.420480 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27bb03-a1e2-4b02-a349-21db0385f6a7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:59.532343 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27bb03-a1e2-4b02-a349-21db0385f6a7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:59.567186 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64aa577-d4d2-461d-ae25-05484599bba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:59.567993 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aa577-d4d2-461d-ae25-05484599bba7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:59.568274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aa577-d4d2-461d-ae25-05484599bba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:59.568548 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aa577-d4d2-461d-ae25-05484599bba7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:59.576674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64aa577-d4d2-461d-ae25-05484599bba7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:59.578184 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64aa577-d4d2-461d-ae25-05484599bba7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:59.593221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e64aa577-d4d2-461d-ae25-05484599bba7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 20:55:59.593221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:59.593221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:59.593221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:59.593221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:59.593221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:59.593221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:59.593221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:59.593221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:59.593221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:59.593221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:59.593221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:59.593221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:55:59.593221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:55:59.593221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:55:59.593221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:59.594229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:59.595175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:59.595175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:59.595175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:55:59.595175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:55:59.595175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:55:59.595175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:55:59.595175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:55:59.595175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:55:59.595175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 20:55:59.595175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:59.595175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 523/1066] 10.222.0.61 () {56 vars in 1093 bytes} [Thu May 26 20:55:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:59.601780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea775e5-a6f3-4703-9b46-d328edcd9f4c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:59.628351 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0db8db-41de-4b92-bc47-dee41ced932a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:59.628911 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0db8db-41de-4b92-bc47-dee41ced932a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:59.629335 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0db8db-41de-4b92-bc47-dee41ced932a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:59.630906 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 524/1067] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:55:59.636187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ede2d-7254-458a-8f0f-3b82e2385806 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:59.636471 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ede2d-7254-458a-8f0f-3b82e2385806 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:59.636744 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ede2d-7254-458a-8f0f-3b82e2385806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:59.655070 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a77ede2d-7254-458a-8f0f-3b82e2385806 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:55:59.656265 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a77ede2d-7254-458a-8f0f-3b82e2385806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:55:59.671157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:59.714810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea775e5-a6f3-4703-9b46-d328edcd9f4c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:59.729327 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 525/1068] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:55:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:55:59.736376 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:59.751037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6b107-ec9f-401a-a681-c4428a7739f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:59.751765 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6b107-ec9f-401a-a681-c4428a7739f0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:59.752049 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6b107-ec9f-401a-a681-c4428a7739f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:59.752322 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6b107-ec9f-401a-a681-c4428a7739f0 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:59.752713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ede2d-7254-458a-8f0f-3b82e2385806 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:59.753159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6b107-ec9f-401a-a681-c4428a7739f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:55:59.753467 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6b107-ec9f-401a-a681-c4428a7739f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:59.754937 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6b107-ec9f-401a-a681-c4428a7739f0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:59.780013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 544/1069] 10.222.0.61 () {56 vars in 1133 bytes} [Thu May 26 20:55:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:55:59.781851 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6b107-ec9f-401a-a681-c4428a7739f0 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:59.868120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ede2d-7254-458a-8f0f-3b82e2385806 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:59.886279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6b107-ec9f-401a-a681-c4428a7739f0 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:55:59.905219 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3648b20-490e-47c7-82d9-4cef67e06baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:59.906049 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3648b20-490e-47c7-82d9-4cef67e06baa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:59.906335 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3648b20-490e-47c7-82d9-4cef67e06baa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:59.906613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3648b20-490e-47c7-82d9-4cef67e06baa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:59.917204 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3648b20-490e-47c7-82d9-4cef67e06baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:55:59.921495 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04505106-f88e-4602-8efc-5c2e56f8de01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:55:59.922350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04505106-f88e-4602-8efc-5c2e56f8de01 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:55:59.922635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04505106-f88e-4602-8efc-5c2e56f8de01 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:55:59.922912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04505106-f88e-4602-8efc-5c2e56f8de01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:55:59.924898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d3648b20-490e-47c7-82d9-4cef67e06baa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:55:59.924898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:59.924898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:59.924898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:59.924898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:59.924898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:59.924898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:59.924898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:59.924898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:59.924898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:59.924898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:59.924898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:59.924898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:55:59.924898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:55:59.924898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:55:59.924898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:55:59.925832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:55:59.925832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:55:59.925832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:55:59.925832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:55:59.925832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:59.925832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:59.925832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:59.925832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:59.925832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:59.925832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:59.925832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:59.925832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:55:59.925832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:59.925832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:59.925832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:59.925832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:59.926803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:59.926803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:59.926803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:59.926803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:59.926803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:55:59.926803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:55:59.926803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:55:59.926803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:55:59.926803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:55:59.926803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:55:59.926803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:55:59.926803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:55:59.926803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 526/1070] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:55:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:55:59.932006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3648b20-490e-47c7-82d9-4cef67e06baa None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:59.937437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04505106-f88e-4602-8efc-5c2e56f8de01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:55:59.938987 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04505106-f88e-4602-8efc-5c2e56f8de01 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:55:59.946762 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:55:59.958053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-04505106-f88e-4602-8efc-5c2e56f8de01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:59.958053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:55:59.958053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:55:59.958053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:55:59.958053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:55:59.958053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:55:59.958053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:55:59.958053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:55:59.958053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:55:59.958053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:55:59.958053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:55:59.958053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:55:59.958053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:55:59.958053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:55:59.958053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:55:59.958989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:55:59.958989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:55:59.958989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:55:59.958989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:55:59.958989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:55:59.958989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:55:59.958989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:55:59.958989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:55:59.958989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:55:59.958989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:55:59.958989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:55:59.958989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:55:59.958989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:55:59.958989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:55:59.958989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:55:59.958989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:55:59.958989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:55:59.960280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:55:59.960280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:55:59.960280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:55:59.960280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:55:59.960280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 545/1071] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:55:59.965338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04505106-f88e-4602-8efc-5c2e56f8de01 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:55:59.999158 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:00.044139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3648b20-490e-47c7-82d9-4cef67e06baa None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:00.074609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04505106-f88e-4602-8efc-5c2e56f8de01 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:00.080241 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61aa65-d64a-4cd6-8bc0-6fd248688fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:00.080924 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61aa65-d64a-4cd6-8bc0-6fd248688fff None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:00.081206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61aa65-d64a-4cd6-8bc0-6fd248688fff None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:00.081483 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61aa65-d64a-4cd6-8bc0-6fd248688fff None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:00.082287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61aa65-d64a-4cd6-8bc0-6fd248688fff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:00.082622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61aa65-d64a-4cd6-8bc0-6fd248688fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:00.083978 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61aa65-d64a-4cd6-8bc0-6fd248688fff None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:00.094858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 527/1072] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:55:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:00.100689 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61aa65-d64a-4cd6-8bc0-6fd248688fff None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:00.111700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8927c81-8203-4bb1-8b32-0e91de8d71b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:00.112655 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927c81-8203-4bb1-8b32-0e91de8d71b2 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:00.112655 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927c81-8203-4bb1-8b32-0e91de8d71b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:00.112938 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927c81-8203-4bb1-8b32-0e91de8d71b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:00.113650 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8927c81-8203-4bb1-8b32-0e91de8d71b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:00.113988 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8927c81-8203-4bb1-8b32-0e91de8d71b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:00.115384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8927c81-8203-4bb1-8b32-0e91de8d71b2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:00.132736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 546/1073] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:56:00.134124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8927c81-8203-4bb1-8b32-0e91de8d71b2 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:00.175930 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:00.207060 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61aa65-d64a-4cd6-8bc0-6fd248688fff None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:00.227828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:00.239290 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8927c81-8203-4bb1-8b32-0e91de8d71b2 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:00.244790 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580473d-401a-4a80-8fc4-ef25f627b4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:00.245961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580473d-401a-4a80-8fc4-ef25f627b4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:00.246445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580473d-401a-4a80-8fc4-ef25f627b4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:00.246869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580473d-401a-4a80-8fc4-ef25f627b4a1 None admin] PATH_INFO: `/v3/users/60a5692a86784918bfbcf2b4708c9e05` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:00.248496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580473d-401a-4a80-8fc4-ef25f627b4a1 None admin] RBAC: Authorizing `identity:get_user(user_id=60a5692a86784918bfbcf2b4708c9e05)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:00.250056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580473d-401a-4a80-8fc4-ef25f627b4a1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:00.256449 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 528/1074] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:56:00 2022] GET /identity/v3/users/60a5692a86784918bfbcf2b4708c9e05 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:56:00.257404 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580473d-401a-4a80-8fc4-ef25f627b4a1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:00.281071 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5caef4-fbeb-4930-858f-05d9b373957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:00.281922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5caef4-fbeb-4930-858f-05d9b373957a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:00.282215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5caef4-fbeb-4930-858f-05d9b373957a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:00.282495 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5caef4-fbeb-4930-858f-05d9b373957a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:00.289417 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5caef4-fbeb-4930-858f-05d9b373957a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:00.290939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5caef4-fbeb-4930-858f-05d9b373957a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:00.305442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-2c5caef4-fbeb-4930-858f-05d9b373957a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:56:00.305442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:56:00.305442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:56:00.305442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:56:00.305442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:56:00.305442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:56:00.305442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:56:00.305442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:56:00.305442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:56:00.305442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:56:00.305442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:56:00.305442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:56:00.305442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:56:00.305442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:56:00.305442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:56:00.306524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:56:00.306524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:56:00.306524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:56:00.306524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:56:00.306524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:56:00.306524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:56:00.306524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:56:00.306524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:56:00.306524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:56:00.306524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:56:00.306524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:56:00.306524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:56:00.306524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:56:00.306524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:56:00.306524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:56:00.306524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:56:00.306524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:56:00.307591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:56:00.307591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:56:00.307591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:56:00.307591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:56:00.307591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:56:00.307591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:56:00.307591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:56:00.307591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:56:00.309344 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 547/1075] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:56:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:56:00.315804 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5caef4-fbeb-4930-858f-05d9b373957a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:00.365434 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580473d-401a-4a80-8fc4-ef25f627b4a1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:00.403963 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d0395-d7d5-4749-af82-e29aa680fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:00.405028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0395-d7d5-4749-af82-e29aa680fde1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:00.405390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0395-d7d5-4749-af82-e29aa680fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:00.405713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0395-d7d5-4749-af82-e29aa680fde1 None admin] PATH_INFO: `/v3/projects/9104ad147e8e411a90de4639d9ecf17f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:00.407026 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d0395-d7d5-4749-af82-e29aa680fde1 None admin] RBAC: Authorizing `identity:get_project(project_id=9104ad147e8e411a90de4639d9ecf17f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:00.408477 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d0395-d7d5-4749-af82-e29aa680fde1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:00.415563 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 529/1076] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:56:00 2022] GET /identity/v3/projects/9104ad147e8e411a90de4639d9ecf17f => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:00.416395 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d0395-d7d5-4749-af82-e29aa680fde1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:00.423161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5caef4-fbeb-4930-858f-05d9b373957a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:00.428619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:00.461527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4734cf-a01e-4e80-92ce-37c57fe8b4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:00.462244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4734cf-a01e-4e80-92ce-37c57fe8b4ca None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:00.462531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4734cf-a01e-4e80-92ce-37c57fe8b4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:00.462894 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4734cf-a01e-4e80-92ce-37c57fe8b4ca None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:00.463602 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4734cf-a01e-4e80-92ce-37c57fe8b4ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:00.463916 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4734cf-a01e-4e80-92ce-37c57fe8b4ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:00.465383 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4734cf-a01e-4e80-92ce-37c57fe8b4ca None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:00.477985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 548/1077] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:56:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:00.484761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4734cf-a01e-4e80-92ce-37c57fe8b4ca None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:00.497879 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:00.528582 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d0395-d7d5-4749-af82-e29aa680fde1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:00.572679 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1cc7b-5a68-4e56-973a-49d054dc64dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:00.573596 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1cc7b-5a68-4e56-973a-49d054dc64dc None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:00.573917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1cc7b-5a68-4e56-973a-49d054dc64dc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:00.574199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1cc7b-5a68-4e56-973a-49d054dc64dc None admin] PATH_INFO: `/v3/projects/9104ad147e8e411a90de4639d9ecf17f/users/60a5692a86784918bfbcf2b4708c9e05/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:00.576325 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1cc7b-5a68-4e56-973a-49d054dc64dc None admin] RBAC: Authorizing `identity:create_grant(project_id=9104ad147e8e411a90de4639d9ecf17f, user_id=60a5692a86784918bfbcf2b4708c9e05, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:00.577788 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1cc7b-5a68-4e56-973a-49d054dc64dc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:00.593853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 530/1078] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:56:00 2022] PUT /identity/v3/projects/9104ad147e8e411a90de4639d9ecf17f/users/60a5692a86784918bfbcf2b4708c9e05/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:56:00.619605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4734cf-a01e-4e80-92ce-37c57fe8b4ca None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:00.659166 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2174c8a-1954-4bdf-b5ed-ffd14a35a2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:00.660013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2174c8a-1954-4bdf-b5ed-ffd14a35a2fd None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:00.660299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2174c8a-1954-4bdf-b5ed-ffd14a35a2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:00.660578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2174c8a-1954-4bdf-b5ed-ffd14a35a2fd None admin] PATH_INFO: `/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/a99b767501244338bc48fb5428a589a1/roles/043685c168c24e0f890ef4479ad74e90` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:00.663029 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2174c8a-1954-4bdf-b5ed-ffd14a35a2fd None admin] RBAC: Authorizing `identity:create_grant(project_id=2c23678abd4f4dacaf35d73c5184e72e, user_id=a99b767501244338bc48fb5428a589a1, role_id=043685c168c24e0f890ef4479ad74e90)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:00.664547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2174c8a-1954-4bdf-b5ed-ffd14a35a2fd None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:00.680799 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 549/1079] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:56:00 2022] PUT /identity/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/a99b767501244338bc48fb5428a589a1/roles/043685c168c24e0f890ef4479ad74e90 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:56:00.956954 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974a932-5b84-4978-ae90-74d45804a3e9 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:00.957316 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974a932-5b84-4978-ae90-74d45804a3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:00.957486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974a932-5b84-4978-ae90-74d45804a3e9 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:00.958909 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 531/1080] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:00.964870 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532e706-5e85-4cc8-8623-089291b0d5d2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:00.965129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532e706-5e85-4cc8-8623-089291b0d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:00.965424 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532e706-5e85-4cc8-8623-089291b0d5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:00.983293 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6532e706-5e85-4cc8-8623-089291b0d5d2 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:00.984487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6532e706-5e85-4cc8-8623-089291b0d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:01.050375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:01.056547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 550/1081] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:01.078588 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974a932-5b84-4978-ae90-74d45804a3e9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:01.155145 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:01.196136 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974a932-5b84-4978-ae90-74d45804a3e9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:01.232610 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a976f-2943-44f0-a0e1-59b15010e9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:01.233187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a976f-2943-44f0-a0e1-59b15010e9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:01.233467 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a976f-2943-44f0-a0e1-59b15010e9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:01.233807 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a976f-2943-44f0-a0e1-59b15010e9c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:01.303103 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a976f-2943-44f0-a0e1-59b15010e9c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:01.304568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a976f-2943-44f0-a0e1-59b15010e9c8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:01.371825 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:01.409233 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 532/1082] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:56:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:56:01.415161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532e706-5e85-4cc8-8623-089291b0d5d2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:01.520129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532e706-5e85-4cc8-8623-089291b0d5d2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:01.554859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8b7e3-74e0-466b-850e-0e24588b7b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:01.555660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8b7e3-74e0-466b-850e-0e24588b7b5f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:01.555935 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8b7e3-74e0-466b-850e-0e24588b7b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:01.556205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8b7e3-74e0-466b-850e-0e24588b7b5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:01.566202 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8b7e3-74e0-466b-850e-0e24588b7b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:01.567661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8b7e3-74e0-466b-850e-0e24588b7b5f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:01.585217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-e7f8b7e3-74e0-466b-850e-0e24588b7b5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:56:01.585217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:56:01.585217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:56:01.585217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:56:01.585217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:56:01.585217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:56:01.585217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:56:01.585217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:56:01.585217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:56:01.585217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:56:01.585217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:56:01.585217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:56:01.585217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:56:01.585217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:56:01.585217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:56:01.586146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:56:01.586146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:56:01.586146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:56:01.586146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:56:01.586146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:56:01.586146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:56:01.586146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:56:01.586146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:56:01.586146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:56:01.586146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:56:01.586146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:56:01.586146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:56:01.586146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:56:01.586146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:56:01.586146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:56:01.586146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:56:01.586146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:56:01.587057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:56:01.587057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:56:01.587057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:56:01.587057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:56:01.587057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 551/1083] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:56:01.593824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a976f-2943-44f0-a0e1-59b15010e9c8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:01.701077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a976f-2943-44f0-a0e1-59b15010e9c8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:01.739365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b231d-44f0-4334-ba8a-e90e177051df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:01.740048 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b231d-44f0-4334-ba8a-e90e177051df None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:01.740326 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b231d-44f0-4334-ba8a-e90e177051df None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:01.740598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b231d-44f0-4334-ba8a-e90e177051df None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:01.741321 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b231d-44f0-4334-ba8a-e90e177051df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:01.741606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b231d-44f0-4334-ba8a-e90e177051df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:01.743022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b231d-44f0-4334-ba8a-e90e177051df None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:01.761847 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 533/1084] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:56:02.808075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d29804-b25b-45ef-82a5-5e3121b3af0c None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:02.808626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d29804-b25b-45ef-82a5-5e3121b3af0c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:02.808626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d29804-b25b-45ef-82a5-5e3121b3af0c None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:02.810220 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 552/1085] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:02.815742 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea67c4-3be9-4b4f-94c6-6b482848b977 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:02.816144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea67c4-3be9-4b4f-94c6-6b482848b977 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:02.816391 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea67c4-3be9-4b4f-94c6-6b482848b977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:02.834305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6cea67c4-3be9-4b4f-94c6-6b482848b977 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:02.835825 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6cea67c4-3be9-4b4f-94c6-6b482848b977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:02.860302 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:02.886530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fcfad-6d72-486e-923f-88c2992bbcce None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:02.887059 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fcfad-6d72-486e-923f-88c2992bbcce None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:02.887584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fcfad-6d72-486e-923f-88c2992bbcce None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:02.889642 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 553/1086] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:02.894340 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e50a0f-73b7-4636-8927-540a451740ce None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:02.894630 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e50a0f-73b7-4636-8927-540a451740ce None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:02.895310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e50a0f-73b7-4636-8927-540a451740ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:02.908824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 534/1087] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:02.912068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-40e50a0f-73b7-4636-8927-540a451740ce None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:02.913262 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-40e50a0f-73b7-4636-8927-540a451740ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:02.932123 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea67c4-3be9-4b4f-94c6-6b482848b977 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:02.966849 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:02.987664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 554/1088] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:03.011612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e50a0f-73b7-4636-8927-540a451740ce None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:03.039546 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea67c4-3be9-4b4f-94c6-6b482848b977 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:03.074509 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f9e45-5f5e-48b3-905f-0ce56270981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:03.075307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f9e45-5f5e-48b3-905f-0ce56270981c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:03.075601 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f9e45-5f5e-48b3-905f-0ce56270981c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:03.075866 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f9e45-5f5e-48b3-905f-0ce56270981c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:03.086490 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f9e45-5f5e-48b3-905f-0ce56270981c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:56:03.094064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-7b2f9e45-5f5e-48b3-905f-0ce56270981c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:56:03.094064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:56:03.094064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:56:03.094064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:56:03.094064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:56:03.094064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:56:03.094064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:56:03.094064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:56:03.094064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:56:03.094064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:56:03.094064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:56:03.094064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:56:03.094064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:56:03.094064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:56:03.094064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:56:03.094064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:56:03.095058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:56:03.095058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:56:03.095058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:56:03.095058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:56:03.095058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:56:03.095058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:56:03.095058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:56:03.095058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:56:03.095058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:56:03.095058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:56:03.095058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:56:03.095058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:56:03.095058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:56:03.095058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:56:03.095058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:56:03.095058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:56:03.095997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:56:03.095997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:56:03.095997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:56:03.095997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:56:03.095997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:56:03.095997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:56:03.095997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:56:03.095997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:56:03.095997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:56:03.095997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:56:03.095997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:56:03.095997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:56:03.095997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 535/1089] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:56:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:56:03.101306 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f9e45-5f5e-48b3-905f-0ce56270981c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:03.116561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e50a0f-73b7-4636-8927-540a451740ce None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:03.121027 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:03.151119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a0259-aa23-4e12-a17f-4c20024b8b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:03.151950 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a0259-aa23-4e12-a17f-4c20024b8b1b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:03.152235 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a0259-aa23-4e12-a17f-4c20024b8b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:03.152508 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a0259-aa23-4e12-a17f-4c20024b8b1b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:03.162765 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a0259-aa23-4e12-a17f-4c20024b8b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:56:03.170997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-d61a0259-aa23-4e12-a17f-4c20024b8b1b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:56:03.170997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:56:03.170997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:56:03.170997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:56:03.170997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:56:03.170997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:56:03.170997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:56:03.170997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:56:03.170997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:56:03.170997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:56:03.170997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:56:03.170997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:56:03.170997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:56:03.170997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:56:03.170997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:56:03.170997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:56:03.171914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:56:03.171914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:56:03.171914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:56:03.171914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:56:03.171914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:56:03.171914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:56:03.171914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:56:03.171914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:56:03.171914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:56:03.171914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:56:03.171914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:56:03.171914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:56:03.171914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:56:03.171914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:56:03.171914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:56:03.171914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:56:03.172756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:56:03.172756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:56:03.172756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:56:03.172756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:56:03.172756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:56:03.172756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:56:03.172756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:56:03.172756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:56:03.172756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:56:03.172756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:56:03.172756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:56:03.172756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:56:03.172756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 555/1090] 10.222.0.61 () {56 vars in 1120 bytes} [Thu May 26 20:56:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:56:03.178313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a0259-aa23-4e12-a17f-4c20024b8b1b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:03.205346 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f9e45-5f5e-48b3-905f-0ce56270981c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:03.223415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:03.239320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a5bee-9c48-4713-9f8f-cf86b9e073a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:03.240029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a5bee-9c48-4713-9f8f-cf86b9e073a8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:03.240389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a5bee-9c48-4713-9f8f-cf86b9e073a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:03.240668 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a5bee-9c48-4713-9f8f-cf86b9e073a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:03.241426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a5bee-9c48-4713-9f8f-cf86b9e073a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:03.241829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a5bee-9c48-4713-9f8f-cf86b9e073a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:03.243248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a5bee-9c48-4713-9f8f-cf86b9e073a8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:03.252556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 536/1091] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:56:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:56:03.258442 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a5bee-9c48-4713-9f8f-cf86b9e073a8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:03.282268 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a0259-aa23-4e12-a17f-4c20024b8b1b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:03.319204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a6dd7-2b65-4d4a-8f0c-b87dd5c5f740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:03.319796 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a6dd7-2b65-4d4a-8f0c-b87dd5c5f740 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:03.320078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a6dd7-2b65-4d4a-8f0c-b87dd5c5f740 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:03.320361 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a6dd7-2b65-4d4a-8f0c-b87dd5c5f740 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:03.321112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a6dd7-2b65-4d4a-8f0c-b87dd5c5f740 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:03.321419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a6dd7-2b65-4d4a-8f0c-b87dd5c5f740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:03.322848 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a6dd7-2b65-4d4a-8f0c-b87dd5c5f740 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:03.331613 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 556/1092] 10.222.0.61 () {56 vars in 1115 bytes} [Thu May 26 20:56:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:56:03.337694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a6dd7-2b65-4d4a-8f0c-b87dd5c5f740 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:03.340727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:03.363410 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a5bee-9c48-4713-9f8f-cf86b9e073a8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:03.397997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fe14c-cbc0-4154-a4e0-e0b2792cbd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:03.398877 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fe14c-cbc0-4154-a4e0-e0b2792cbd19 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:03.399155 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fe14c-cbc0-4154-a4e0-e0b2792cbd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:03.399427 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fe14c-cbc0-4154-a4e0-e0b2792cbd19 None admin] PATH_INFO: `/v3/users/60a5692a86784918bfbcf2b4708c9e05` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:03.400630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fe14c-cbc0-4154-a4e0-e0b2792cbd19 None admin] RBAC: Authorizing `identity:get_user(user_id=60a5692a86784918bfbcf2b4708c9e05)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:03.402102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fe14c-cbc0-4154-a4e0-e0b2792cbd19 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:03.403783 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 537/1093] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:56:03 2022] GET /identity/v3/users/60a5692a86784918bfbcf2b4708c9e05 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:56:03.409867 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fe14c-cbc0-4154-a4e0-e0b2792cbd19 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:03.442524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a6dd7-2b65-4d4a-8f0c-b87dd5c5f740 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:03.444926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:03.479486 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45516b7-c28e-4d66-a691-15807babe47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:03.480265 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45516b7-c28e-4d66-a691-15807babe47d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:03.480547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45516b7-c28e-4d66-a691-15807babe47d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:03.480821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45516b7-c28e-4d66-a691-15807babe47d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:03.492555 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45516b7-c28e-4d66-a691-15807babe47d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:03.494076 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45516b7-c28e-4d66-a691-15807babe47d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:03.509219 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fe14c-cbc0-4154-a4e0-e0b2792cbd19 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:03.511494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-e45516b7-c28e-4d66-a691-15807babe47d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:56:03.511494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:56:03.511494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:56:03.511494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:56:03.511494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:56:03.511494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:56:03.511494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:56:03.511494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:56:03.511494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:56:03.511494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:56:03.511494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:56:03.511494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:56:03.511494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:56:03.511494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:56:03.511494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:56:03.512519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:56:03.512519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:56:03.512519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:56:03.512519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:56:03.512519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:56:03.512519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:56:03.512519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:56:03.512519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:56:03.512519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:56:03.512519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:56:03.512519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:56:03.512519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:56:03.512519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:56:03.512519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:56:03.512519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:56:03.512519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:56:03.512519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:56:03.513606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:56:03.513606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:56:03.513606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:56:03.513606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:56:03.513606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 557/1094] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:56:03.518920 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45516b7-c28e-4d66-a691-15807babe47d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:03.545683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5b61a-6a28-4241-91ff-0544cc72ef7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:03.546365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5b61a-6a28-4241-91ff-0544cc72ef7f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:03.546648 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5b61a-6a28-4241-91ff-0544cc72ef7f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:03.546918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5b61a-6a28-4241-91ff-0544cc72ef7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:03.565315 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:03.615411 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5b61a-6a28-4241-91ff-0544cc72ef7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:03.616806 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5b61a-6a28-4241-91ff-0544cc72ef7f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:03.619233 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45516b7-c28e-4d66-a691-15807babe47d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:03.653856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85ea9d-7046-48ec-bf2e-6ba50df8a140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:03.654525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85ea9d-7046-48ec-bf2e-6ba50df8a140 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:03.654802 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85ea9d-7046-48ec-bf2e-6ba50df8a140 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:03.655072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85ea9d-7046-48ec-bf2e-6ba50df8a140 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:03.655792 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85ea9d-7046-48ec-bf2e-6ba50df8a140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:03.656090 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85ea9d-7046-48ec-bf2e-6ba50df8a140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:03.657468 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85ea9d-7046-48ec-bf2e-6ba50df8a140 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:03.674778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 558/1095] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:56:03.675783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85ea9d-7046-48ec-bf2e-6ba50df8a140 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:03.694601 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:03.721179 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 538/1096] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:56:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 20:56:03.722277 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5b61a-6a28-4241-91ff-0544cc72ef7f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:03.775159 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:03.785959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85ea9d-7046-48ec-bf2e-6ba50df8a140 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:03.820489 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2ce9e-9041-49a9-a25b-b72fbe9ba0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:03.821335 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2ce9e-9041-49a9-a25b-b72fbe9ba0ef None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:03.821618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2ce9e-9041-49a9-a25b-b72fbe9ba0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:03.821930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2ce9e-9041-49a9-a25b-b72fbe9ba0ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:03.828616 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5b61a-6a28-4241-91ff-0544cc72ef7f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:03.829310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2ce9e-9041-49a9-a25b-b72fbe9ba0ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:03.830817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2ce9e-9041-49a9-a25b-b72fbe9ba0ef None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:03.846289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-57a2ce9e-9041-49a9-a25b-b72fbe9ba0ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 20:56:03.846289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:56:03.846289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:56:03.846289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:56:03.846289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:56:03.846289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:56:03.846289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:56:03.846289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:56:03.846289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:56:03.846289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:56:03.846289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:56:03.846289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:56:03.846289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:56:03.846289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:56:03.846289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:56:03.846289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:56:03.847260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:56:03.848213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:56:03.848213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:56:03.848213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:56:03.848213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:56:03.848213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:56:03.848213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:56:03.848213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:56:03.848213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:56:03.848213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 20:56:03.848213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:56:03.848213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 559/1097] 10.222.0.61 () {56 vars in 1093 bytes} [Thu May 26 20:56:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:56:03.853372 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2ce9e-9041-49a9-a25b-b72fbe9ba0ef None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:03.863803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda5290-dfdc-462b-8f02-0ce4bad5d66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:03.864670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda5290-dfdc-462b-8f02-0ce4bad5d66e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:03.864944 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda5290-dfdc-462b-8f02-0ce4bad5d66e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:03.865213 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda5290-dfdc-462b-8f02-0ce4bad5d66e None admin] PATH_INFO: `/v3/projects/9104ad147e8e411a90de4639d9ecf17f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:03.866470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda5290-dfdc-462b-8f02-0ce4bad5d66e None admin] RBAC: Authorizing `identity:get_project(project_id=9104ad147e8e411a90de4639d9ecf17f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:03.867837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda5290-dfdc-462b-8f02-0ce4bad5d66e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:03.869551 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 539/1098] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:56:03 2022] GET /identity/v3/projects/9104ad147e8e411a90de4639d9ecf17f => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:03.875524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda5290-dfdc-462b-8f02-0ce4bad5d66e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:03.929254 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:03.954270 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2ce9e-9041-49a9-a25b-b72fbe9ba0ef None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:03.973681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda5290-dfdc-462b-8f02-0ce4bad5d66e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:03.989126 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128a6cd-c1c3-45f0-aea4-b8183e29104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:03.989835 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128a6cd-c1c3-45f0-aea4-b8183e29104f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:03.990123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128a6cd-c1c3-45f0-aea4-b8183e29104f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:03.990402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128a6cd-c1c3-45f0-aea4-b8183e29104f None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:03.990554 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:03.991255 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128a6cd-c1c3-45f0-aea4-b8183e29104f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:03.991596 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128a6cd-c1c3-45f0-aea4-b8183e29104f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:03.993017 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128a6cd-c1c3-45f0-aea4-b8183e29104f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:04.008327 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60301b-0fa2-4db6-a38a-6a0ba0b6eb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:04.008980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60301b-0fa2-4db6-a38a-6a0ba0b6eb46 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:04.009258 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60301b-0fa2-4db6-a38a-6a0ba0b6eb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:04.009529 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60301b-0fa2-4db6-a38a-6a0ba0b6eb46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:04.009968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 560/1099] 10.222.0.61 () {56 vars in 1133 bytes} [Thu May 26 20:56:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:04.010393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60301b-0fa2-4db6-a38a-6a0ba0b6eb46 None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=9104ad147e8e411a90de4639d9ecf17f, user.id=60a5692a86784918bfbcf2b4708c9e05) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:04.010700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60301b-0fa2-4db6-a38a-6a0ba0b6eb46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:04.012122 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60301b-0fa2-4db6-a38a-6a0ba0b6eb46 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:04.015676 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128a6cd-c1c3-45f0-aea4-b8183e29104f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:04.030339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 540/1100] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:56:03 2022] GET /identity/v3/role_assignments?user.id=60a5692a86784918bfbcf2b4708c9e05&scope.project.id=9104ad147e8e411a90de4639d9ecf17f&role.id=aefba81d87bf47258c17064af7d9a05f => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:04.122730 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128a6cd-c1c3-45f0-aea4-b8183e29104f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:04.160397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82715e-f761-47c2-8331-3f9db9acd7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:04.161079 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82715e-f761-47c2-8331-3f9db9acd7ce None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:04.161365 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82715e-f761-47c2-8331-3f9db9acd7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:04.161643 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82715e-f761-47c2-8331-3f9db9acd7ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:04.164713 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:04.238563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82715e-f761-47c2-8331-3f9db9acd7ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:04.240065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82715e-f761-47c2-8331-3f9db9acd7ce None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:04.340272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 561/1101] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:56:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 20:56:04.346260 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60301b-0fa2-4db6-a38a-6a0ba0b6eb46 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:04.450861 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60301b-0fa2-4db6-a38a-6a0ba0b6eb46 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:04.485828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3906fee-18d6-4b66-92d5-d79018793a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:04.486671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3906fee-18d6-4b66-92d5-d79018793a4d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:04.486944 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3906fee-18d6-4b66-92d5-d79018793a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:04.487213 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3906fee-18d6-4b66-92d5-d79018793a4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:04.498352 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3906fee-18d6-4b66-92d5-d79018793a4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:04.499800 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3906fee-18d6-4b66-92d5-d79018793a4d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:04.517224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f3906fee-18d6-4b66-92d5-d79018793a4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:56:04.517224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:56:04.517224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:56:04.517224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:56:04.517224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:56:04.517224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:56:04.517224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:56:04.517224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:56:04.517224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:56:04.517224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:56:04.517224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:56:04.517224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:56:04.517224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:56:04.517224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:56:04.517224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:56:04.518197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:56:04.518197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:56:04.518197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:56:04.518197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:56:04.518197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:56:04.518197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:56:04.518197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:56:04.518197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:56:04.518197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:56:04.518197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:56:04.518197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:56:04.518197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:56:04.518197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:56:04.518197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:56:04.518197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:56:04.518197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:56:04.518197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:56:04.519203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:56:04.519203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:56:04.519203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:56:04.519203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:56:04.519203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 541/1102] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:56:04.524588 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82715e-f761-47c2-8331-3f9db9acd7ce None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:04.559120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:04.630224 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82715e-f761-47c2-8331-3f9db9acd7ce None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:04.664704 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61757f47-38a6-4587-8ec5-5153ff8e6f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:04.665366 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757f47-38a6-4587-8ec5-5153ff8e6f38 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:04.665645 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757f47-38a6-4587-8ec5-5153ff8e6f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:04.665940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757f47-38a6-4587-8ec5-5153ff8e6f38 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:04.666663 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61757f47-38a6-4587-8ec5-5153ff8e6f38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:04.666970 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61757f47-38a6-4587-8ec5-5153ff8e6f38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:04.668354 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61757f47-38a6-4587-8ec5-5153ff8e6f38 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:04.679696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 562/1103] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:04.685581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3906fee-18d6-4b66-92d5-d79018793a4d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:04.719736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:04.795055 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3906fee-18d6-4b66-92d5-d79018793a4d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:04.830806 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271021f-bc37-4ebc-a5c7-574cf1833473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:04.831557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271021f-bc37-4ebc-a5c7-574cf1833473 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:04.831869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271021f-bc37-4ebc-a5c7-574cf1833473 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:04.832160 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271021f-bc37-4ebc-a5c7-574cf1833473 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:04.839643 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271021f-bc37-4ebc-a5c7-574cf1833473 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:04.841278 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271021f-bc37-4ebc-a5c7-574cf1833473 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:04.855858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b271021f-bc37-4ebc-a5c7-574cf1833473 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:56:04.855858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:56:04.855858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:56:04.855858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:56:04.855858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:56:04.855858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:56:04.855858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:56:04.855858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:56:04.855858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:56:04.855858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:56:04.855858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:56:04.855858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:56:04.855858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:56:04.855858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:56:04.855858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:56:04.857003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:56:04.857003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:56:04.857003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:56:04.857003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:56:04.857003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:56:04.857003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:56:04.857003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:56:04.857003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:56:04.857003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:56:04.857003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:56:04.857003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:56:04.857003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:56:04.857003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:56:04.857003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:56:04.857003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:56:04.857003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:56:04.857003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:56:04.858074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:56:04.858074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:56:04.858074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:56:04.858074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:56:04.858074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:56:04.858074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:56:04.858074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:56:04.858074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:56:04.858074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 542/1104] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:56:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:56:04.863253 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61757f47-38a6-4587-8ec5-5153ff8e6f38 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:04.964284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:04.972481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61757f47-38a6-4587-8ec5-5153ff8e6f38 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:05.008171 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9980816-78b4-4f78-b145-c2bcb9855483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:05.008832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9980816-78b4-4f78-b145-c2bcb9855483 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:05.009108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9980816-78b4-4f78-b145-c2bcb9855483 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:05.009384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9980816-78b4-4f78-b145-c2bcb9855483 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:05.010232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9980816-78b4-4f78-b145-c2bcb9855483 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:05.010540 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9980816-78b4-4f78-b145-c2bcb9855483 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:05.011987 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9980816-78b4-4f78-b145-c2bcb9855483 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:05.024243 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 563/1105] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:56:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:05.030840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271021f-bc37-4ebc-a5c7-574cf1833473 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:05.126928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:05.136492 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271021f-bc37-4ebc-a5c7-574cf1833473 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:05.175150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538a4a4-1eb7-4c00-8bc6-950e106b1556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:05.175808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538a4a4-1eb7-4c00-8bc6-950e106b1556 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:05.176086 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538a4a4-1eb7-4c00-8bc6-950e106b1556 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:05.176355 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538a4a4-1eb7-4c00-8bc6-950e106b1556 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:05.177184 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538a4a4-1eb7-4c00-8bc6-950e106b1556 None admin] RBAC: Adding query filter params (role.id=043685c168c24e0f890ef4479ad74e90, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=a99b767501244338bc48fb5428a589a1) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:05.177489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538a4a4-1eb7-4c00-8bc6-950e106b1556 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:05.178965 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538a4a4-1eb7-4c00-8bc6-950e106b1556 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:05.185366 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 543/1106] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:56:05 2022] GET /identity/v3/role_assignments?user.id=a99b767501244338bc48fb5428a589a1&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=043685c168c24e0f890ef4479ad74e90 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:06.267722 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc349b9f-bdd6-4d3c-a59c-f30484720a63 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:06.268601 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc349b9f-bdd6-4d3c-a59c-f30484720a63 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:06.268601 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc349b9f-bdd6-4d3c-a59c-f30484720a63 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:06.270885 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 564/1107] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:06.277475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf918f-70a6-4eb2-b0fc-9c8435ce8316 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:06.278245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf918f-70a6-4eb2-b0fc-9c8435ce8316 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:06.278505 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf918f-70a6-4eb2-b0fc-9c8435ce8316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:06.302364 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-75cf918f-70a6-4eb2-b0fc-9c8435ce8316 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:06.303618 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-75cf918f-70a6-4eb2-b0fc-9c8435ce8316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:06.377930 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 544/1108] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:06.406987 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc349b9f-bdd6-4d3c-a59c-f30484720a63 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:06.519306 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc349b9f-bdd6-4d3c-a59c-f30484720a63 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:06.565443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d0fc9-1ee5-4970-80f2-f073594a4aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:06.566271 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0fc9-1ee5-4970-80f2-f073594a4aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:06.566551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0fc9-1ee5-4970-80f2-f073594a4aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:06.566821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0fc9-1ee5-4970-80f2-f073594a4aa4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:06.568057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d0fc9-1ee5-4970-80f2-f073594a4aa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:06.569509 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d0fc9-1ee5-4970-80f2-f073594a4aa4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:06.571145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 565/1109] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:56:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:06.580495 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf918f-70a6-4eb2-b0fc-9c8435ce8316 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:06.682220 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:06.701780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf918f-70a6-4eb2-b0fc-9c8435ce8316 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:06.739187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a3143-5143-43b9-be08-cfd075fcea46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:06.739873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a3143-5143-43b9-be08-cfd075fcea46 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:06.740148 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a3143-5143-43b9-be08-cfd075fcea46 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:06.740423 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a3143-5143-43b9-be08-cfd075fcea46 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:06.741129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a3143-5143-43b9-be08-cfd075fcea46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:06.742634 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a3143-5143-43b9-be08-cfd075fcea46 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:06.781036 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 545/1110] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:56:06 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:56:08.997534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792bd5e-54f8-4efd-b95b-c25f7a2734eb None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:08.998499 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792bd5e-54f8-4efd-b95b-c25f7a2734eb None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:08.998859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792bd5e-54f8-4efd-b95b-c25f7a2734eb None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:09.001107 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 566/1111] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:09.006745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a55118-3e76-4805-bb61-2da187910efb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:09.007167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a55118-3e76-4805-bb61-2da187910efb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:09.007279 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a55118-3e76-4805-bb61-2da187910efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:09.026604 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f4a55118-3e76-4805-bb61-2da187910efb None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:09.027698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f4a55118-3e76-4805-bb61-2da187910efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:09.101664 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 546/1112] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:09.125878 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792bd5e-54f8-4efd-b95b-c25f7a2734eb None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:09.162134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:09.243887 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792bd5e-54f8-4efd-b95b-c25f7a2734eb None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:09.285717 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1edcfa-dd07-40df-aff9-77481b9c2dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:09.286548 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1edcfa-dd07-40df-aff9-77481b9c2dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:09.286843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1edcfa-dd07-40df-aff9-77481b9c2dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:09.287125 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1edcfa-dd07-40df-aff9-77481b9c2dc4 None admin] PATH_INFO: `/v3/roles/3695c157587346198902d1f6ec05153a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:09.288765 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1edcfa-dd07-40df-aff9-77481b9c2dc4 None admin] RBAC: Authorizing `identity:get_role(role_id=3695c157587346198902d1f6ec05153a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:09.290207 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1edcfa-dd07-40df-aff9-77481b9c2dc4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:09.291585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 567/1113] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:56:09 2022] GET /identity/v3/roles/3695c157587346198902d1f6ec05153a => generated 223 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:09.298264 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a55118-3e76-4805-bb61-2da187910efb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:09.375941 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:09.416214 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a55118-3e76-4805-bb61-2da187910efb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:09.452002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36011729-d4a7-442d-b120-bd6baa56ecaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:09.452872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36011729-d4a7-442d-b120-bd6baa56ecaf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:09.453152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36011729-d4a7-442d-b120-bd6baa56ecaf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:09.453420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36011729-d4a7-442d-b120-bd6baa56ecaf None admin] PATH_INFO: `/v3/users/bee711dbfbc448cbbcd0810bfa342e20` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:09.467072 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36011729-d4a7-442d-b120-bd6baa56ecaf None admin] RBAC: Authorizing `identity:get_user(user_id=bee711dbfbc448cbbcd0810bfa342e20)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:09.469348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36011729-d4a7-442d-b120-bd6baa56ecaf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:09.471053 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 547/1114] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:56:09 2022] GET /identity/v3/users/bee711dbfbc448cbbcd0810bfa342e20 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:09.479810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1edcfa-dd07-40df-aff9-77481b9c2dc4 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:09.583063 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:09.594004 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1edcfa-dd07-40df-aff9-77481b9c2dc4 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:09.629399 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4af5db-2078-4f80-917f-12bd7e7a04ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:09.630082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4af5db-2078-4f80-917f-12bd7e7a04ae None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:09.630372 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4af5db-2078-4f80-917f-12bd7e7a04ae None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:09.630650 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4af5db-2078-4f80-917f-12bd7e7a04ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:09.700846 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4af5db-2078-4f80-917f-12bd7e7a04ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:09.702365 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4af5db-2078-4f80-917f-12bd7e7a04ae None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:09.801662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:09.814158 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 568/1115] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:56:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:56:09.822867 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36011729-d4a7-442d-b120-bd6baa56ecaf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:09.926485 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36011729-d4a7-442d-b120-bd6baa56ecaf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:09.957455 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:09.964940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325ddae-b128-40a0-a191-113792968caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:09.966026 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325ddae-b128-40a0-a191-113792968caa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:09.966372 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325ddae-b128-40a0-a191-113792968caa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:09.966590 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325ddae-b128-40a0-a191-113792968caa None admin] PATH_INFO: `/v3/projects/9104ad147e8e411a90de4639d9ecf17f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:09.967818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325ddae-b128-40a0-a191-113792968caa None admin] RBAC: Authorizing `identity:get_project(project_id=9104ad147e8e411a90de4639d9ecf17f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:09.969268 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325ddae-b128-40a0-a191-113792968caa None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:09.971023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 548/1116] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:56:09 2022] GET /identity/v3/projects/9104ad147e8e411a90de4639d9ecf17f => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:56:09.977386 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4af5db-2078-4f80-917f-12bd7e7a04ae None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:10.088788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4af5db-2078-4f80-917f-12bd7e7a04ae None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:10.132065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0396d-523c-4a98-a661-af55bfe6421b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:10.133684 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0396d-523c-4a98-a661-af55bfe6421b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:10.134302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0396d-523c-4a98-a661-af55bfe6421b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:10.134696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0396d-523c-4a98-a661-af55bfe6421b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:10.136028 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0396d-523c-4a98-a661-af55bfe6421b None admin] RBAC: Adding query filter params (role.id=3695c157587346198902d1f6ec05153a, scope.project.id=9104ad147e8e411a90de4639d9ecf17f, user.id=bee711dbfbc448cbbcd0810bfa342e20) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:10.136490 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0396d-523c-4a98-a661-af55bfe6421b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:10.138434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0396d-523c-4a98-a661-af55bfe6421b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:10.144617 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 569/1117] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:56:09 2022] GET /identity/v3/role_assignments?user.id=bee711dbfbc448cbbcd0810bfa342e20&scope.project.id=9104ad147e8e411a90de4639d9ecf17f&role.id=3695c157587346198902d1f6ec05153a => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:12.273704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93394b4b-0ee6-4125-93a4-1cc611ff6bf8 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:12.274642 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93394b4b-0ee6-4125-93a4-1cc611ff6bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:12.274642 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93394b4b-0ee6-4125-93a4-1cc611ff6bf8 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:12.276870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 549/1118] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:12.282292 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219c49d-a6fd-41c5-88e5-2b0c10f871e6 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:12.282734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219c49d-a6fd-41c5-88e5-2b0c10f871e6 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:12.282831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219c49d-a6fd-41c5-88e5-2b0c10f871e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:12.301370 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6219c49d-a6fd-41c5-88e5-2b0c10f871e6 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:12.302575 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6219c49d-a6fd-41c5-88e5-2b0c10f871e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:12.354949 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:12.373310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 570/1119] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:12.395650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93394b4b-0ee6-4125-93a4-1cc611ff6bf8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:12.506020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93394b4b-0ee6-4125-93a4-1cc611ff6bf8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:12.542829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a438c-d6d3-4944-b71c-ce4f7759ea64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:12.543605 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a438c-d6d3-4944-b71c-ce4f7759ea64 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:12.543883 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a438c-d6d3-4944-b71c-ce4f7759ea64 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:12.544207 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a438c-d6d3-4944-b71c-ce4f7759ea64 None admin] PATH_INFO: `/v3/roles/3695c157587346198902d1f6ec05153a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:12.545736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a438c-d6d3-4944-b71c-ce4f7759ea64 None admin] RBAC: Authorizing `identity:get_role(role_id=3695c157587346198902d1f6ec05153a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:12.547157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a438c-d6d3-4944-b71c-ce4f7759ea64 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:12.548527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 550/1120] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:56:12 2022] GET /identity/v3/roles/3695c157587346198902d1f6ec05153a => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:12.554519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219c49d-a6fd-41c5-88e5-2b0c10f871e6 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:12.651685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219c49d-a6fd-41c5-88e5-2b0c10f871e6 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:12.699067 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e5f75-e60c-4747-923d-612a1da75c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:12.699959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e5f75-e60c-4747-923d-612a1da75c37 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:12.700238 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e5f75-e60c-4747-923d-612a1da75c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:12.700514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e5f75-e60c-4747-923d-612a1da75c37 None admin] PATH_INFO: `/v3/users/bee711dbfbc448cbbcd0810bfa342e20` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:12.701989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e5f75-e60c-4747-923d-612a1da75c37 None admin] RBAC: Authorizing `identity:get_user(user_id=bee711dbfbc448cbbcd0810bfa342e20)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:12.703466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e5f75-e60c-4747-923d-612a1da75c37 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:12.705086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 571/1121] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:56:12 2022] GET /identity/v3/users/bee711dbfbc448cbbcd0810bfa342e20 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:12.711706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a438c-d6d3-4944-b71c-ce4f7759ea64 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:12.782433 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:12.818708 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a438c-d6d3-4944-b71c-ce4f7759ea64 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:12.854683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79717d04-4f63-4d3b-8c52-3e0b7aac4e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:12.855550 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79717d04-4f63-4d3b-8c52-3e0b7aac4e11 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:12.855832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79717d04-4f63-4d3b-8c52-3e0b7aac4e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:12.856104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79717d04-4f63-4d3b-8c52-3e0b7aac4e11 None admin] PATH_INFO: `/v3/projects/9104ad147e8e411a90de4639d9ecf17f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:12.857435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79717d04-4f63-4d3b-8c52-3e0b7aac4e11 None admin] RBAC: Authorizing `identity:get_project(project_id=9104ad147e8e411a90de4639d9ecf17f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:12.858898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79717d04-4f63-4d3b-8c52-3e0b7aac4e11 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:12.860629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 551/1122] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:56:12 2022] GET /identity/v3/projects/9104ad147e8e411a90de4639d9ecf17f => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:12.867153 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e5f75-e60c-4747-923d-612a1da75c37 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:12.923938 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:12.973927 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e5f75-e60c-4747-923d-612a1da75c37 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:13.012120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcbdfa-2f8e-4d50-a17b-f1ba6ddfa7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:13.013595 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcbdfa-2f8e-4d50-a17b-f1ba6ddfa7f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:13.013980 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcbdfa-2f8e-4d50-a17b-f1ba6ddfa7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:13.014258 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcbdfa-2f8e-4d50-a17b-f1ba6ddfa7f4 None admin] PATH_INFO: `/v3/projects/9104ad147e8e411a90de4639d9ecf17f/users/bee711dbfbc448cbbcd0810bfa342e20/roles/3695c157587346198902d1f6ec05153a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:13.017131 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcbdfa-2f8e-4d50-a17b-f1ba6ddfa7f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9104ad147e8e411a90de4639d9ecf17f, user_id=bee711dbfbc448cbbcd0810bfa342e20, role_id=3695c157587346198902d1f6ec05153a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:13.018676 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcbdfa-2f8e-4d50-a17b-f1ba6ddfa7f4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:13.035204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 572/1123] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:56:12 2022] PUT /identity/v3/projects/9104ad147e8e411a90de4639d9ecf17f/users/bee711dbfbc448cbbcd0810bfa342e20/roles/3695c157587346198902d1f6ec05153a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:56:15.190383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cbe48-b26c-4cef-8ebb-a8476055e058 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:15.190937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cbe48-b26c-4cef-8ebb-a8476055e058 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:15.190937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cbe48-b26c-4cef-8ebb-a8476055e058 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:15.192338 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 552/1124] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:15.199636 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88b1cb-7591-4bc4-b355-f5c7d54d560f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:15.200348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88b1cb-7591-4bc4-b355-f5c7d54d560f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:15.200902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88b1cb-7591-4bc4-b355-f5c7d54d560f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:15.224291 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ac88b1cb-7591-4bc4-b355-f5c7d54d560f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:15.225506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ac88b1cb-7591-4bc4-b355-f5c7d54d560f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:15.329826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 573/1125] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:15.356793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cbe48-b26c-4cef-8ebb-a8476055e058 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:15.492040 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cbe48-b26c-4cef-8ebb-a8476055e058 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:15.545960 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbd47a-7bf5-4a64-810c-c228ceeef83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:15.546848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbd47a-7bf5-4a64-810c-c228ceeef83b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:15.547253 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbd47a-7bf5-4a64-810c-c228ceeef83b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:15.547745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbd47a-7bf5-4a64-810c-c228ceeef83b None admin] PATH_INFO: `/v3/roles/3695c157587346198902d1f6ec05153a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:15.550406 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbd47a-7bf5-4a64-810c-c228ceeef83b None admin] RBAC: Authorizing `identity:get_role(role_id=3695c157587346198902d1f6ec05153a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:15.552586 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbd47a-7bf5-4a64-810c-c228ceeef83b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:15.554892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 553/1126] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:56:15 2022] GET /identity/v3/roles/3695c157587346198902d1f6ec05153a => generated 223 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:15.561330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88b1cb-7591-4bc4-b355-f5c7d54d560f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:15.622939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:15.686227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88b1cb-7591-4bc4-b355-f5c7d54d560f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:15.734565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb270f-5443-44d0-8797-67084452e267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:15.735459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb270f-5443-44d0-8797-67084452e267 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:15.735735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb270f-5443-44d0-8797-67084452e267 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:15.736009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb270f-5443-44d0-8797-67084452e267 None admin] PATH_INFO: `/v3/users/bee711dbfbc448cbbcd0810bfa342e20` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:15.737346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb270f-5443-44d0-8797-67084452e267 None admin] RBAC: Authorizing `identity:get_user(user_id=bee711dbfbc448cbbcd0810bfa342e20)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:15.738871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb270f-5443-44d0-8797-67084452e267 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:15.740530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 574/1127] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:56:15 2022] GET /identity/v3/users/bee711dbfbc448cbbcd0810bfa342e20 => generated 286 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:15.747743 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbd47a-7bf5-4a64-810c-c228ceeef83b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:15.752411 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:15.876304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbd47a-7bf5-4a64-810c-c228ceeef83b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:15.916972 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48764a-81ac-41ec-a27d-7793dc36e59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:15.917651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48764a-81ac-41ec-a27d-7793dc36e59c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:15.917959 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48764a-81ac-41ec-a27d-7793dc36e59c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:15.918235 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48764a-81ac-41ec-a27d-7793dc36e59c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:16.002527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48764a-81ac-41ec-a27d-7793dc36e59c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:16.003865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48764a-81ac-41ec-a27d-7793dc36e59c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:16.006280 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:16.112675 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 554/1128] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:56:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:56:16.122156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb270f-5443-44d0-8797-67084452e267 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:16.235782 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb270f-5443-44d0-8797-67084452e267 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:16.246473 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:16.275348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb67bc-4038-4385-9064-36260be1e596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:16.276601 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb67bc-4038-4385-9064-36260be1e596 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:16.277048 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb67bc-4038-4385-9064-36260be1e596 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:16.277471 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb67bc-4038-4385-9064-36260be1e596 None admin] PATH_INFO: `/v3/projects/9104ad147e8e411a90de4639d9ecf17f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:16.279194 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb67bc-4038-4385-9064-36260be1e596 None admin] RBAC: Authorizing `identity:get_project(project_id=9104ad147e8e411a90de4639d9ecf17f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:16.280991 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb67bc-4038-4385-9064-36260be1e596 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:16.282875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 575/1129] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:56:16 2022] GET /identity/v3/projects/9104ad147e8e411a90de4639d9ecf17f => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:16.289219 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48764a-81ac-41ec-a27d-7793dc36e59c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:16.397717 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48764a-81ac-41ec-a27d-7793dc36e59c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:16.399461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:16.439261 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a712ba-5db6-421d-bb63-19a0bebf9f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:16.439943 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a712ba-5db6-421d-bb63-19a0bebf9f93 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:16.440227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a712ba-5db6-421d-bb63-19a0bebf9f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:16.440506 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a712ba-5db6-421d-bb63-19a0bebf9f93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:16.441355 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a712ba-5db6-421d-bb63-19a0bebf9f93 None admin] RBAC: Adding query filter params (role.id=3695c157587346198902d1f6ec05153a, scope.project.id=9104ad147e8e411a90de4639d9ecf17f, user.id=bee711dbfbc448cbbcd0810bfa342e20) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:16.441674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a712ba-5db6-421d-bb63-19a0bebf9f93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:16.443167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a712ba-5db6-421d-bb63-19a0bebf9f93 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:16.449989 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 555/1130] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:56:16 2022] GET /identity/v3/role_assignments?user.id=bee711dbfbc448cbbcd0810bfa342e20&scope.project.id=9104ad147e8e411a90de4639d9ecf17f&role.id=3695c157587346198902d1f6ec05153a => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:18.635293 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735f532-f00d-46be-8022-e613f178f691 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:18.635890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735f532-f00d-46be-8022-e613f178f691 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:18.635890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735f532-f00d-46be-8022-e613f178f691 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:18.637206 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 576/1131] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:18.643793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fbfc9-c6e0-4a5d-86cb-0f6f666785b3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:18.644509 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fbfc9-c6e0-4a5d-86cb-0f6f666785b3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:18.644687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fbfc9-c6e0-4a5d-86cb-0f6f666785b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:18.665637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ce4fbfc9-c6e0-4a5d-86cb-0f6f666785b3 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:18.667713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ce4fbfc9-c6e0-4a5d-86cb-0f6f666785b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:18.743114 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 556/1132] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:18.767254 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735f532-f00d-46be-8022-e613f178f691 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:18.890833 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735f532-f00d-46be-8022-e613f178f691 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:18.926530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d207e-94f1-49a7-9d6c-0d74d966eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:18.927334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d207e-94f1-49a7-9d6c-0d74d966eac4 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:18.927612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d207e-94f1-49a7-9d6c-0d74d966eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:18.927886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d207e-94f1-49a7-9d6c-0d74d966eac4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:18.929172 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d207e-94f1-49a7-9d6c-0d74d966eac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:18.930654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d207e-94f1-49a7-9d6c-0d74d966eac4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:18.932251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 577/1133] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:56:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:18.941094 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fbfc9-c6e0-4a5d-86cb-0f6f666785b3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:19.041423 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:19.050095 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fbfc9-c6e0-4a5d-86cb-0f6f666785b3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:19.089568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda79ca-ad62-4fbf-b5f0-62a8587b2f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:19.090274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda79ca-ad62-4fbf-b5f0-62a8587b2f57 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:19.090561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda79ca-ad62-4fbf-b5f0-62a8587b2f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:19.090840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda79ca-ad62-4fbf-b5f0-62a8587b2f57 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:19.091553 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda79ca-ad62-4fbf-b5f0-62a8587b2f57 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:19.093015 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda79ca-ad62-4fbf-b5f0-62a8587b2f57 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:19.122177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 557/1134] 10.222.0.61 () {60 vars in 1141 bytes} [Thu May 26 20:56:18 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:56:21.345845 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c92c78-7b20-46a4-b562-3b18fe78a50d None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:21.346702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c92c78-7b20-46a4-b562-3b18fe78a50d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:21.346865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c92c78-7b20-46a4-b562-3b18fe78a50d None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:21.349095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 578/1135] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:21.354883 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1d18d-8ee8-4ca2-b1d2-dd562da4747f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:21.355296 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1d18d-8ee8-4ca2-b1d2-dd562da4747f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:21.355422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1d18d-8ee8-4ca2-b1d2-dd562da4747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:21.373414 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f4d1d18d-8ee8-4ca2-b1d2-dd562da4747f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:21.374645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f4d1d18d-8ee8-4ca2-b1d2-dd562da4747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:21.453630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 558/1136] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:21.478877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c92c78-7b20-46a4-b562-3b18fe78a50d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:21.534126 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:21.590032 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c92c78-7b20-46a4-b562-3b18fe78a50d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:21.625081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d058d78-6c83-4a2d-82fb-4280deeb060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:21.625836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058d78-6c83-4a2d-82fb-4280deeb060b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:21.626111 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058d78-6c83-4a2d-82fb-4280deeb060b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:21.626387 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058d78-6c83-4a2d-82fb-4280deeb060b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:21.627585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d058d78-6c83-4a2d-82fb-4280deeb060b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:21.629039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d058d78-6c83-4a2d-82fb-4280deeb060b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:21.630701 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 579/1137] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:56:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:21.637407 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1d18d-8ee8-4ca2-b1d2-dd562da4747f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:21.724425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:21.755897 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1d18d-8ee8-4ca2-b1d2-dd562da4747f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:21.792478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14314b-897b-45ce-b02f-d0bc65a81d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:21.793157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14314b-897b-45ce-b02f-d0bc65a81d6d None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:21.793432 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14314b-897b-45ce-b02f-d0bc65a81d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:21.793707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14314b-897b-45ce-b02f-d0bc65a81d6d None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:21.794689 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14314b-897b-45ce-b02f-d0bc65a81d6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:21.796165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14314b-897b-45ce-b02f-d0bc65a81d6d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:21.822942 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 559/1138] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:56:21 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:56:24.064358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8cefe-61bf-4856-af30-d16673a72cc0 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:24.065241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8cefe-61bf-4856-af30-d16673a72cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:24.065241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8cefe-61bf-4856-af30-d16673a72cc0 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:24.067390 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 580/1139] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:24.073738 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa397327-cb27-402c-928b-b2b771e6e4dc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:24.074432 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa397327-cb27-402c-928b-b2b771e6e4dc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:24.074707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa397327-cb27-402c-928b-b2b771e6e4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:24.098131 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fa397327-cb27-402c-928b-b2b771e6e4dc None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:24.099369 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fa397327-cb27-402c-928b-b2b771e6e4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:24.170140 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 560/1140] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:24.193355 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8cefe-61bf-4856-af30-d16673a72cc0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:24.300664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8cefe-61bf-4856-af30-d16673a72cc0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:24.314683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:24.338294 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa510e9-dbfd-466c-b874-ed7571b7d3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:24.339085 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa510e9-dbfd-466c-b874-ed7571b7d3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:24.339365 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa510e9-dbfd-466c-b874-ed7571b7d3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:24.339634 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa510e9-dbfd-466c-b874-ed7571b7d3a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:24.351214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa510e9-dbfd-466c-b874-ed7571b7d3a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:56:24.358764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-8aa510e9-dbfd-466c-b874-ed7571b7d3a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:56:24.358764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:56:24.358764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:56:24.358764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:56:24.358764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:56:24.358764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:56:24.358764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:56:24.358764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:56:24.358764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:56:24.358764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:56:24.358764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:56:24.358764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:56:24.358764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:56:24.358764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:56:24.358764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:56:24.358764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:56:24.359843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:56:24.359843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:56:24.359843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:56:24.359843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:56:24.359843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:56:24.359843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:56:24.359843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:56:24.359843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:56:24.359843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:56:24.359843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:56:24.359843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:56:24.359843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:56:24.359843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:56:24.359843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:56:24.359843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:56:24.359843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:56:24.360784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:56:24.360784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:56:24.360784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:56:24.360784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:56:24.360784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:56:24.360784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:56:24.360784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:56:24.360784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:56:24.360784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:56:24.360784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:56:24.360784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:56:24.360784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:56:24.360784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 581/1141] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:56:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:56:24.366285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa397327-cb27-402c-928b-b2b771e6e4dc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:24.428058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:24.470265 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa397327-cb27-402c-928b-b2b771e6e4dc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:24.510123 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e70624-ced2-48f5-ae45-52c0e61c230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:24.510795 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e70624-ced2-48f5-ae45-52c0e61c230c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:24.511079 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e70624-ced2-48f5-ae45-52c0e61c230c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:24.511357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e70624-ced2-48f5-ae45-52c0e61c230c None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:24.512108 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e70624-ced2-48f5-ae45-52c0e61c230c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:24.512416 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e70624-ced2-48f5-ae45-52c0e61c230c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:24.513884 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e70624-ced2-48f5-ae45-52c0e61c230c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:24.526914 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 561/1142] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:56:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:24.533094 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa510e9-dbfd-466c-b874-ed7571b7d3a6 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:24.639289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa510e9-dbfd-466c-b874-ed7571b7d3a6 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:24.674911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa521ce2-7945-4632-88dc-b81f4dc42e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:24.675769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa521ce2-7945-4632-88dc-b81f4dc42e7b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:24.676050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa521ce2-7945-4632-88dc-b81f4dc42e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:24.676316 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa521ce2-7945-4632-88dc-b81f4dc42e7b None admin] PATH_INFO: `/v3/users/36783f3aaf1b4c948a182c0027bf9069` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:24.690011 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa521ce2-7945-4632-88dc-b81f4dc42e7b None admin] RBAC: Authorizing `identity:get_user(user_id=36783f3aaf1b4c948a182c0027bf9069)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:24.691470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa521ce2-7945-4632-88dc-b81f4dc42e7b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:24.693101 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 582/1143] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:56:24 2022] GET /identity/v3/users/36783f3aaf1b4c948a182c0027bf9069 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:24.699535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e70624-ced2-48f5-ae45-52c0e61c230c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:24.816831 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e70624-ced2-48f5-ae45-52c0e61c230c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:24.851547 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:24.866039 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c312e82-c41e-434b-8e77-c78cf9654ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:24.866801 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c312e82-c41e-434b-8e77-c78cf9654ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:24.867074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c312e82-c41e-434b-8e77-c78cf9654ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:24.867347 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c312e82-c41e-434b-8e77-c78cf9654ce6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:24.940159 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c312e82-c41e-434b-8e77-c78cf9654ce6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:24.941624 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c312e82-c41e-434b-8e77-c78cf9654ce6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:25.043072 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 562/1144] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:56:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:56:25.050336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa521ce2-7945-4632-88dc-b81f4dc42e7b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:25.094239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:25.168325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa521ce2-7945-4632-88dc-b81f4dc42e7b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:25.204202 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ec9c2-69cd-4b7b-af2d-7574bc55222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:25.204999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ec9c2-69cd-4b7b-af2d-7574bc55222f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:25.205281 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ec9c2-69cd-4b7b-af2d-7574bc55222f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:25.205553 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ec9c2-69cd-4b7b-af2d-7574bc55222f None admin] PATH_INFO: `/v3/projects/3e81e6df3a074faca7d8f0ebc58a33cb` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:25.206794 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ec9c2-69cd-4b7b-af2d-7574bc55222f None admin] RBAC: Authorizing `identity:get_project(project_id=3e81e6df3a074faca7d8f0ebc58a33cb)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:25.208257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ec9c2-69cd-4b7b-af2d-7574bc55222f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:25.210352 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 583/1145] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:56:25 2022] GET /identity/v3/projects/3e81e6df3a074faca7d8f0ebc58a33cb => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:25.217310 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c312e82-c41e-434b-8e77-c78cf9654ce6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:25.248433 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:25.324137 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c312e82-c41e-434b-8e77-c78cf9654ce6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:25.366866 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a533d-b5f6-4fe8-9f69-3edb60e326f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:25.367520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a533d-b5f6-4fe8-9f69-3edb60e326f5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:25.367802 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a533d-b5f6-4fe8-9f69-3edb60e326f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:25.368092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a533d-b5f6-4fe8-9f69-3edb60e326f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:25.368927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a533d-b5f6-4fe8-9f69-3edb60e326f5 None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=3e81e6df3a074faca7d8f0ebc58a33cb, user.id=36783f3aaf1b4c948a182c0027bf9069) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:25.369238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a533d-b5f6-4fe8-9f69-3edb60e326f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:25.370716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a533d-b5f6-4fe8-9f69-3edb60e326f5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:25.376617 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 563/1146] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:56:25 2022] GET /identity/v3/role_assignments?user.id=36783f3aaf1b4c948a182c0027bf9069&scope.project.id=3e81e6df3a074faca7d8f0ebc58a33cb&role.id=aefba81d87bf47258c17064af7d9a05f => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:27.500532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1a83c-8ccb-4a44-9a92-96c70e581c2e None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:27.501388 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1a83c-8ccb-4a44-9a92-96c70e581c2e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:27.501555 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1a83c-8ccb-4a44-9a92-96c70e581c2e None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:27.504102 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 584/1147] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:27.513016 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc7f1d-c220-47fa-89dd-0296b496bc65 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:27.513451 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc7f1d-c220-47fa-89dd-0296b496bc65 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:27.513716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc7f1d-c220-47fa-89dd-0296b496bc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:27.532056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-68cc7f1d-c220-47fa-89dd-0296b496bc65 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:27.533224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-68cc7f1d-c220-47fa-89dd-0296b496bc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:27.602676 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 564/1148] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:56:27.625950 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1a83c-8ccb-4a44-9a92-96c70e581c2e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:27.740478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:27.744585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1a83c-8ccb-4a44-9a92-96c70e581c2e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:27.781150 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a175d5c-77d0-43f5-8676-80224faa8888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:27.781983 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a175d5c-77d0-43f5-8676-80224faa8888 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:27.782251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a175d5c-77d0-43f5-8676-80224faa8888 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:27.782525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a175d5c-77d0-43f5-8676-80224faa8888 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:27.792585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a175d5c-77d0-43f5-8676-80224faa8888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:56:27.800157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-7a175d5c-77d0-43f5-8676-80224faa8888 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:56:27.800157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:56:27.800157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:56:27.800157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:56:27.800157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:56:27.800157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:56:27.800157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:56:27.800157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:56:27.800157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:56:27.800157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:56:27.800157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:56:27.800157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:56:27.800157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:56:27.800157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:56:27.800157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:56:27.800157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:56:27.801148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:56:27.801148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:56:27.801148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:56:27.801148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:56:27.801148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:56:27.801148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:56:27.801148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:56:27.801148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:56:27.801148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:56:27.801148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:56:27.801148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:56:27.801148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:56:27.801148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:56:27.801148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:56:27.801148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:56:27.801148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:56:27.802165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:56:27.802165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:56:27.802165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:56:27.802165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:56:27.802165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:56:27.802165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:56:27.802165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:56:27.802165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:56:27.802165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:56:27.802165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:56:27.802165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:56:27.802165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:56:27.802165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 585/1149] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:56:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:56:27.807592 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc7f1d-c220-47fa-89dd-0296b496bc65 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:27.832573 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:27.918740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc7f1d-c220-47fa-89dd-0296b496bc65 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:27.954556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61771ef-df48-432a-802c-9508ee3ca01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:27.955214 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61771ef-df48-432a-802c-9508ee3ca01f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:27.955496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61771ef-df48-432a-802c-9508ee3ca01f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:27.955765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61771ef-df48-432a-802c-9508ee3ca01f None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:27.956513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61771ef-df48-432a-802c-9508ee3ca01f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:27.956810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61771ef-df48-432a-802c-9508ee3ca01f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:27.958226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61771ef-df48-432a-802c-9508ee3ca01f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:27.966851 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 565/1150] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:56:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:27.973482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a175d5c-77d0-43f5-8676-80224faa8888 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:28.087752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a175d5c-77d0-43f5-8676-80224faa8888 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:28.123718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42efdd5-9456-4e23-a154-1fc1ee1ff86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:28.124606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42efdd5-9456-4e23-a154-1fc1ee1ff86e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:28.124890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42efdd5-9456-4e23-a154-1fc1ee1ff86e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:28.125174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42efdd5-9456-4e23-a154-1fc1ee1ff86e None admin] PATH_INFO: `/v3/users/36783f3aaf1b4c948a182c0027bf9069` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:28.126500 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42efdd5-9456-4e23-a154-1fc1ee1ff86e None admin] RBAC: Authorizing `identity:get_user(user_id=36783f3aaf1b4c948a182c0027bf9069)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:28.127961 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42efdd5-9456-4e23-a154-1fc1ee1ff86e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:28.129596 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 586/1151] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:56:27 2022] GET /identity/v3/users/36783f3aaf1b4c948a182c0027bf9069 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:28.138724 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61771ef-df48-432a-802c-9508ee3ca01f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:28.223806 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:28.244635 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61771ef-df48-432a-802c-9508ee3ca01f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:28.288750 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90067b14-dbc7-4447-af44-1f69e2d09062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:28.290104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90067b14-dbc7-4447-af44-1f69e2d09062 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:28.290494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90067b14-dbc7-4447-af44-1f69e2d09062 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:28.290864 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90067b14-dbc7-4447-af44-1f69e2d09062 None admin] PATH_INFO: `/v3/projects/3e81e6df3a074faca7d8f0ebc58a33cb` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:28.292718 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90067b14-dbc7-4447-af44-1f69e2d09062 None admin] RBAC: Authorizing `identity:get_project(project_id=3e81e6df3a074faca7d8f0ebc58a33cb)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:28.294897 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90067b14-dbc7-4447-af44-1f69e2d09062 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:28.296585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 566/1152] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:56:28 2022] GET /identity/v3/projects/3e81e6df3a074faca7d8f0ebc58a33cb => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:28.305725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42efdd5-9456-4e23-a154-1fc1ee1ff86e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:28.336561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:28.415255 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42efdd5-9456-4e23-a154-1fc1ee1ff86e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:28.460654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30964ac5-b822-43a1-90a9-60b1a930b01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:28.462064 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30964ac5-b822-43a1-90a9-60b1a930b01d None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:28.462499 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30964ac5-b822-43a1-90a9-60b1a930b01d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:28.462924 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30964ac5-b822-43a1-90a9-60b1a930b01d None admin] PATH_INFO: `/v3/projects/3e81e6df3a074faca7d8f0ebc58a33cb/users/36783f3aaf1b4c948a182c0027bf9069/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:28.466361 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30964ac5-b822-43a1-90a9-60b1a930b01d None admin] RBAC: Authorizing `identity:create_grant(project_id=3e81e6df3a074faca7d8f0ebc58a33cb, user_id=36783f3aaf1b4c948a182c0027bf9069, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:28.467823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30964ac5-b822-43a1-90a9-60b1a930b01d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:28.483596 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 587/1153] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:56:28 2022] PUT /identity/v3/projects/3e81e6df3a074faca7d8f0ebc58a33cb/users/36783f3aaf1b4c948a182c0027bf9069/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:56:30.622469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b5615-3c6e-4599-a031-f24c643dd5ce None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:30.623060 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b5615-3c6e-4599-a031-f24c643dd5ce None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:30.623060 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b5615-3c6e-4599-a031-f24c643dd5ce None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:30.624431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 567/1154] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:30.629748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b99c7-e165-47b5-b708-e9b2405a0f47 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:30.630187 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b99c7-e165-47b5-b708-e9b2405a0f47 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:30.630355 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b99c7-e165-47b5-b708-e9b2405a0f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:30.648778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-871b99c7-e165-47b5-b708-e9b2405a0f47 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:30.649996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-871b99c7-e165-47b5-b708-e9b2405a0f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:30.719413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 588/1155] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:30.743014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b5615-3c6e-4599-a031-f24c643dd5ce None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:30.869074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b5615-3c6e-4599-a031-f24c643dd5ce None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:30.916481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477abc3-34f6-49bd-8324-5e7e5c65d35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:30.917197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477abc3-34f6-49bd-8324-5e7e5c65d35b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:30.917475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477abc3-34f6-49bd-8324-5e7e5c65d35b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:30.917717 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477abc3-34f6-49bd-8324-5e7e5c65d35b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:30.930947 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477abc3-34f6-49bd-8324-5e7e5c65d35b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:56:30.938651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-5477abc3-34f6-49bd-8324-5e7e5c65d35b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:56:30.938651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:56:30.938651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:56:30.938651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:56:30.938651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:56:30.938651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:56:30.938651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:56:30.938651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:56:30.938651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:56:30.938651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:56:30.938651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:56:30.938651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:56:30.938651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:56:30.938651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:56:30.938651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:56:30.938651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:56:30.939741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:56:30.939741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:56:30.939741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:56:30.939741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:56:30.939741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:56:30.939741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:56:30.939741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:56:30.939741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:56:30.939741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:56:30.939741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:56:30.939741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:56:30.939741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:56:30.939741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:56:30.939741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:56:30.939741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:56:30.939741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:56:30.940756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:56:30.940756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:56:30.940756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:56:30.940756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:56:30.940756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:56:30.940756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:56:30.940756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:56:30.940756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:56:30.940756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:56:30.940756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:56:30.940756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:56:30.940756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:56:30.940756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 568/1156] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:56:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:56:30.946276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b99c7-e165-47b5-b708-e9b2405a0f47 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:30.968606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:31.056571 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b99c7-e165-47b5-b708-e9b2405a0f47 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:31.091351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654fff3-014d-4f88-a742-f813e6c3d7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:31.092009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654fff3-014d-4f88-a742-f813e6c3d7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:31.092289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654fff3-014d-4f88-a742-f813e6c3d7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:31.092557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654fff3-014d-4f88-a742-f813e6c3d7e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:31.093303 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654fff3-014d-4f88-a742-f813e6c3d7e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:31.093603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654fff3-014d-4f88-a742-f813e6c3d7e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:31.095057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654fff3-014d-4f88-a742-f813e6c3d7e6 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:31.103259 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 589/1157] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:56:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:31.110791 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477abc3-34f6-49bd-8324-5e7e5c65d35b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:31.125077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:31.221977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477abc3-34f6-49bd-8324-5e7e5c65d35b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:31.257109 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a13ce4-6cf0-45da-95c9-2cc0b1e521bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:31.258009 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a13ce4-6cf0-45da-95c9-2cc0b1e521bb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:31.258281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a13ce4-6cf0-45da-95c9-2cc0b1e521bb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:31.258546 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a13ce4-6cf0-45da-95c9-2cc0b1e521bb None admin] PATH_INFO: `/v3/users/36783f3aaf1b4c948a182c0027bf9069` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:31.259746 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a13ce4-6cf0-45da-95c9-2cc0b1e521bb None admin] RBAC: Authorizing `identity:get_user(user_id=36783f3aaf1b4c948a182c0027bf9069)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:31.261231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a13ce4-6cf0-45da-95c9-2cc0b1e521bb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:31.263109 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 569/1158] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:56:31 2022] GET /identity/v3/users/36783f3aaf1b4c948a182c0027bf9069 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:31.269768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654fff3-014d-4f88-a742-f813e6c3d7e6 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:31.371100 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:31.394452 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654fff3-014d-4f88-a742-f813e6c3d7e6 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:31.430137 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb026b-f257-435b-8983-f80abffee550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:31.430778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb026b-f257-435b-8983-f80abffee550 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:31.431055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb026b-f257-435b-8983-f80abffee550 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:31.431327 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb026b-f257-435b-8983-f80abffee550 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:31.500400 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb026b-f257-435b-8983-f80abffee550 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:31.501840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb026b-f257-435b-8983-f80abffee550 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:31.583547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:31.604757 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 590/1159] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:56:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:56:31.610988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a13ce4-6cf0-45da-95c9-2cc0b1e521bb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:31.695034 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:31.718174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a13ce4-6cf0-45da-95c9-2cc0b1e521bb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:31.754335 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0a629-1d58-464c-86ec-e748c94271f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:31.755164 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0a629-1d58-464c-86ec-e748c94271f6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:31.755449 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0a629-1d58-464c-86ec-e748c94271f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:31.755722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0a629-1d58-464c-86ec-e748c94271f6 None admin] PATH_INFO: `/v3/projects/3e81e6df3a074faca7d8f0ebc58a33cb` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:31.756976 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0a629-1d58-464c-86ec-e748c94271f6 None admin] RBAC: Authorizing `identity:get_project(project_id=3e81e6df3a074faca7d8f0ebc58a33cb)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:31.758529 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0a629-1d58-464c-86ec-e748c94271f6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:31.760246 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 570/1160] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:56:31 2022] GET /identity/v3/projects/3e81e6df3a074faca7d8f0ebc58a33cb => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:31.767813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb026b-f257-435b-8983-f80abffee550 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:31.870376 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb026b-f257-435b-8983-f80abffee550 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:31.906743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6133596-27c6-40a7-b059-473854344c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:31.907395 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6133596-27c6-40a7-b059-473854344c30 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:31.907675 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6133596-27c6-40a7-b059-473854344c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:31.907944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6133596-27c6-40a7-b059-473854344c30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:31.908776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6133596-27c6-40a7-b059-473854344c30 None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=3e81e6df3a074faca7d8f0ebc58a33cb, user.id=36783f3aaf1b4c948a182c0027bf9069) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:31.909080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6133596-27c6-40a7-b059-473854344c30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:31.910554 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6133596-27c6-40a7-b059-473854344c30 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:31.916490 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 591/1161] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:56:31 2022] GET /identity/v3/role_assignments?user.id=36783f3aaf1b4c948a182c0027bf9069&scope.project.id=3e81e6df3a074faca7d8f0ebc58a33cb&role.id=aefba81d87bf47258c17064af7d9a05f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:34.121102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a7328-e0da-4661-9367-5dae6f9789fd None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:34.122103 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a7328-e0da-4661-9367-5dae6f9789fd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:34.122103 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a7328-e0da-4661-9367-5dae6f9789fd None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:34.125119 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 571/1162] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:34.133694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac784786-bb34-441f-8fe5-ed8c928376db None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:34.134410 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac784786-bb34-441f-8fe5-ed8c928376db None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:34.134558 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac784786-bb34-441f-8fe5-ed8c928376db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:34.153719 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ac784786-bb34-441f-8fe5-ed8c928376db None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:34.154926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ac784786-bb34-441f-8fe5-ed8c928376db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:34.197456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:34.228784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 592/1163] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:34.251226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a7328-e0da-4661-9367-5dae6f9789fd None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:34.364308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a7328-e0da-4661-9367-5dae6f9789fd None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:34.399915 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bda1dc-c9e4-445a-8a42-b89782f60ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:34.400488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bda1dc-c9e4-445a-8a42-b89782f60ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:34.400765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bda1dc-c9e4-445a-8a42-b89782f60ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:34.401039 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bda1dc-c9e4-445a-8a42-b89782f60ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:34.416488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:34.475213 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bda1dc-c9e4-445a-8a42-b89782f60ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:34.476686 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bda1dc-c9e4-445a-8a42-b89782f60ee8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:34.591955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 572/1164] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:56:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:56:34.598456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac784786-bb34-441f-8fe5-ed8c928376db None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:34.713814 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac784786-bb34-441f-8fe5-ed8c928376db None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:34.752112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edaebc-d77c-4f8c-b7b1-3e9949551473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:34.752944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edaebc-d77c-4f8c-b7b1-3e9949551473 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:34.753224 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edaebc-d77c-4f8c-b7b1-3e9949551473 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:34.753491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edaebc-d77c-4f8c-b7b1-3e9949551473 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:34.760289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edaebc-d77c-4f8c-b7b1-3e9949551473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:34.761764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edaebc-d77c-4f8c-b7b1-3e9949551473 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:34.775740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-b0edaebc-d77c-4f8c-b7b1-3e9949551473 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 20:56:34.775740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:56:34.775740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 20:56:34.775740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 20:56:34.775740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:56:34.775740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:56:34.775740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:56:34.775740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:56:34.775740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 20:56:34.775740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:56:34.775740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:56:34.775740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:56:34.775740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:56:34.775740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:56:34.775740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:56:34.775740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:56:34.775740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:56:34.776876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:56:34.776876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:56:34.776876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:56:34.776876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:56:34.776876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:56:34.776876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:56:34.776876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:56:34.776876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:56:34.776876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:56:34.776876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:56:34.776876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:56:34.776876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:56:34.776876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:56:34.776876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:56:34.776876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:56:34.776876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:56:34.778165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:56:34.778165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:56:34.778165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:56:34.778165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:56:34.778165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:56:34.778165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:56:34.778165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:56:34.778165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:56:34.778165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:56:34.778165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:56:34.778165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 20:56:34.778165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:56:34.778165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 20:56:34.778165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:56:34.778165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 593/1165] 10.222.0.61 () {56 vars in 1117 bytes} [Thu May 26 20:56:34 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:56:34.783706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bda1dc-c9e4-445a-8a42-b89782f60ee8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:34.830935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:34.892196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bda1dc-c9e4-445a-8a42-b89782f60ee8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:34.927871 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14489d1b-81f2-4efa-a4a2-1449be2bf14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:34.928542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14489d1b-81f2-4efa-a4a2-1449be2bf14d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:34.928826 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14489d1b-81f2-4efa-a4a2-1449be2bf14d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:34.929129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14489d1b-81f2-4efa-a4a2-1449be2bf14d None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:34.937069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14489d1b-81f2-4efa-a4a2-1449be2bf14d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:34.937069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14489d1b-81f2-4efa-a4a2-1449be2bf14d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:34.937069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14489d1b-81f2-4efa-a4a2-1449be2bf14d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:34.939539 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 573/1166] 10.222.0.61 () {56 vars in 1115 bytes} [Thu May 26 20:56:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:37.115125 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f2ecd-3682-4f08-9d6f-12dc44024b2b None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:37.115998 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f2ecd-3682-4f08-9d6f-12dc44024b2b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:37.115998 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f2ecd-3682-4f08-9d6f-12dc44024b2b None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:37.118158 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 594/1167] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:37.123642 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22007f2-8905-4793-8478-5f30cffd026b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:37.124084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22007f2-8905-4793-8478-5f30cffd026b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:37.124181 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22007f2-8905-4793-8478-5f30cffd026b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:37.143001 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e22007f2-8905-4793-8478-5f30cffd026b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:37.144166 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e22007f2-8905-4793-8478-5f30cffd026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:37.218913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 574/1168] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:37.242468 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f2ecd-3682-4f08-9d6f-12dc44024b2b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:37.290072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:37.367295 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f2ecd-3682-4f08-9d6f-12dc44024b2b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:37.402821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975b847-dc26-4ae4-af90-76f840faa957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:37.403498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975b847-dc26-4ae4-af90-76f840faa957 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:37.404120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975b847-dc26-4ae4-af90-76f840faa957 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:37.404120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975b847-dc26-4ae4-af90-76f840faa957 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:37.404815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975b847-dc26-4ae4-af90-76f840faa957 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:37.406252 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975b847-dc26-4ae4-af90-76f840faa957 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:37.423738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 595/1169] 10.222.0.61 () {60 vars in 1138 bytes} [Thu May 26 20:56:37 2022] POST /identity/v3/domains => generated 267 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:56:39.631694 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd384b-fdb3-42d2-97b5-23cc748e19e6 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:39.632606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd384b-fdb3-42d2-97b5-23cc748e19e6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:39.632606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd384b-fdb3-42d2-97b5-23cc748e19e6 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:39.634906 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 575/1170] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:39.640786 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51909b1b-958b-41cb-b628-a5000c3574fc None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:39.641229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51909b1b-958b-41cb-b628-a5000c3574fc None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:39.641339 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51909b1b-958b-41cb-b628-a5000c3574fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:39.660809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-51909b1b-958b-41cb-b628-a5000c3574fc None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:39.662028 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-51909b1b-958b-41cb-b628-a5000c3574fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:39.741985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 596/1171] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:39.773253 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd384b-fdb3-42d2-97b5-23cc748e19e6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:39.822594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:39.886591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd384b-fdb3-42d2-97b5-23cc748e19e6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:39.921110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bf13c-91f0-4983-be59-86a426c8083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:39.922005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bf13c-91f0-4983-be59-86a426c8083e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:39.922285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bf13c-91f0-4983-be59-86a426c8083e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:39.922555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bf13c-91f0-4983-be59-86a426c8083e None admin] PATH_INFO: `/v3/domains/030172955d164090b0a9ab3ab851e874` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:39.933737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bf13c-91f0-4983-be59-86a426c8083e None admin] RBAC: Authorizing `identity:get_domain(domain_id=030172955d164090b0a9ab3ab851e874)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:39.935263 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bf13c-91f0-4983-be59-86a426c8083e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:39.936912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 576/1172] 10.222.0.61 () {56 vars in 1183 bytes} [Thu May 26 20:56:39 2022] GET /identity/v3/domains/030172955d164090b0a9ab3ab851e874 => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:39.946742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51909b1b-958b-41cb-b628-a5000c3574fc None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:39.979672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:40.057271 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51909b1b-958b-41cb-b628-a5000c3574fc None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:40.105340 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d42d4c-f6c6-4d0f-842f-6594771b05d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:40.106005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d42d4c-f6c6-4d0f-842f-6594771b05d0 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:40.106284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d42d4c-f6c6-4d0f-842f-6594771b05d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:40.106560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d42d4c-f6c6-4d0f-842f-6594771b05d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:40.107268 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d42d4c-f6c6-4d0f-842f-6594771b05d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:40.108713 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d42d4c-f6c6-4d0f-842f-6594771b05d0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:40.142762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 597/1173] 10.222.0.61 () {60 vars in 1141 bytes} [Thu May 26 20:56:39 2022] POST /identity/v3/projects => generated 361 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:56:42.345383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de3b9c-453d-4014-a70d-1c798c805ccd None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:42.346305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de3b9c-453d-4014-a70d-1c798c805ccd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:42.346437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de3b9c-453d-4014-a70d-1c798c805ccd None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:42.348663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 577/1174] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:42.355169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a602d-a94a-404b-bec4-fe1535820d6e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:42.355619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a602d-a94a-404b-bec4-fe1535820d6e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:42.355747 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a602d-a94a-404b-bec4-fe1535820d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:42.379562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-931a602d-a94a-404b-bec4-fe1535820d6e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:42.380766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-931a602d-a94a-404b-bec4-fe1535820d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:42.450419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 598/1175] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:42.475652 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de3b9c-453d-4014-a70d-1c798c805ccd None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:42.579326 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:42.584030 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de3b9c-453d-4014-a70d-1c798c805ccd None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:42.619429 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a775545-8f2c-4789-af8b-0ec9856b55d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:42.620228 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a775545-8f2c-4789-af8b-0ec9856b55d5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:42.620589 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a775545-8f2c-4789-af8b-0ec9856b55d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:42.620901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a775545-8f2c-4789-af8b-0ec9856b55d5 None admin] PATH_INFO: `/v3/domains/030172955d164090b0a9ab3ab851e874` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:42.622173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a775545-8f2c-4789-af8b-0ec9856b55d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=030172955d164090b0a9ab3ab851e874)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:42.623762 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a775545-8f2c-4789-af8b-0ec9856b55d5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:42.625387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 578/1176] 10.222.0.61 () {56 vars in 1183 bytes} [Thu May 26 20:56:42 2022] GET /identity/v3/domains/030172955d164090b0a9ab3ab851e874 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:42.632064 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a602d-a94a-404b-bec4-fe1535820d6e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:42.642797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:42.764106 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a602d-a94a-404b-bec4-fe1535820d6e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:42.799632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a36ea-9be2-4ffc-801f-719e6d458d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:42.800305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a36ea-9be2-4ffc-801f-719e6d458d9f None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:42.800587 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a36ea-9be2-4ffc-801f-719e6d458d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:42.800840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a36ea-9be2-4ffc-801f-719e6d458d9f None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:42.801576 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a36ea-9be2-4ffc-801f-719e6d458d9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:42.803067 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a36ea-9be2-4ffc-801f-719e6d458d9f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:42.826673 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 599/1177] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:56:42 2022] POST /identity/v3/users => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:56:45.064404 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6049a-cc40-4bc6-ad60-8f1be6b536fd None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:45.064953 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6049a-cc40-4bc6-ad60-8f1be6b536fd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:45.064953 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6049a-cc40-4bc6-ad60-8f1be6b536fd None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:45.066311 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 579/1178] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:45.072796 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd16032-dc8f-45fb-98e7-410f4dce7475 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:45.073425 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd16032-dc8f-45fb-98e7-410f4dce7475 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:45.073659 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd16032-dc8f-45fb-98e7-410f4dce7475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:45.093530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1cd16032-dc8f-45fb-98e7-410f4dce7475 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:45.094743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1cd16032-dc8f-45fb-98e7-410f4dce7475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:45.152657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:45.166256 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 600/1179] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:45.189445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6049a-cc40-4bc6-ad60-8f1be6b536fd None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:45.301331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6049a-cc40-4bc6-ad60-8f1be6b536fd None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:45.336740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d79f72-e869-4f82-ba31-558f3fa89e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:45.337476 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d79f72-e869-4f82-ba31-558f3fa89e3a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:45.337759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d79f72-e869-4f82-ba31-558f3fa89e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:45.338068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d79f72-e869-4f82-ba31-558f3fa89e3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:45.348833 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d79f72-e869-4f82-ba31-558f3fa89e3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:56:45.356412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a7d79f72-e869-4f82-ba31-558f3fa89e3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:56:45.356412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:56:45.356412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:56:45.356412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:56:45.356412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:56:45.356412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:56:45.356412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:56:45.356412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:56:45.356412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:56:45.356412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:56:45.356412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:56:45.356412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:56:45.356412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:56:45.356412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:56:45.356412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:56:45.356412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:56:45.357574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:56:45.357574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:56:45.357574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:56:45.357574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:56:45.357574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:56:45.357574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:56:45.357574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:56:45.357574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:56:45.357574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:56:45.357574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:56:45.357574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:56:45.357574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:56:45.357574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:56:45.357574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:56:45.357574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:56:45.357574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:56:45.358838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:56:45.358838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:56:45.358838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:56:45.358838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:56:45.358838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:56:45.358838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:56:45.358838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:56:45.358838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:56:45.358838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:56:45.358838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:56:45.358838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:56:45.358838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:56:45.358838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 580/1180] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:56:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:56:45.366141 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd16032-dc8f-45fb-98e7-410f4dce7475 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:45.469837 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd16032-dc8f-45fb-98e7-410f4dce7475 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:45.506944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e910e1c-cf23-4be8-b385-d1b439a47364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:45.507636 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e910e1c-cf23-4be8-b385-d1b439a47364 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:45.507916 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e910e1c-cf23-4be8-b385-d1b439a47364 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:45.508191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e910e1c-cf23-4be8-b385-d1b439a47364 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:45.509224 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e910e1c-cf23-4be8-b385-d1b439a47364 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:45.509611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e910e1c-cf23-4be8-b385-d1b439a47364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:45.511049 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e910e1c-cf23-4be8-b385-d1b439a47364 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:45.520496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 601/1181] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:56:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:45.527065 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d79f72-e869-4f82-ba31-558f3fa89e3a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:45.558419 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:45.630629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d79f72-e869-4f82-ba31-558f3fa89e3a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:45.664719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd098768-9605-427b-9620-8b6e4119af42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:45.665623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd098768-9605-427b-9620-8b6e4119af42 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:45.665929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd098768-9605-427b-9620-8b6e4119af42 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:45.666201 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd098768-9605-427b-9620-8b6e4119af42 None admin] PATH_INFO: `/v3/users/b952f44210024606a3a9f80a89a41550` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:45.679854 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd098768-9605-427b-9620-8b6e4119af42 None admin] RBAC: Authorizing `identity:get_user(user_id=b952f44210024606a3a9f80a89a41550)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:45.681304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd098768-9605-427b-9620-8b6e4119af42 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:45.682989 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 581/1182] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:56:45 2022] GET /identity/v3/users/b952f44210024606a3a9f80a89a41550 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:45.689298 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e910e1c-cf23-4be8-b385-d1b439a47364 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:45.745334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:45.793334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e910e1c-cf23-4be8-b385-d1b439a47364 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:45.828011 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f0101-1991-4a5f-b9a9-0e3460859e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:45.828661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f0101-1991-4a5f-b9a9-0e3460859e31 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:45.828937 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f0101-1991-4a5f-b9a9-0e3460859e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:45.829214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f0101-1991-4a5f-b9a9-0e3460859e31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:45.896411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f0101-1991-4a5f-b9a9-0e3460859e31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:45.897829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f0101-1991-4a5f-b9a9-0e3460859e31 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:45.952590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:46.000077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 602/1183] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:56:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:56:46.006229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd098768-9605-427b-9620-8b6e4119af42 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:46.091373 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:46.107146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd098768-9605-427b-9620-8b6e4119af42 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:46.142829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f7c9f-1707-4f36-8c5a-c0c67ff2ac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:46.143670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f7c9f-1707-4f36-8c5a-c0c67ff2ac32 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:46.143945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f7c9f-1707-4f36-8c5a-c0c67ff2ac32 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:46.144206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f7c9f-1707-4f36-8c5a-c0c67ff2ac32 None admin] PATH_INFO: `/v3/projects/4898ab36883744b89867f2027e948c34` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:46.145421 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f7c9f-1707-4f36-8c5a-c0c67ff2ac32 None admin] RBAC: Authorizing `identity:get_project(project_id=4898ab36883744b89867f2027e948c34)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:46.146942 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f7c9f-1707-4f36-8c5a-c0c67ff2ac32 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:46.148558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 582/1184] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:56:46 2022] GET /identity/v3/projects/4898ab36883744b89867f2027e948c34 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:46.155309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f0101-1991-4a5f-b9a9-0e3460859e31 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:46.275733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f0101-1991-4a5f-b9a9-0e3460859e31 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:46.311084 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38348c2-0022-4983-b60f-99f14e450462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:46.311726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38348c2-0022-4983-b60f-99f14e450462 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:46.312003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38348c2-0022-4983-b60f-99f14e450462 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:46.312276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38348c2-0022-4983-b60f-99f14e450462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:46.313104 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38348c2-0022-4983-b60f-99f14e450462 None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=4898ab36883744b89867f2027e948c34, user.id=b952f44210024606a3a9f80a89a41550) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:46.313417 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38348c2-0022-4983-b60f-99f14e450462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:46.314907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38348c2-0022-4983-b60f-99f14e450462 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:46.320465 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 603/1185] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:56:46 2022] GET /identity/v3/role_assignments?user.id=b952f44210024606a3a9f80a89a41550&scope.project.id=4898ab36883744b89867f2027e948c34&role.id=aefba81d87bf47258c17064af7d9a05f => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:48.514638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297f7d2-8e37-448b-95c1-cc12237da066 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:48.515539 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297f7d2-8e37-448b-95c1-cc12237da066 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:48.515539 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297f7d2-8e37-448b-95c1-cc12237da066 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:48.517833 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 583/1186] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:48.527073 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96514cc7-88f4-470b-9909-af90d9fc7add None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:48.527764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96514cc7-88f4-470b-9909-af90d9fc7add None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:48.527950 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96514cc7-88f4-470b-9909-af90d9fc7add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:48.547693 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-96514cc7-88f4-470b-9909-af90d9fc7add None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:48.548886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-96514cc7-88f4-470b-9909-af90d9fc7add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:48.563697 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:48.628195 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 604/1187] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:48.654813 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297f7d2-8e37-448b-95c1-cc12237da066 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:48.763031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297f7d2-8e37-448b-95c1-cc12237da066 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:48.800699 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74feb9d1-7f2a-49a1-a1fd-7f39c665d717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:48.801420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74feb9d1-7f2a-49a1-a1fd-7f39c665d717 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:48.801698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74feb9d1-7f2a-49a1-a1fd-7f39c665d717 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:48.802006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74feb9d1-7f2a-49a1-a1fd-7f39c665d717 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:48.812686 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74feb9d1-7f2a-49a1-a1fd-7f39c665d717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:56:48.820129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-74feb9d1-7f2a-49a1-a1fd-7f39c665d717 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:56:48.820129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:56:48.820129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:56:48.820129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:56:48.820129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:56:48.820129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:56:48.820129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:56:48.820129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:56:48.820129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:56:48.820129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:56:48.820129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:56:48.820129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:56:48.820129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:56:48.820129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:56:48.820129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:56:48.820129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:56:48.821252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:56:48.821252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:56:48.821252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:56:48.821252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:56:48.821252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:56:48.821252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:56:48.821252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:56:48.821252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:56:48.821252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:56:48.821252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:56:48.821252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:56:48.821252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:56:48.821252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:56:48.821252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:56:48.821252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:56:48.821252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:56:48.822121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:56:48.822121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:56:48.822121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:56:48.822121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:56:48.822121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:56:48.822121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:56:48.822121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:56:48.822121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:56:48.822121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:56:48.822121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:56:48.822121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:56:48.822121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:56:48.822121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 584/1188] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:56:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:56:48.827806 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96514cc7-88f4-470b-9909-af90d9fc7add None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:48.945533 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96514cc7-88f4-470b-9909-af90d9fc7add None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:48.987082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5ac86-31a6-4161-893f-2b401114d49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:48.987767 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5ac86-31a6-4161-893f-2b401114d49d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:48.988049 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5ac86-31a6-4161-893f-2b401114d49d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:48.988328 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5ac86-31a6-4161-893f-2b401114d49d None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:48.989085 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5ac86-31a6-4161-893f-2b401114d49d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:48.989395 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5ac86-31a6-4161-893f-2b401114d49d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:48.990889 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5ac86-31a6-4161-893f-2b401114d49d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:48.999143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 605/1189] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:56:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:49.008852 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74feb9d1-7f2a-49a1-a1fd-7f39c665d717 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:49.035339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:49.126269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74feb9d1-7f2a-49a1-a1fd-7f39c665d717 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:49.162722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bd0b9-ea33-4624-b286-5ab2198b03ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:49.163601 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bd0b9-ea33-4624-b286-5ab2198b03ed None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:49.163887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bd0b9-ea33-4624-b286-5ab2198b03ed None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:49.164156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bd0b9-ea33-4624-b286-5ab2198b03ed None admin] PATH_INFO: `/v3/users/b952f44210024606a3a9f80a89a41550` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:49.165473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bd0b9-ea33-4624-b286-5ab2198b03ed None admin] RBAC: Authorizing `identity:get_user(user_id=b952f44210024606a3a9f80a89a41550)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:49.166950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bd0b9-ea33-4624-b286-5ab2198b03ed None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:49.168595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 585/1190] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:56:49 2022] GET /identity/v3/users/b952f44210024606a3a9f80a89a41550 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:49.174870 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5ac86-31a6-4161-893f-2b401114d49d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:49.188982 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:49.281835 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5ac86-31a6-4161-893f-2b401114d49d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:49.318087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69c89c-8950-47b3-b7fa-6c81eb4b57d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:49.318946 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69c89c-8950-47b3-b7fa-6c81eb4b57d3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:49.319204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69c89c-8950-47b3-b7fa-6c81eb4b57d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:49.319485 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69c89c-8950-47b3-b7fa-6c81eb4b57d3 None admin] PATH_INFO: `/v3/projects/4898ab36883744b89867f2027e948c34` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:49.320793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69c89c-8950-47b3-b7fa-6c81eb4b57d3 None admin] RBAC: Authorizing `identity:get_project(project_id=4898ab36883744b89867f2027e948c34)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:49.322276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69c89c-8950-47b3-b7fa-6c81eb4b57d3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:49.323980 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 606/1191] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:56:49 2022] GET /identity/v3/projects/4898ab36883744b89867f2027e948c34 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:49.331095 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bd0b9-ea33-4624-b286-5ab2198b03ed None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:49.430017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:49.452604 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bd0b9-ea33-4624-b286-5ab2198b03ed None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:49.488065 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e457d7b-94ae-4a3a-b1f2-c81c5ce62c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:49.488959 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e457d7b-94ae-4a3a-b1f2-c81c5ce62c2b None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:49.489236 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e457d7b-94ae-4a3a-b1f2-c81c5ce62c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:49.489506 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e457d7b-94ae-4a3a-b1f2-c81c5ce62c2b None admin] PATH_INFO: `/v3/projects/4898ab36883744b89867f2027e948c34/users/b952f44210024606a3a9f80a89a41550/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:49.491681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e457d7b-94ae-4a3a-b1f2-c81c5ce62c2b None admin] RBAC: Authorizing `identity:create_grant(project_id=4898ab36883744b89867f2027e948c34, user_id=b952f44210024606a3a9f80a89a41550, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:49.493115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e457d7b-94ae-4a3a-b1f2-c81c5ce62c2b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:49.513060 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 586/1192] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:56:49 2022] PUT /identity/v3/projects/4898ab36883744b89867f2027e948c34/users/b952f44210024606a3a9f80a89a41550/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:56:51.667823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e854a0b-37bd-4053-a4c4-9430a758631f None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:51.668669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e854a0b-37bd-4053-a4c4-9430a758631f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:51.668669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e854a0b-37bd-4053-a4c4-9430a758631f None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:51.670765 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 607/1193] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:56:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:56:51.676266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905debb-b3f7-4d96-8024-a4b74b214210 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:51.676676 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905debb-b3f7-4d96-8024-a4b74b214210 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:51.676801 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905debb-b3f7-4d96-8024-a4b74b214210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:51.696137 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7905debb-b3f7-4d96-8024-a4b74b214210 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:56:51.697342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7905debb-b3f7-4d96-8024-a4b74b214210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:56:51.787024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 587/1194] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:56:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:56:51.810420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e854a0b-37bd-4053-a4c4-9430a758631f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:51.894133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:51.929366 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e854a0b-37bd-4053-a4c4-9430a758631f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:51.965628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b956d29-74f0-4a7f-a218-5b9ccbd021bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:51.966450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956d29-74f0-4a7f-a218-5b9ccbd021bb None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:51.966760 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956d29-74f0-4a7f-a218-5b9ccbd021bb None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:51.967035 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956d29-74f0-4a7f-a218-5b9ccbd021bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:51.977908 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b956d29-74f0-4a7f-a218-5b9ccbd021bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:56:51.985413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-9b956d29-74f0-4a7f-a218-5b9ccbd021bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:56:51.985413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:56:51.985413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:56:51.985413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:56:51.985413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:56:51.985413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:56:51.985413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:56:51.985413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:56:51.985413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:56:51.985413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:56:51.985413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:56:51.985413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:56:51.985413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:56:51.985413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:56:51.985413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:56:51.985413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:56:51.986514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:56:51.986514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:56:51.986514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:56:51.986514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:56:51.986514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:56:51.986514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:56:51.986514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:56:51.986514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:56:51.986514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:56:51.986514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:56:51.986514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:56:51.986514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:56:51.986514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:56:51.986514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:56:51.986514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:56:51.986514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:56:51.987534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:56:51.987534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:56:51.987534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:56:51.987534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:56:51.987534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:56:51.987534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:56:51.987534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:56:51.987534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:56:51.987534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:56:51.987534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:56:51.987534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:56:51.987534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:56:51.987534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 608/1195] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:56:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:56:51.995653 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905debb-b3f7-4d96-8024-a4b74b214210 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:52.064928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:52.097496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905debb-b3f7-4d96-8024-a4b74b214210 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:52.135970 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658f23b-4ca0-458b-9068-f642e4449b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:52.136639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658f23b-4ca0-458b-9068-f642e4449b47 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:52.136915 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658f23b-4ca0-458b-9068-f642e4449b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:52.137184 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658f23b-4ca0-458b-9068-f642e4449b47 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:52.137953 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658f23b-4ca0-458b-9068-f642e4449b47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:52.138420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658f23b-4ca0-458b-9068-f642e4449b47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:52.139954 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658f23b-4ca0-458b-9068-f642e4449b47 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:52.148432 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 588/1196] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:56:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:52.155524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b956d29-74f0-4a7f-a218-5b9ccbd021bb None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:52.274415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b956d29-74f0-4a7f-a218-5b9ccbd021bb None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:52.319039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c1a17-3c05-4315-882e-6ce17ce62e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:52.319923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c1a17-3c05-4315-882e-6ce17ce62e2a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:52.320205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c1a17-3c05-4315-882e-6ce17ce62e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:52.320481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c1a17-3c05-4315-882e-6ce17ce62e2a None admin] PATH_INFO: `/v3/users/b952f44210024606a3a9f80a89a41550` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:52.321721 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c1a17-3c05-4315-882e-6ce17ce62e2a None admin] RBAC: Authorizing `identity:get_user(user_id=b952f44210024606a3a9f80a89a41550)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:52.323218 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c1a17-3c05-4315-882e-6ce17ce62e2a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:52.324856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 609/1197] 10.222.0.61 () {56 vars in 1177 bytes} [Thu May 26 20:56:52 2022] GET /identity/v3/users/b952f44210024606a3a9f80a89a41550 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:52.331686 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658f23b-4ca0-458b-9068-f642e4449b47 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:52.454585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658f23b-4ca0-458b-9068-f642e4449b47 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:52.490873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6c512-1117-437d-9ca5-96614726a6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:52.491518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6c512-1117-437d-9ca5-96614726a6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:52.491798 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6c512-1117-437d-9ca5-96614726a6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:52.492072 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6c512-1117-437d-9ca5-96614726a6f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:52.495077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:52.571561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6c512-1117-437d-9ca5-96614726a6f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:52.572946 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6c512-1117-437d-9ca5-96614726a6f4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:52.695884 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 589/1198] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:56:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:56:52.702865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c1a17-3c05-4315-882e-6ce17ce62e2a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:52.713235 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:52.823905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c1a17-3c05-4315-882e-6ce17ce62e2a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:52.866446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca99552-0495-4e10-af15-ae7e4c78f845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:52.867314 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca99552-0495-4e10-af15-ae7e4c78f845 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:52.867596 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca99552-0495-4e10-af15-ae7e4c78f845 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:52.867871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca99552-0495-4e10-af15-ae7e4c78f845 None admin] PATH_INFO: `/v3/projects/4898ab36883744b89867f2027e948c34` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:52.869200 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca99552-0495-4e10-af15-ae7e4c78f845 None admin] RBAC: Authorizing `identity:get_project(project_id=4898ab36883744b89867f2027e948c34)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:52.870781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca99552-0495-4e10-af15-ae7e4c78f845 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:52.872487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 610/1199] 10.222.0.61 () {56 vars in 1186 bytes} [Thu May 26 20:56:52 2022] GET /identity/v3/projects/4898ab36883744b89867f2027e948c34 => generated 361 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:56:52.879266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6c512-1117-437d-9ca5-96614726a6f4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:56:52.918317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:56:52.988833 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6c512-1117-437d-9ca5-96614726a6f4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:56:53.029113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97008f2e-ba6a-43df-a71e-1a7b235ee8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:56:53.030335 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97008f2e-ba6a-43df-a71e-1a7b235ee8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:56:53.030768 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97008f2e-ba6a-43df-a71e-1a7b235ee8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:56:53.031213 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97008f2e-ba6a-43df-a71e-1a7b235ee8f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:56:53.032046 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97008f2e-ba6a-43df-a71e-1a7b235ee8f8 None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=4898ab36883744b89867f2027e948c34, user.id=b952f44210024606a3a9f80a89a41550) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:56:53.032349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97008f2e-ba6a-43df-a71e-1a7b235ee8f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:56:53.033788 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97008f2e-ba6a-43df-a71e-1a7b235ee8f8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:56:53.040455 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 590/1200] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:56:52 2022] GET /identity/v3/role_assignments?user.id=b952f44210024606a3a9f80a89a41550&scope.project.id=4898ab36883744b89867f2027e948c34&role.id=aefba81d87bf47258c17064af7d9a05f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:57:02.862365 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=63 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:57:03.037513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=51 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:57:53.593469 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e40d1-1be5-4fa2-8843-4aaaa011d457 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:53.594203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e40d1-1be5-4fa2-8843-4aaaa011d457 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:53.594203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e40d1-1be5-4fa2-8843-4aaaa011d457 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:53.596128 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 611/1201] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:57:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:57:53.601771 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae203f03-0710-49c3-996d-30ffbe2a5696 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:53.602455 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae203f03-0710-49c3-996d-30ffbe2a5696 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:53.602455 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae203f03-0710-49c3-996d-30ffbe2a5696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:53.622587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ae203f03-0710-49c3-996d-30ffbe2a5696 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:57:53.624272 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ae203f03-0710-49c3-996d-30ffbe2a5696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:57:53.715768 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 591/1202] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:57:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:57:53.740056 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e40d1-1be5-4fa2-8843-4aaaa011d457 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:57:53.878095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e40d1-1be5-4fa2-8843-4aaaa011d457 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:57:53.920023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a2357-61c1-41f9-bb95-bf324633567c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:57:53.920845 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a2357-61c1-41f9-bb95-bf324633567c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:53.921131 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a2357-61c1-41f9-bb95-bf324633567c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:53.921408 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a2357-61c1-41f9-bb95-bf324633567c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:53.932989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a2357-61c1-41f9-bb95-bf324633567c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:57:53.934530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a2357-61c1-41f9-bb95-bf324633567c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:57:53.958279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-765a2357-61c1-41f9-bb95-bf324633567c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:57:53.958279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:57:53.958279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:57:53.958279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:57:53.958279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:57:53.958279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:57:53.958279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:57:53.958279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:57:53.958279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:57:53.958279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:57:53.958279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:57:53.958279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:57:53.958279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:57:53.958279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:57:53.958279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:57:53.959397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:57:53.959397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:57:53.959397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:57:53.959397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:57:53.959397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:57:53.959397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:57:53.959397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:57:53.959397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:57:53.959397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:57:53.959397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:57:53.959397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:57:53.959397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:57:53.959397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:57:53.959397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:57:53.959397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:57:53.959397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:57:53.959397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:57:53.962746 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:57:53.962746 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:57:53.962746 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:57:53.962746 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:57:53.962746 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 612/1203] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:57:53.966287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae203f03-0710-49c3-996d-30ffbe2a5696 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:57:54.104948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae203f03-0710-49c3-996d-30ffbe2a5696 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:57:54.145919 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:57:54.154949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c92922-dcac-48c7-b179-9bfc64710ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:57:54.155625 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c92922-dcac-48c7-b179-9bfc64710ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:54.155931 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c92922-dcac-48c7-b179-9bfc64710ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:54.156226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c92922-dcac-48c7-b179-9bfc64710ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:54.156916 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c92922-dcac-48c7-b179-9bfc64710ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:57:54.157194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c92922-dcac-48c7-b179-9bfc64710ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:57:54.158605 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c92922-dcac-48c7-b179-9bfc64710ad6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:57:54.171536 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 592/1204] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:57:54.177099 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a2357-61c1-41f9-bb95-bf324633567c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:57:54.246834 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:57:54.311499 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a2357-61c1-41f9-bb95-bf324633567c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:57:54.354403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a01ad-862f-42b7-b64c-4554a179a42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:57:54.355244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a01ad-862f-42b7-b64c-4554a179a42b None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:54.355518 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a01ad-862f-42b7-b64c-4554a179a42b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:54.355866 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a01ad-862f-42b7-b64c-4554a179a42b None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:54.356785 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a01ad-862f-42b7-b64c-4554a179a42b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:57:54.358965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a01ad-862f-42b7-b64c-4554a179a42b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:57:54.398314 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 613/1205] 10.222.0.61 () {60 vars in 1132 bytes} [Thu May 26 20:57:54 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:57:56.777561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f6884-1ed6-4e09-a24f-ad4603d13375 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:56.778136 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f6884-1ed6-4e09-a24f-ad4603d13375 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:56.778338 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f6884-1ed6-4e09-a24f-ad4603d13375 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:56.779867 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 593/1206] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:57:56.785885 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd05280-309c-4432-a629-9b089c606b99 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:56.786343 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd05280-309c-4432-a629-9b089c606b99 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:56.786429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd05280-309c-4432-a629-9b089c606b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:56.803517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3cd05280-309c-4432-a629-9b089c606b99 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:57:56.804702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3cd05280-309c-4432-a629-9b089c606b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:57:56.879490 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 614/1207] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:57:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:57:56.903107 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f6884-1ed6-4e09-a24f-ad4603d13375 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:57:57.021916 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f6884-1ed6-4e09-a24f-ad4603d13375 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:57:57.060064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff42850-e0d1-4a6b-b6e0-d459cf5c5dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:57:57.061084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff42850-e0d1-4a6b-b6e0-d459cf5c5dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:57.061387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff42850-e0d1-4a6b-b6e0-d459cf5c5dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:57.061715 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff42850-e0d1-4a6b-b6e0-d459cf5c5dc4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:57.074012 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff42850-e0d1-4a6b-b6e0-d459cf5c5dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:57:57.081824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-5ff42850-e0d1-4a6b-b6e0-d459cf5c5dc4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:57:57.081824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:57:57.081824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:57:57.081824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:57:57.081824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:57:57.081824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:57:57.081824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:57:57.081824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:57:57.081824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:57:57.081824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:57:57.081824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:57:57.081824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:57:57.081824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:57:57.081824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:57:57.081824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:57:57.081824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:57:57.083286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:57:57.083286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:57:57.083286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:57:57.083286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:57:57.083286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:57:57.083286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:57:57.083286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:57:57.083286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:57:57.083286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:57:57.083286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:57:57.083286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:57:57.083286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:57:57.083286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:57:57.083286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:57:57.083286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:57:57.083286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:57:57.086776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:57:57.086776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:57:57.086776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:57:57.086776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:57:57.086776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:57:57.086776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:57:57.086776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:57:57.086776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:57:57.086776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:57:57.086776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:57:57.086776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:57:57.086776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:57:57.086776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 594/1208] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:57:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:57:57.089896 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd05280-309c-4432-a629-9b089c606b99 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:57:57.131139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:57:57.196830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd05280-309c-4432-a629-9b089c606b99 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:57:57.235707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277934f-984e-479b-8f31-f5ed595e4375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:57:57.236397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277934f-984e-479b-8f31-f5ed595e4375 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:57.236646 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277934f-984e-479b-8f31-f5ed595e4375 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:57.236953 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277934f-984e-479b-8f31-f5ed595e4375 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:57.237696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277934f-984e-479b-8f31-f5ed595e4375 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:57:57.238029 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277934f-984e-479b-8f31-f5ed595e4375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:57:57.239419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277934f-984e-479b-8f31-f5ed595e4375 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:57:57.247840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 615/1209] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:57:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:57:57.254326 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff42850-e0d1-4a6b-b6e0-d459cf5c5dc4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:57:57.317274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:57:57.374157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff42850-e0d1-4a6b-b6e0-d459cf5c5dc4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:57:57.413260 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ad4fe-4f36-476c-892c-bd56f2637aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:57:57.414114 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ad4fe-4f36-476c-892c-bd56f2637aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:57.414397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ad4fe-4f36-476c-892c-bd56f2637aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:57.414690 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ad4fe-4f36-476c-892c-bd56f2637aa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:57.428264 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ad4fe-4f36-476c-892c-bd56f2637aa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:57:57.430009 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ad4fe-4f36-476c-892c-bd56f2637aa8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:57:57.451687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-436ad4fe-4f36-476c-892c-bd56f2637aa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:57:57.451687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:57:57.451687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:57:57.451687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:57:57.451687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:57:57.451687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:57:57.451687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:57:57.451687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:57:57.451687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:57:57.451687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:57:57.451687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:57:57.451687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:57:57.451687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:57:57.451687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:57:57.451687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:57:57.452781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:57:57.452781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:57:57.452781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:57:57.452781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:57:57.452781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:57:57.452781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:57:57.452781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:57:57.452781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:57:57.452781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:57:57.452781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:57:57.452781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:57:57.452781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:57:57.452781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:57:57.452781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:57:57.452781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:57:57.452781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:57:57.452781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:57:57.453697 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:57:57.453697 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:57:57.453697 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:57:57.453697 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:57:57.455360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 595/1210] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:57:57.461880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277934f-984e-479b-8f31-f5ed595e4375 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:57:57.581748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:57:57.586343 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277934f-984e-479b-8f31-f5ed595e4375 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:57:57.625500 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d777bd0-6bb9-4ba9-918a-02b278263152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:57:57.626232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d777bd0-6bb9-4ba9-918a-02b278263152 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:57.626520 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d777bd0-6bb9-4ba9-918a-02b278263152 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:57.626801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d777bd0-6bb9-4ba9-918a-02b278263152 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:57.627534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d777bd0-6bb9-4ba9-918a-02b278263152 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:57:57.627841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d777bd0-6bb9-4ba9-918a-02b278263152 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:57:57.629266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d777bd0-6bb9-4ba9-918a-02b278263152 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:57:57.643133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 616/1211] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:57:57.649080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ad4fe-4f36-476c-892c-bd56f2637aa8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:57:57.775932 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ad4fe-4f36-476c-892c-bd56f2637aa8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:57:57.777634 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:57:57.815757 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f9f21-8c1b-4f57-b0d2-c11c7ca355bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:57:57.816643 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f9f21-8c1b-4f57-b0d2-c11c7ca355bf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:57.816929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f9f21-8c1b-4f57-b0d2-c11c7ca355bf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:57.817206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f9f21-8c1b-4f57-b0d2-c11c7ca355bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:57.825638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f9f21-8c1b-4f57-b0d2-c11c7ca355bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:57:57.827355 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f9f21-8c1b-4f57-b0d2-c11c7ca355bf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:57:57.843459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-451f9f21-8c1b-4f57-b0d2-c11c7ca355bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 20:57:57.843459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:57:57.843459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:57:57.843459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:57:57.843459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:57:57.843459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:57:57.843459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:57:57.843459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:57:57.843459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:57:57.843459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:57:57.843459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:57:57.843459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:57:57.843459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:57:57.843459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:57:57.843459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:57:57.843459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:57:57.844754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:57:57.845729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:57:57.845729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:57:57.845729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:57:57.845729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:57:57.845729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:57:57.845729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:57:57.845729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:57:57.845729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:57:57.845729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 20:57:57.845729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:57:57.845729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 596/1212] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:57:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:57:57.851048 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d777bd0-6bb9-4ba9-918a-02b278263152 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:57:57.972150 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d777bd0-6bb9-4ba9-918a-02b278263152 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:57:58.012060 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329f2cf-4f24-4264-a54e-c64c9e7400f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:57:58.012796 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329f2cf-4f24-4264-a54e-c64c9e7400f9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:58.013078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329f2cf-4f24-4264-a54e-c64c9e7400f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:58.013349 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329f2cf-4f24-4264-a54e-c64c9e7400f9 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:58.014420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329f2cf-4f24-4264-a54e-c64c9e7400f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:57:58.014807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329f2cf-4f24-4264-a54e-c64c9e7400f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:57:58.016273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329f2cf-4f24-4264-a54e-c64c9e7400f9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:57:58.036627 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 617/1213] 10.222.0.61 () {56 vars in 1143 bytes} [Thu May 26 20:57:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:57:58.043324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f9f21-8c1b-4f57-b0d2-c11c7ca355bf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:57:58.170458 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f9f21-8c1b-4f57-b0d2-c11c7ca355bf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:57:58.222641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deedd1-397b-475c-9d7d-364f7864af1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:57:58.223591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deedd1-397b-475c-9d7d-364f7864af1c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:58.223981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deedd1-397b-475c-9d7d-364f7864af1c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:58.224460 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deedd1-397b-475c-9d7d-364f7864af1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:58.258863 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:57:58.304892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71deedd1-397b-475c-9d7d-364f7864af1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:57:58.306474 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71deedd1-397b-475c-9d7d-364f7864af1c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:57:58.427150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 597/1214] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:57:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 20:57:58.433137 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329f2cf-4f24-4264-a54e-c64c9e7400f9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:57:58.456518 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:57:58.568497 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329f2cf-4f24-4264-a54e-c64c9e7400f9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:57:58.612186 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7a5fd-fe30-4100-96c8-51c3db548894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:57:58.613197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7a5fd-fe30-4100-96c8-51c3db548894 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:58.613471 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7a5fd-fe30-4100-96c8-51c3db548894 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:58.613748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7a5fd-fe30-4100-96c8-51c3db548894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:58.625581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7a5fd-fe30-4100-96c8-51c3db548894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:57:58.627989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7a5fd-fe30-4100-96c8-51c3db548894 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:57:58.652013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-ccf7a5fd-fe30-4100-96c8-51c3db548894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:57:58.652013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:57:58.652013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:57:58.652013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:57:58.652013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:57:58.652013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:57:58.652013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:57:58.652013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:57:58.652013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:57:58.652013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:57:58.652013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:57:58.652013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:57:58.652013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:57:58.652013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:57:58.652013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:57:58.653081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:57:58.653081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:57:58.653081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:57:58.653081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:57:58.653081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:57:58.653081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:57:58.653081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:57:58.653081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:57:58.653081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:57:58.653081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:57:58.653081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:57:58.653081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:57:58.653081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:57:58.653081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:57:58.653081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:57:58.653081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:57:58.653081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:57:58.654134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:57:58.654134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:57:58.654134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:57:58.654134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:57:58.654134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 618/1215] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:57:58.659535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deedd1-397b-475c-9d7d-364f7864af1c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:57:58.734611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:57:58.782793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deedd1-397b-475c-9d7d-364f7864af1c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:57:58.833831 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474cf58-5279-4a07-832f-9c6cf16eab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:57:58.833831 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474cf58-5279-4a07-832f-9c6cf16eab39 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:58.833831 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474cf58-5279-4a07-832f-9c6cf16eab39 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:58.833831 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474cf58-5279-4a07-832f-9c6cf16eab39 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:58.834295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474cf58-5279-4a07-832f-9c6cf16eab39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:57:58.834295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474cf58-5279-4a07-832f-9c6cf16eab39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:57:58.834295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474cf58-5279-4a07-832f-9c6cf16eab39 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:57:58.847297 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 598/1216] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:57:58.854313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7a5fd-fe30-4100-96c8-51c3db548894 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:57:58.945635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:57:58.985987 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7a5fd-fe30-4100-96c8-51c3db548894 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:57:59.027416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f46f2-3df0-435d-90ee-39ab4839174b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:57:59.028585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f46f2-3df0-435d-90ee-39ab4839174b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:59.028874 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f46f2-3df0-435d-90ee-39ab4839174b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:59.029341 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f46f2-3df0-435d-90ee-39ab4839174b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:59.038171 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f46f2-3df0-435d-90ee-39ab4839174b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:57:59.039842 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f46f2-3df0-435d-90ee-39ab4839174b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:57:59.055875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-c77f46f2-3df0-435d-90ee-39ab4839174b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:57:59.055875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:57:59.055875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:57:59.055875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:57:59.055875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:57:59.055875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:57:59.055875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:57:59.055875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:57:59.055875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:57:59.055875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:57:59.055875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:57:59.055875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:57:59.055875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:57:59.055875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:57:59.055875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:57:59.056912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:57:59.056912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:57:59.056912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:57:59.056912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:57:59.056912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:57:59.056912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:57:59.056912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:57:59.056912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:57:59.056912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:57:59.056912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:57:59.056912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:57:59.056912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:57:59.056912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:57:59.056912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:57:59.056912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:57:59.056912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:57:59.056912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:57:59.062942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:57:59.062942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:57:59.062942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:57:59.062942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:57:59.062942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:57:59.062942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:57:59.062942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:57:59.062942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:57:59.062942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 619/1217] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:57:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:57:59.063462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474cf58-5279-4a07-832f-9c6cf16eab39 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:57:59.187606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474cf58-5279-4a07-832f-9c6cf16eab39 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:57:59.214282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:57:59.227919 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10429b68-c227-4ff5-8e1b-62143ceb5c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:57:59.228630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10429b68-c227-4ff5-8e1b-62143ceb5c5c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:59.228993 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10429b68-c227-4ff5-8e1b-62143ceb5c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:59.229244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10429b68-c227-4ff5-8e1b-62143ceb5c5c None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:59.230076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10429b68-c227-4ff5-8e1b-62143ceb5c5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:57:59.230448 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10429b68-c227-4ff5-8e1b-62143ceb5c5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:57:59.232112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10429b68-c227-4ff5-8e1b-62143ceb5c5c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:57:59.245896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 599/1218] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:57:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:57:59.251926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f46f2-3df0-435d-90ee-39ab4839174b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:57:59.368230 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f46f2-3df0-435d-90ee-39ab4839174b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:57:59.398629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:57:59.405381 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156cfa4-f89e-41dd-8ac1-fc7d0b418a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:57:59.406289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156cfa4-f89e-41dd-8ac1-fc7d0b418a53 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:57:59.406857 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156cfa4-f89e-41dd-8ac1-fc7d0b418a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:57:59.407255 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156cfa4-f89e-41dd-8ac1-fc7d0b418a53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:57:59.408444 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156cfa4-f89e-41dd-8ac1-fc7d0b418a53 None admin] RBAC: Adding query filter params (role.id=6046421464dd48ea8977d7d1481bde10, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=e8952f35c21c4a2eaf1fbc601fe76242) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:57:59.409031 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156cfa4-f89e-41dd-8ac1-fc7d0b418a53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:57:59.410872 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156cfa4-f89e-41dd-8ac1-fc7d0b418a53 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:57:59.417138 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 620/1219] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:57:59 2022] GET /identity/v3/role_assignments?user.id=e8952f35c21c4a2eaf1fbc601fe76242&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=6046421464dd48ea8977d7d1481bde10 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:01.659655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380255a-6069-4d95-aaf4-7a00fe441245 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:01.660277 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380255a-6069-4d95-aaf4-7a00fe441245 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:01.660277 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380255a-6069-4d95-aaf4-7a00fe441245 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:01.661946 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 600/1220] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:58:01.667792 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13799eaa-5cd1-4c89-ba3c-78e2b990b6ce None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:01.668331 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13799eaa-5cd1-4c89-ba3c-78e2b990b6ce None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:01.668331 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13799eaa-5cd1-4c89-ba3c-78e2b990b6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:01.686613 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-13799eaa-5cd1-4c89-ba3c-78e2b990b6ce None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:58:01.687869 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-13799eaa-5cd1-4c89-ba3c-78e2b990b6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:58:01.773829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 621/1221] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:58:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:58:01.796467 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380255a-6069-4d95-aaf4-7a00fe441245 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:01.907453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380255a-6069-4d95-aaf4-7a00fe441245 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:01.960760 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fd34f-84bc-4fe9-b43c-6b329d9ce24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:01.962069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fd34f-84bc-4fe9-b43c-6b329d9ce24b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:01.962481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fd34f-84bc-4fe9-b43c-6b329d9ce24b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:01.963115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fd34f-84bc-4fe9-b43c-6b329d9ce24b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:01.976992 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fd34f-84bc-4fe9-b43c-6b329d9ce24b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:58:01.986120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-293fd34f-84bc-4fe9-b43c-6b329d9ce24b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:58:01.986120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:01.986120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:01.986120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:01.986120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:01.986120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:01.986120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:01.986120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:01.986120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:01.986120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:01.986120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:01.986120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:01.986120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:58:01.986120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:58:01.986120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:58:01.986120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:58:01.987393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:58:01.987393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:58:01.987393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:58:01.987393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:58:01.987393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:01.987393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:01.987393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:01.987393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:01.987393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:01.987393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:01.987393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:01.987393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:58:01.987393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:01.987393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:01.987393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:01.987393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:01.988558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:01.988558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:01.988558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:01.988558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:01.988558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:58:01.988558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:58:01.988558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:58:01.988558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:58:01.988558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:58:01.988558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:58:01.988558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:58:01.988558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:01.988558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 601/1222] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:58:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:01.993889 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13799eaa-5cd1-4c89-ba3c-78e2b990b6ce None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:02.128484 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13799eaa-5cd1-4c89-ba3c-78e2b990b6ce None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:02.160861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:02.176392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddc604-8958-48f2-bd14-87e63843d7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:02.177077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddc604-8958-48f2-bd14-87e63843d7de None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:02.177362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddc604-8958-48f2-bd14-87e63843d7de None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:02.177640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddc604-8958-48f2-bd14-87e63843d7de None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:02.178429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddc604-8958-48f2-bd14-87e63843d7de None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:02.178737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddc604-8958-48f2-bd14-87e63843d7de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:02.180538 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddc604-8958-48f2-bd14-87e63843d7de None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:02.193972 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 622/1223] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:58:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:58:02.202001 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fd34f-84bc-4fe9-b43c-6b329d9ce24b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:02.254424 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:02.320641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fd34f-84bc-4fe9-b43c-6b329d9ce24b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:02.363309 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57331025-38bb-4144-ad35-c3b78ab2b536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:02.364211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57331025-38bb-4144-ad35-c3b78ab2b536 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:02.364519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57331025-38bb-4144-ad35-c3b78ab2b536 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:02.364873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57331025-38bb-4144-ad35-c3b78ab2b536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:02.376836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57331025-38bb-4144-ad35-c3b78ab2b536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:02.378343 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57331025-38bb-4144-ad35-c3b78ab2b536 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:02.397390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-57331025-38bb-4144-ad35-c3b78ab2b536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:02.397390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:02.397390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:02.397390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:02.397390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:02.397390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:02.397390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:02.397390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:02.397390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:02.397390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:02.397390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:02.397390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:02.397390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:58:02.397390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:58:02.397390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:58:02.398540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:58:02.398540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:02.398540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:02.398540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:02.398540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:02.398540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:02.398540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:02.398540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:02.398540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:58:02.398540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:02.398540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:02.398540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:02.398540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:02.398540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:02.398540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:02.398540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:02.398540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:02.399469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:58:02.399469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:58:02.399469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:02.399469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:02.399469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 602/1224] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:58:02.405212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddc604-8958-48f2-bd14-87e63843d7de None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:02.520888 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddc604-8958-48f2-bd14-87e63843d7de None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:02.562810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b401622-ae3b-42f8-9ec0-f446797571e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:02.563577 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b401622-ae3b-42f8-9ec0-f446797571e3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:02.563865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b401622-ae3b-42f8-9ec0-f446797571e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:02.564251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b401622-ae3b-42f8-9ec0-f446797571e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:02.565104 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b401622-ae3b-42f8-9ec0-f446797571e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:02.565450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b401622-ae3b-42f8-9ec0-f446797571e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:02.567664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b401622-ae3b-42f8-9ec0-f446797571e3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:02.581069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 623/1225] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:02.587413 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57331025-38bb-4144-ad35-c3b78ab2b536 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:02.689277 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:02.697818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57331025-38bb-4144-ad35-c3b78ab2b536 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:02.733373 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f346cc-c9d9-41e5-9453-4073189ea80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:02.734224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f346cc-c9d9-41e5-9453-4073189ea80a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:02.734502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f346cc-c9d9-41e5-9453-4073189ea80a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:02.734773 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f346cc-c9d9-41e5-9453-4073189ea80a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:02.743442 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f346cc-c9d9-41e5-9453-4073189ea80a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:02.744904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f346cc-c9d9-41e5-9453-4073189ea80a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:02.763497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-48f346cc-c9d9-41e5-9453-4073189ea80a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 20:58:02.763497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:02.763497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:02.763497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:02.763497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:02.763497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:02.763497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:02.763497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:02.763497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:02.763497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:02.763497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:02.763497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:02.763497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:58:02.763497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:58:02.763497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:58:02.763497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:02.764542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:02.765728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:02.765728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:02.765728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:58:02.765728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:58:02.765728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:58:02.765728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:58:02.765728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:58:02.765728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:58:02.765728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 20:58:02.765728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:02.765728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 603/1226] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:58:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:02.771802 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b401622-ae3b-42f8-9ec0-f446797571e3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:02.822688 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:02.882484 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b401622-ae3b-42f8-9ec0-f446797571e3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:02.919810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1379872-eb7e-45ff-9b82-9b6a603e6794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:02.920572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1379872-eb7e-45ff-9b82-9b6a603e6794 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:02.920861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1379872-eb7e-45ff-9b82-9b6a603e6794 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:02.921176 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1379872-eb7e-45ff-9b82-9b6a603e6794 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:02.922179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1379872-eb7e-45ff-9b82-9b6a603e6794 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:02.922527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1379872-eb7e-45ff-9b82-9b6a603e6794 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:02.924079 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1379872-eb7e-45ff-9b82-9b6a603e6794 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:02.942977 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 624/1227] 10.222.0.61 () {56 vars in 1143 bytes} [Thu May 26 20:58:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:02.948750 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f346cc-c9d9-41e5-9453-4073189ea80a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:03.054540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f346cc-c9d9-41e5-9453-4073189ea80a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:03.090667 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c098c3b-9694-4c96-a4d2-edbba95bfc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:03.091567 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c098c3b-9694-4c96-a4d2-edbba95bfc7a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:03.091853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c098c3b-9694-4c96-a4d2-edbba95bfc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:03.092133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c098c3b-9694-4c96-a4d2-edbba95bfc7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:03.104412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c098c3b-9694-4c96-a4d2-edbba95bfc7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:03.105920 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c098c3b-9694-4c96-a4d2-edbba95bfc7a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:03.123655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-1c098c3b-9694-4c96-a4d2-edbba95bfc7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:03.123655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:03.123655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:03.123655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:03.123655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:03.123655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:03.123655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:03.123655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:03.123655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:03.123655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:03.123655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:03.123655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:03.123655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:58:03.123655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:58:03.123655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:58:03.124793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:58:03.124793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:03.124793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:03.124793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:03.124793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:03.124793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:03.124793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:03.124793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:03.124793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:58:03.124793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:03.124793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:03.124793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:03.124793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:03.124793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:03.124793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:03.124793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:03.124793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:03.125841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:58:03.125841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:58:03.125841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:03.125841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:03.125841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 604/1228] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:03.130772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1379872-eb7e-45ff-9b82-9b6a603e6794 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:03.232616 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1379872-eb7e-45ff-9b82-9b6a603e6794 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:03.235055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:03.279030 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879328a-e66b-4ff3-a86b-3d1e3e3c1533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:03.279890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879328a-e66b-4ff3-a86b-3d1e3e3c1533 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:03.280171 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879328a-e66b-4ff3-a86b-3d1e3e3c1533 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:03.280448 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879328a-e66b-4ff3-a86b-3d1e3e3c1533 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:03.281176 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879328a-e66b-4ff3-a86b-3d1e3e3c1533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:03.281479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879328a-e66b-4ff3-a86b-3d1e3e3c1533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:03.282962 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879328a-e66b-4ff3-a86b-3d1e3e3c1533 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:03.295359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 625/1229] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:03.301496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c098c3b-9694-4c96-a4d2-edbba95bfc7a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:03.314600 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:03.417413 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c098c3b-9694-4c96-a4d2-edbba95bfc7a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:03.453355 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b8dbd-1bef-484b-8505-b1c5a0d9f018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:03.454188 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8dbd-1bef-484b-8505-b1c5a0d9f018 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:03.454467 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8dbd-1bef-484b-8505-b1c5a0d9f018 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:03.454746 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8dbd-1bef-484b-8505-b1c5a0d9f018 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:03.462455 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b8dbd-1bef-484b-8505-b1c5a0d9f018 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:03.464280 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b8dbd-1bef-484b-8505-b1c5a0d9f018 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:03.480133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e60b8dbd-1bef-484b-8505-b1c5a0d9f018 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:58:03.480133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:03.480133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:03.480133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:03.480133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:03.480133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:03.480133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:03.480133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:03.480133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:03.480133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:03.480133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:03.480133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:03.480133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:58:03.480133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:58:03.480133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:58:03.481441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:58:03.481441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:03.481441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:03.481441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:03.481441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:03.481441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:03.481441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:03.481441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:03.481441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:58:03.481441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:03.481441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:03.481441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:03.481441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:03.481441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:03.481441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:03.481441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:03.481441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:03.482542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:58:03.482542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:58:03.482542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:58:03.482542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:58:03.482542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:58:03.482542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:58:03.482542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:58:03.482542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:03.482542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 605/1230] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:58:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:03.487735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879328a-e66b-4ff3-a86b-3d1e3e3c1533 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:03.607100 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879328a-e66b-4ff3-a86b-3d1e3e3c1533 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:03.642326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029151a1-2d75-492e-8cd6-42bcdb9f055d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:03.643030 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029151a1-2d75-492e-8cd6-42bcdb9f055d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:03.643348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029151a1-2d75-492e-8cd6-42bcdb9f055d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:03.643621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029151a1-2d75-492e-8cd6-42bcdb9f055d None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:03.644549 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029151a1-2d75-492e-8cd6-42bcdb9f055d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:03.644904 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029151a1-2d75-492e-8cd6-42bcdb9f055d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:03.646424 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029151a1-2d75-492e-8cd6-42bcdb9f055d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:03.659472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 626/1231] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:58:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:03.665643 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b8dbd-1bef-484b-8505-b1c5a0d9f018 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:03.736657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:03.773655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b8dbd-1bef-484b-8505-b1c5a0d9f018 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:03.811768 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9ddb9-e34b-4075-9ea5-46fa6b16571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:03.812756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9ddb9-e34b-4075-9ea5-46fa6b16571a None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:03.813100 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9ddb9-e34b-4075-9ea5-46fa6b16571a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:03.813880 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9ddb9-e34b-4075-9ea5-46fa6b16571a None admin] PATH_INFO: `/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/e8952f35c21c4a2eaf1fbc601fe76242/roles/6046421464dd48ea8977d7d1481bde10` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:03.831654 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9ddb9-e34b-4075-9ea5-46fa6b16571a None admin] RBAC: Authorizing `identity:create_grant(project_id=2c23678abd4f4dacaf35d73c5184e72e, user_id=e8952f35c21c4a2eaf1fbc601fe76242, role_id=6046421464dd48ea8977d7d1481bde10)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:03.833721 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9ddb9-e34b-4075-9ea5-46fa6b16571a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:03.847169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 606/1232] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:58:03 2022] PUT /identity/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/e8952f35c21c4a2eaf1fbc601fe76242/roles/6046421464dd48ea8977d7d1481bde10 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:58:06.074560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc4a9d-f226-4925-8f3e-c730eb17912e None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:06.075815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc4a9d-f226-4925-8f3e-c730eb17912e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:06.075815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc4a9d-f226-4925-8f3e-c730eb17912e None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:06.076734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 627/1233] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:58:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:58:06.083194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a129c-9861-461f-9ec2-ae21595c514d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:06.083624 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a129c-9861-461f-9ec2-ae21595c514d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:06.083785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a129c-9861-461f-9ec2-ae21595c514d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:06.106481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9a5a129c-9861-461f-9ec2-ae21595c514d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:58:06.108378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9a5a129c-9861-461f-9ec2-ae21595c514d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:58:06.194111 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 607/1234] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:58:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:58:06.220627 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc4a9d-f226-4925-8f3e-c730eb17912e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:06.248912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:06.333820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc4a9d-f226-4925-8f3e-c730eb17912e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:06.372546 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f0d74-ad0f-4114-b49d-30cb08661bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:06.373398 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f0d74-ad0f-4114-b49d-30cb08661bcc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:06.373682 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f0d74-ad0f-4114-b49d-30cb08661bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:06.373992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f0d74-ad0f-4114-b49d-30cb08661bcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:06.384923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f0d74-ad0f-4114-b49d-30cb08661bcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:58:06.393188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-f82f0d74-ad0f-4114-b49d-30cb08661bcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:58:06.393188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:06.393188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:06.393188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:06.393188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:06.393188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:06.393188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:06.393188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:06.393188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:06.393188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:06.393188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:06.393188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:06.393188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:58:06.393188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:58:06.393188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:58:06.393188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:58:06.394487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:58:06.394487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:58:06.394487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:58:06.394487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:58:06.394487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:06.394487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:06.394487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:06.394487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:06.394487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:06.394487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:06.394487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:06.394487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:58:06.394487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:06.394487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:06.394487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:06.394487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:06.395345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:06.395345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:06.395345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:06.395345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:06.395345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:58:06.395345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:58:06.395345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:58:06.395345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:58:06.395345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:58:06.395345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:58:06.395345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:58:06.395345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:58:06.395345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 628/1235] 10.222.0.61 () {56 vars in 1102 bytes} [Thu May 26 20:58:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:06.401259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a129c-9861-461f-9ec2-ae21595c514d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:06.451315 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:06.527083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a129c-9861-461f-9ec2-ae21595c514d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:06.565654 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda47d6e-2f95-4d0c-8d3e-9ffa1a38e302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:06.566478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda47d6e-2f95-4d0c-8d3e-9ffa1a38e302 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:06.566796 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda47d6e-2f95-4d0c-8d3e-9ffa1a38e302 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:06.567090 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda47d6e-2f95-4d0c-8d3e-9ffa1a38e302 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:06.567940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda47d6e-2f95-4d0c-8d3e-9ffa1a38e302 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:06.568271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda47d6e-2f95-4d0c-8d3e-9ffa1a38e302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:06.569937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda47d6e-2f95-4d0c-8d3e-9ffa1a38e302 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:06.580764 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 608/1236] 10.222.0.61 () {56 vars in 1103 bytes} [Thu May 26 20:58:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:06.587085 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f0d74-ad0f-4114-b49d-30cb08661bcc None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:06.680076 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:06.698988 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f0d74-ad0f-4114-b49d-30cb08661bcc None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:06.736004 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880634b3-0400-4508-bcdf-c02c5469bfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:06.736820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880634b3-0400-4508-bcdf-c02c5469bfb8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:06.737105 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880634b3-0400-4508-bcdf-c02c5469bfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:06.737390 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880634b3-0400-4508-bcdf-c02c5469bfb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:06.749396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880634b3-0400-4508-bcdf-c02c5469bfb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:06.750934 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880634b3-0400-4508-bcdf-c02c5469bfb8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:06.768810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-880634b3-0400-4508-bcdf-c02c5469bfb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:06.768810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:06.768810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:06.768810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:06.768810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:06.768810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:06.768810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:06.768810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:06.768810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:06.768810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:06.768810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:06.768810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:06.768810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:58:06.768810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:58:06.768810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:58:06.769739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:58:06.769739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:06.769739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:06.769739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:06.769739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:06.769739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:06.769739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:06.769739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:06.769739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:58:06.769739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:06.769739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:06.769739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:06.769739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:06.769739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:06.769739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:06.769739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:06.769739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:06.770876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:58:06.770876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:58:06.770876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:06.770876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:58:06.770876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 629/1237] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:06.776508 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda47d6e-2f95-4d0c-8d3e-9ffa1a38e302 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:06.888255 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda47d6e-2f95-4d0c-8d3e-9ffa1a38e302 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:06.898294 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:06.926499 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224aa04-0459-42c3-8edd-b8f590c63ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:06.927192 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224aa04-0459-42c3-8edd-b8f590c63ddd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:06.927459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224aa04-0459-42c3-8edd-b8f590c63ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:06.927759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224aa04-0459-42c3-8edd-b8f590c63ddd None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:06.928458 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224aa04-0459-42c3-8edd-b8f590c63ddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:06.928768 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224aa04-0459-42c3-8edd-b8f590c63ddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:06.930179 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224aa04-0459-42c3-8edd-b8f590c63ddd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:06.942816 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 609/1238] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:06.948985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880634b3-0400-4508-bcdf-c02c5469bfb8 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:07.062459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880634b3-0400-4508-bcdf-c02c5469bfb8 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:07.100891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f7c32-d334-4b99-89bc-0d41f558185b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:07.101728 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f7c32-d334-4b99-89bc-0d41f558185b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:07.102040 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f7c32-d334-4b99-89bc-0d41f558185b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:07.102314 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f7c32-d334-4b99-89bc-0d41f558185b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:07.105079 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:07.111279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f7c32-d334-4b99-89bc-0d41f558185b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:07.112966 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f7c32-d334-4b99-89bc-0d41f558185b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:07.129217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-045f7c32-d334-4b99-89bc-0d41f558185b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 20:58:07.129217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:07.129217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:07.129217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:07.129217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:07.129217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:07.129217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:07.129217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:07.129217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:07.129217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:07.129217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:07.129217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:07.129217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:58:07.129217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:58:07.129217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:58:07.129217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:07.130308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:07.131415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:07.131415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:07.131415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:58:07.131415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:58:07.131415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:58:07.131415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:58:07.131415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:58:07.131415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:58:07.131415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 20:58:07.131415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:58:07.131415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 630/1239] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:58:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:07.136806 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224aa04-0459-42c3-8edd-b8f590c63ddd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:07.250066 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224aa04-0459-42c3-8edd-b8f590c63ddd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:07.286138 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed956082-bdb8-4f8f-aa11-191cfe60d1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:07.286827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed956082-bdb8-4f8f-aa11-191cfe60d1cc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:07.287117 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed956082-bdb8-4f8f-aa11-191cfe60d1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:07.287394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed956082-bdb8-4f8f-aa11-191cfe60d1cc None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:07.288234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed956082-bdb8-4f8f-aa11-191cfe60d1cc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:07.288547 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed956082-bdb8-4f8f-aa11-191cfe60d1cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:07.290013 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed956082-bdb8-4f8f-aa11-191cfe60d1cc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:07.311794 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 610/1240] 10.222.0.61 () {56 vars in 1143 bytes} [Thu May 26 20:58:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:58:07.319732 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f7c32-d334-4b99-89bc-0d41f558185b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:07.434086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f7c32-d334-4b99-89bc-0d41f558185b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:07.477393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f034ec-6a95-438c-9e28-9b03965194eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:07.478088 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f034ec-6a95-438c-9e28-9b03965194eb None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:07.478402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f034ec-6a95-438c-9e28-9b03965194eb None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:07.478682 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f034ec-6a95-438c-9e28-9b03965194eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:07.548999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:07.556903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f034ec-6a95-438c-9e28-9b03965194eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:07.558809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f034ec-6a95-438c-9e28-9b03965194eb None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:07.678439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 631/1241] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:58:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:58:07.679741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed956082-bdb8-4f8f-aa11-191cfe60d1cc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:07.710832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:07.788588 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed956082-bdb8-4f8f-aa11-191cfe60d1cc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:07.824744 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42c63e-f0bf-4b91-ab28-84ee88c0620d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:07.825517 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42c63e-f0bf-4b91-ab28-84ee88c0620d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:07.825836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42c63e-f0bf-4b91-ab28-84ee88c0620d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:07.826108 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42c63e-f0bf-4b91-ab28-84ee88c0620d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:07.837157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42c63e-f0bf-4b91-ab28-84ee88c0620d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:07.838642 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42c63e-f0bf-4b91-ab28-84ee88c0620d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:07.856542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-2f42c63e-f0bf-4b91-ab28-84ee88c0620d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:07.856542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:07.856542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:07.856542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:07.856542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:07.856542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:07.856542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:07.856542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:07.856542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:07.856542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:07.856542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:07.856542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:07.856542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:58:07.856542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:58:07.856542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:58:07.857754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:58:07.857754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:07.857754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:07.857754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:07.857754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:07.857754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:07.857754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:07.857754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:07.857754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:58:07.857754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:07.857754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:07.857754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:07.857754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:07.857754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:07.857754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:07.857754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:07.857754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:07.859266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:58:07.859266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:58:07.859266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:07.859266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:07.859266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 611/1242] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:07.864623 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f034ec-6a95-438c-9e28-9b03965194eb None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:07.971241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:07.978677 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f034ec-6a95-438c-9e28-9b03965194eb None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:08.018053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6bd1e-f454-4463-9167-a4207a17d84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:08.018781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6bd1e-f454-4463-9167-a4207a17d84c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:08.019019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6bd1e-f454-4463-9167-a4207a17d84c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:08.019333 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6bd1e-f454-4463-9167-a4207a17d84c None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:08.020160 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6bd1e-f454-4463-9167-a4207a17d84c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:08.020468 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6bd1e-f454-4463-9167-a4207a17d84c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:08.022058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6bd1e-f454-4463-9167-a4207a17d84c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:08.035534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 632/1243] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:08.045050 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42c63e-f0bf-4b91-ab28-84ee88c0620d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:08.133929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:08.156384 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42c63e-f0bf-4b91-ab28-84ee88c0620d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:08.196490 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1c3b8-ee81-4d2a-af3b-135b5702856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:08.197440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1c3b8-ee81-4d2a-af3b-135b5702856e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:08.197780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1c3b8-ee81-4d2a-af3b-135b5702856e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:08.198166 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1c3b8-ee81-4d2a-af3b-135b5702856e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:08.206065 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1c3b8-ee81-4d2a-af3b-135b5702856e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:08.208095 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1c3b8-ee81-4d2a-af3b-135b5702856e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:08.222834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-52f1c3b8-ee81-4d2a-af3b-135b5702856e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:58:08.222834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:08.222834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:08.222834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:08.222834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:08.222834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:08.222834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:08.222834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:08.222834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:08.222834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:08.222834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:08.222834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:08.222834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:58:08.222834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:58:08.222834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:58:08.224029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:58:08.224029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:08.224029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:08.224029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:08.224029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:08.224029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:08.224029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:08.224029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:08.224029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:58:08.224029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:08.224029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:08.224029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:08.224029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:08.224029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:08.224029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:08.224029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:08.224029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:08.224973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:58:08.224973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:58:08.224973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:58:08.224973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:58:08.224973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:58:08.224973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:58:08.224973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:58:08.224973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:08.224973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 612/1244] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:58:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:08.230242 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6bd1e-f454-4463-9167-a4207a17d84c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:08.341266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6bd1e-f454-4463-9167-a4207a17d84c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:08.384565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b59e5-6daf-43f8-96a2-eece94ddc4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:08.385240 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b59e5-6daf-43f8-96a2-eece94ddc4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:08.385579 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b59e5-6daf-43f8-96a2-eece94ddc4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:08.385914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b59e5-6daf-43f8-96a2-eece94ddc4b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:08.386880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b59e5-6daf-43f8-96a2-eece94ddc4b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:08.387162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b59e5-6daf-43f8-96a2-eece94ddc4b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:08.388741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b59e5-6daf-43f8-96a2-eece94ddc4b4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:08.402718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 633/1245] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:58:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:08.409487 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1c3b8-ee81-4d2a-af3b-135b5702856e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:08.533608 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1c3b8-ee81-4d2a-af3b-135b5702856e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:08.575313 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370e066-6b6a-45cd-9e72-b0c020c5b884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:08.575971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370e066-6b6a-45cd-9e72-b0c020c5b884 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:08.576254 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370e066-6b6a-45cd-9e72-b0c020c5b884 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:08.576529 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370e066-6b6a-45cd-9e72-b0c020c5b884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:08.577370 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370e066-6b6a-45cd-9e72-b0c020c5b884 None admin] RBAC: Adding query filter params (role.id=6046421464dd48ea8977d7d1481bde10, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=e8952f35c21c4a2eaf1fbc601fe76242) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:08.577765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370e066-6b6a-45cd-9e72-b0c020c5b884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:08.579707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370e066-6b6a-45cd-9e72-b0c020c5b884 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:08.588109 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 613/1246] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:58:08 2022] GET /identity/v3/role_assignments?user.id=e8952f35c21c4a2eaf1fbc601fe76242&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=6046421464dd48ea8977d7d1481bde10 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:11.012335 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ad793-712e-4d45-8c03-9aa239e133d3 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:11.012865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ad793-712e-4d45-8c03-9aa239e133d3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:11.012865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ad793-712e-4d45-8c03-9aa239e133d3 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:11.014383 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 634/1247] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:58:11.020848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa76a37-de04-429c-8f8c-7699dd416254 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:11.021467 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa76a37-de04-429c-8f8c-7699dd416254 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:11.021467 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa76a37-de04-429c-8f8c-7699dd416254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:11.027086 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:11.041539 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3fa76a37-de04-429c-8f8c-7699dd416254 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:58:11.042928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3fa76a37-de04-429c-8f8c-7699dd416254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:58:11.119420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 614/1248] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:58:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:58:11.146316 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ad793-712e-4d45-8c03-9aa239e133d3 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:11.168193 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:11.260561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ad793-712e-4d45-8c03-9aa239e133d3 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:11.298583 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360b359-1409-4a05-aca6-b18767d02ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:11.299298 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360b359-1409-4a05-aca6-b18767d02ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:11.299585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360b359-1409-4a05-aca6-b18767d02ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:11.299864 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360b359-1409-4a05-aca6-b18767d02ec9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:11.313231 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360b359-1409-4a05-aca6-b18767d02ec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:58:11.321871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-1360b359-1409-4a05-aca6-b18767d02ec9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:58:11.321871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:11.321871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:11.321871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:11.321871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:11.321871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:11.321871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:11.321871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:11.321871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:11.321871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:11.321871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:11.321871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:11.321871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:58:11.321871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:58:11.321871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:58:11.321871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:58:11.323204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:58:11.323204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:58:11.323204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:58:11.323204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:58:11.323204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:11.323204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:11.323204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:11.323204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:11.323204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:11.323204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:11.323204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:11.323204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:58:11.323204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:11.323204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:11.323204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:11.323204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:11.324269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:11.324269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:11.324269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:11.324269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:11.324269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:58:11.324269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:58:11.324269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:58:11.324269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:58:11.324269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:58:11.324269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:58:11.324269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:58:11.324269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:58:11.325973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 635/1249] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:58:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:11.335676 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa76a37-de04-429c-8f8c-7699dd416254 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:11.454194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa76a37-de04-429c-8f8c-7699dd416254 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:11.489208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:11.495789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006cae4-852b-4808-adec-d44758ce95eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:11.496592 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006cae4-852b-4808-adec-d44758ce95eb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:11.496870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006cae4-852b-4808-adec-d44758ce95eb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:11.497145 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006cae4-852b-4808-adec-d44758ce95eb None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:11.497973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006cae4-852b-4808-adec-d44758ce95eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:11.498288 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006cae4-852b-4808-adec-d44758ce95eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:11.499665 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006cae4-852b-4808-adec-d44758ce95eb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:11.508901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 615/1250] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:58:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:11.514945 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360b359-1409-4a05-aca6-b18767d02ec9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:11.611267 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:11.653142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360b359-1409-4a05-aca6-b18767d02ec9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:11.699610 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943583f-3b38-40fe-8606-bb337a5dd1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:11.700519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943583f-3b38-40fe-8606-bb337a5dd1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:11.700787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943583f-3b38-40fe-8606-bb337a5dd1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:11.701061 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943583f-3b38-40fe-8606-bb337a5dd1d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:11.715017 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943583f-3b38-40fe-8606-bb337a5dd1d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:11.716954 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943583f-3b38-40fe-8606-bb337a5dd1d2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:11.739638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-7943583f-3b38-40fe-8606-bb337a5dd1d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:11.739638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:11.739638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:11.739638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:11.739638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:11.739638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:11.739638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:11.739638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:11.739638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:11.739638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:11.739638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:11.739638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:11.739638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:58:11.739638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:58:11.739638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:58:11.740772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:58:11.740772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:11.740772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:11.740772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:11.740772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:11.740772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:11.740772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:11.740772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:11.740772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:58:11.740772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:11.740772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:11.740772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:11.740772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:11.740772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:11.740772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:11.740772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:11.740772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:11.742089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:58:11.742089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:58:11.742089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:11.742089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:58:11.742089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 636/1251] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:58:11.747779 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006cae4-852b-4808-adec-d44758ce95eb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:11.867020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006cae4-852b-4808-adec-d44758ce95eb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:11.908771 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e146d-5e40-4c14-bf00-dcf2e410ac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:11.909554 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e146d-5e40-4c14-bf00-dcf2e410ac92 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:11.909919 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e146d-5e40-4c14-bf00-dcf2e410ac92 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:11.910209 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e146d-5e40-4c14-bf00-dcf2e410ac92 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:11.911035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e146d-5e40-4c14-bf00-dcf2e410ac92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:11.911408 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e146d-5e40-4c14-bf00-dcf2e410ac92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:11.913081 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e146d-5e40-4c14-bf00-dcf2e410ac92 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:11.927566 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 616/1252] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:58:11.933399 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943583f-3b38-40fe-8606-bb337a5dd1d2 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:12.063170 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943583f-3b38-40fe-8606-bb337a5dd1d2 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:12.092402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:12.101612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26996358-4306-4022-82d5-8b8105882247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:12.102574 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26996358-4306-4022-82d5-8b8105882247 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:12.102869 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26996358-4306-4022-82d5-8b8105882247 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:12.103195 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26996358-4306-4022-82d5-8b8105882247 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:12.112040 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26996358-4306-4022-82d5-8b8105882247 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:12.113530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26996358-4306-4022-82d5-8b8105882247 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:12.128334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-26996358-4306-4022-82d5-8b8105882247 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 20:58:12.128334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:12.128334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:12.128334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:12.128334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:12.128334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:12.128334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:12.128334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:12.128334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:12.128334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:12.128334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:12.128334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:12.128334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:58:12.128334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:58:12.128334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:58:12.128334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:12.129342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:12.130368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:12.130368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:12.130368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:58:12.130368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:58:12.130368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:58:12.130368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:58:12.130368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:58:12.130368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:58:12.130368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 20:58:12.130368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:58:12.130368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 637/1253] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:58:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:12.135835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e146d-5e40-4c14-bf00-dcf2e410ac92 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:12.195110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:12.244637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e146d-5e40-4c14-bf00-dcf2e410ac92 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:12.281420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db82ab-bff3-40ac-8fbe-1701acbfdcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:12.282205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db82ab-bff3-40ac-8fbe-1701acbfdcfc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:12.282489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db82ab-bff3-40ac-8fbe-1701acbfdcfc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:12.282805 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db82ab-bff3-40ac-8fbe-1701acbfdcfc None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:12.283728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db82ab-bff3-40ac-8fbe-1701acbfdcfc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:12.284076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db82ab-bff3-40ac-8fbe-1701acbfdcfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:12.285520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db82ab-bff3-40ac-8fbe-1701acbfdcfc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:12.306273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 617/1254] 10.222.0.61 () {56 vars in 1143 bytes} [Thu May 26 20:58:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:12.311652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26996358-4306-4022-82d5-8b8105882247 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:12.433547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26996358-4306-4022-82d5-8b8105882247 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:12.473329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c66fca-ccd2-43ff-ab3f-4b688becead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:12.474107 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c66fca-ccd2-43ff-ab3f-4b688becead3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:12.474514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c66fca-ccd2-43ff-ab3f-4b688becead3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:12.474824 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c66fca-ccd2-43ff-ab3f-4b688becead3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:12.533393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:12.549287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c66fca-ccd2-43ff-ab3f-4b688becead3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:12.550914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c66fca-ccd2-43ff-ab3f-4b688becead3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:12.663327 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 638/1255] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:58:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:58:12.670759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db82ab-bff3-40ac-8fbe-1701acbfdcfc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:12.783888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db82ab-bff3-40ac-8fbe-1701acbfdcfc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:12.798030 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:12.822795 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574927d-d458-4bb7-966b-cdec30b1ca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:12.823556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574927d-d458-4bb7-966b-cdec30b1ca19 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:12.823887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574927d-d458-4bb7-966b-cdec30b1ca19 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:12.824159 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574927d-d458-4bb7-966b-cdec30b1ca19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:12.837376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574927d-d458-4bb7-966b-cdec30b1ca19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:12.839041 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574927d-d458-4bb7-966b-cdec30b1ca19 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:12.858850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-5574927d-d458-4bb7-966b-cdec30b1ca19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:12.858850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:12.858850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:12.858850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:12.858850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:12.858850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:12.858850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:12.858850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:12.858850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:12.858850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:12.858850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:12.858850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:12.858850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:58:12.858850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:58:12.858850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:58:12.860146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:58:12.860146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:12.860146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:12.860146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:12.860146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:12.860146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:12.860146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:12.860146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:12.860146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:58:12.860146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:12.860146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:12.860146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:12.860146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:12.860146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:12.860146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:12.860146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:12.860146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:12.866751 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:58:12.866751 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:58:12.866751 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:12.866751 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:12.866751 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 618/1256] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:12.867048 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c66fca-ccd2-43ff-ab3f-4b688becead3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:12.963401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:12.977856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c66fca-ccd2-43ff-ab3f-4b688becead3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:13.019900 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c03dc8-2a4c-420c-af68-45b7adc2e27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:13.020495 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03dc8-2a4c-420c-af68-45b7adc2e27a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:13.020779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03dc8-2a4c-420c-af68-45b7adc2e27a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:13.021054 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c03dc8-2a4c-420c-af68-45b7adc2e27a None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:13.021781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c03dc8-2a4c-420c-af68-45b7adc2e27a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:13.022117 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c03dc8-2a4c-420c-af68-45b7adc2e27a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:13.023514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c03dc8-2a4c-420c-af68-45b7adc2e27a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:13.035827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 639/1257] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:13.042257 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574927d-d458-4bb7-966b-cdec30b1ca19 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:13.159448 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574927d-d458-4bb7-966b-cdec30b1ca19 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:13.207329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb097b60-8c96-4363-ab1a-712ca33df8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:13.208187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb097b60-8c96-4363-ab1a-712ca33df8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:13.208469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb097b60-8c96-4363-ab1a-712ca33df8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:13.208741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb097b60-8c96-4363-ab1a-712ca33df8a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:13.216444 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb097b60-8c96-4363-ab1a-712ca33df8a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:13.217958 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb097b60-8c96-4363-ab1a-712ca33df8a7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:13.232020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-fb097b60-8c96-4363-ab1a-712ca33df8a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:58:13.232020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:13.232020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:13.232020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:13.232020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:13.232020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:13.232020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:13.232020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:13.232020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:13.232020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:13.232020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:13.232020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:13.232020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:58:13.232020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:58:13.232020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:58:13.233044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:58:13.233044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:13.233044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:13.233044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:13.233044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:13.233044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:13.233044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:13.233044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:13.233044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:58:13.233044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:13.233044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:13.233044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:13.233044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:13.233044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:13.233044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:13.233044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:13.233044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:13.233951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:58:13.233951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:58:13.233951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:58:13.233951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:58:13.233951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:58:13.233951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:58:13.233951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:58:13.233951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:13.233951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 619/1258] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:58:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:13.239439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c03dc8-2a4c-420c-af68-45b7adc2e27a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:13.354804 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c03dc8-2a4c-420c-af68-45b7adc2e27a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:13.394276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af511f1-f004-4d8b-b284-3205f6eae3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:13.395050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af511f1-f004-4d8b-b284-3205f6eae3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:13.395329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af511f1-f004-4d8b-b284-3205f6eae3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:13.395608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af511f1-f004-4d8b-b284-3205f6eae3d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:13.396394 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af511f1-f004-4d8b-b284-3205f6eae3d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:13.396713 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af511f1-f004-4d8b-b284-3205f6eae3d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:13.398383 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af511f1-f004-4d8b-b284-3205f6eae3d0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:13.413871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 640/1259] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:58:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:13.420349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb097b60-8c96-4363-ab1a-712ca33df8a7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:13.450122 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:13.531277 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb097b60-8c96-4363-ab1a-712ca33df8a7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:13.569821 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414df12-3ae3-491d-bf96-34083993b776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:13.570489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414df12-3ae3-491d-bf96-34083993b776 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:13.570780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414df12-3ae3-491d-bf96-34083993b776 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:13.571121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414df12-3ae3-491d-bf96-34083993b776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:13.572093 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414df12-3ae3-491d-bf96-34083993b776 None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=e8952f35c21c4a2eaf1fbc601fe76242) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:13.572405 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414df12-3ae3-491d-bf96-34083993b776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:13.573881 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414df12-3ae3-491d-bf96-34083993b776 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:13.580322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 620/1260] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:58:13 2022] GET /identity/v3/role_assignments?user.id=e8952f35c21c4a2eaf1fbc601fe76242&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=aefba81d87bf47258c17064af7d9a05f => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:15.752855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da561090-94d9-44dc-9929-f9daaa2a3f79 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:15.753707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da561090-94d9-44dc-9929-f9daaa2a3f79 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:15.753707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da561090-94d9-44dc-9929-f9daaa2a3f79 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:15.755907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 641/1261] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:58:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:58:15.761319 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f851888-fec2-48ee-8d8f-6ec2c89a4ef7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:15.761773 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f851888-fec2-48ee-8d8f-6ec2c89a4ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:15.761981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f851888-fec2-48ee-8d8f-6ec2c89a4ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:15.780476 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1f851888-fec2-48ee-8d8f-6ec2c89a4ef7 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:58:15.781672 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1f851888-fec2-48ee-8d8f-6ec2c89a4ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:58:15.852393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 621/1262] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:58:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:58:15.889788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da561090-94d9-44dc-9929-f9daaa2a3f79 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:15.905991 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:16.007243 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da561090-94d9-44dc-9929-f9daaa2a3f79 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:16.043017 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93686a59-cfa0-4a89-be49-b47830bc2c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:16.044158 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686a59-cfa0-4a89-be49-b47830bc2c72 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:16.044439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686a59-cfa0-4a89-be49-b47830bc2c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:16.044711 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686a59-cfa0-4a89-be49-b47830bc2c72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:16.055913 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93686a59-cfa0-4a89-be49-b47830bc2c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:58:16.063944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-93686a59-cfa0-4a89-be49-b47830bc2c72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:58:16.063944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:16.063944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:16.063944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:16.063944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:16.063944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:16.063944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:16.063944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:16.063944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:16.063944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:16.063944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:16.063944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:16.063944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:58:16.063944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:58:16.063944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:58:16.063944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:58:16.065062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:58:16.065062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:58:16.065062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:58:16.065062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:58:16.065062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:16.065062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:16.065062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:16.065062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:16.065062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:16.065062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:16.065062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:16.065062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:58:16.065062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:16.065062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:16.065062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:16.065062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:16.066569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:16.066569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:16.066569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:16.066569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:16.066569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:58:16.066569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:58:16.066569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:58:16.066569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:58:16.066569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:58:16.066569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:58:16.066569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:58:16.066569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:58:16.066569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 642/1263] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:58:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:16.074759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f851888-fec2-48ee-8d8f-6ec2c89a4ef7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:16.101671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:16.193415 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f851888-fec2-48ee-8d8f-6ec2c89a4ef7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:16.231963 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb55db-f23c-4482-8bc0-f4a3fd6ac095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:16.232632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb55db-f23c-4482-8bc0-f4a3fd6ac095 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:16.232920 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb55db-f23c-4482-8bc0-f4a3fd6ac095 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:16.233193 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb55db-f23c-4482-8bc0-f4a3fd6ac095 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:16.233973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb55db-f23c-4482-8bc0-f4a3fd6ac095 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:16.234287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb55db-f23c-4482-8bc0-f4a3fd6ac095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:16.235674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb55db-f23c-4482-8bc0-f4a3fd6ac095 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:16.243955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 622/1264] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:58:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:16.251044 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93686a59-cfa0-4a89-be49-b47830bc2c72 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:16.345250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:16.381584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93686a59-cfa0-4a89-be49-b47830bc2c72 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:16.416826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bedbb-bc65-4c3d-a443-932cebe40115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:16.417616 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bedbb-bc65-4c3d-a443-932cebe40115 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:16.417930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bedbb-bc65-4c3d-a443-932cebe40115 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:16.418346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bedbb-bc65-4c3d-a443-932cebe40115 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:16.429249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bedbb-bc65-4c3d-a443-932cebe40115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:16.430864 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bedbb-bc65-4c3d-a443-932cebe40115 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:16.448009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-807bedbb-bc65-4c3d-a443-932cebe40115 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:16.448009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:16.448009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:16.448009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:16.448009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:16.448009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:16.448009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:16.448009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:16.448009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:16.448009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:16.448009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:16.448009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:16.448009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:58:16.448009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:58:16.448009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:58:16.449020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:58:16.449020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:16.449020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:16.449020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:16.449020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:16.449020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:16.449020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:16.449020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:16.449020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:58:16.449020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:16.449020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:16.449020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:16.449020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:16.449020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:16.449020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:16.449020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:16.449020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:16.450573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:58:16.450573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:58:16.450573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:16.450573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:58:16.450573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 643/1265] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:16.458663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb55db-f23c-4482-8bc0-f4a3fd6ac095 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:16.551230 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:16.573115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb55db-f23c-4482-8bc0-f4a3fd6ac095 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:16.612052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99151d9b-9f6d-4929-8c40-cb7fab4957be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:16.612687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151d9b-9f6d-4929-8c40-cb7fab4957be None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:16.613152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151d9b-9f6d-4929-8c40-cb7fab4957be None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:16.613394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151d9b-9f6d-4929-8c40-cb7fab4957be None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:16.614341 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99151d9b-9f6d-4929-8c40-cb7fab4957be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:16.614960 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99151d9b-9f6d-4929-8c40-cb7fab4957be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:16.616478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99151d9b-9f6d-4929-8c40-cb7fab4957be None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:16.631487 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 623/1266] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:16.638681 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bedbb-bc65-4c3d-a443-932cebe40115 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:16.743806 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bedbb-bc65-4c3d-a443-932cebe40115 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:16.764430 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:16.780712 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2423d8-0f61-42b6-b53e-34156ca85ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:16.781525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2423d8-0f61-42b6-b53e-34156ca85ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:16.781831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2423d8-0f61-42b6-b53e-34156ca85ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:16.782114 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2423d8-0f61-42b6-b53e-34156ca85ee4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:16.789927 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2423d8-0f61-42b6-b53e-34156ca85ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:16.791401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2423d8-0f61-42b6-b53e-34156ca85ee4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:16.805551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-9e2423d8-0f61-42b6-b53e-34156ca85ee4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 20:58:16.805551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:16.805551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:16.805551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:16.805551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:16.805551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:16.805551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:16.805551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:16.805551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:16.805551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:16.805551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:16.805551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:16.805551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:58:16.805551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:58:16.805551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:58:16.805551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:16.806669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:16.812836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:16.812836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:16.812836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:58:16.812836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:58:16.812836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:58:16.812836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:58:16.812836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:58:16.812836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:58:16.812836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 20:58:16.812836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:58:16.812836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 644/1267] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:58:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:16.813594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99151d9b-9f6d-4929-8c40-cb7fab4957be None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:16.935862 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99151d9b-9f6d-4929-8c40-cb7fab4957be None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:16.974516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22295f-f49a-499a-aff1-f32383415fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:16.975185 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22295f-f49a-499a-aff1-f32383415fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:16.975463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22295f-f49a-499a-aff1-f32383415fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:16.975740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22295f-f49a-499a-aff1-f32383415fa7 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:16.976556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22295f-f49a-499a-aff1-f32383415fa7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:16.976859 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22295f-f49a-499a-aff1-f32383415fa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:16.978332 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22295f-f49a-499a-aff1-f32383415fa7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:16.987267 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:17.000208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 624/1268] 10.222.0.61 () {56 vars in 1143 bytes} [Thu May 26 20:58:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:58:17.006190 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2423d8-0f61-42b6-b53e-34156ca85ee4 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:17.107884 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2423d8-0f61-42b6-b53e-34156ca85ee4 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:17.142784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513309da-4938-46ef-ae12-893ae2576193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:17.143583 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513309da-4938-46ef-ae12-893ae2576193 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:17.143862 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513309da-4938-46ef-ae12-893ae2576193 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:17.144201 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513309da-4938-46ef-ae12-893ae2576193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:17.157253 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513309da-4938-46ef-ae12-893ae2576193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:17.158771 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513309da-4938-46ef-ae12-893ae2576193 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:17.177445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-513309da-4938-46ef-ae12-893ae2576193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:17.177445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:17.177445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:17.177445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:17.177445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:17.177445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:17.177445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:17.177445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:17.177445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:17.177445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:17.177445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:17.177445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:17.177445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:58:17.177445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:58:17.177445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:58:17.178563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:58:17.178563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:17.178563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:17.178563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:17.178563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:17.178563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:17.178563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:17.178563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:17.178563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:58:17.178563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:17.178563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:17.178563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:17.178563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:17.178563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:17.178563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:17.178563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:17.178563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:17.179592 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:58:17.179592 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:58:17.179592 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:17.179592 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:58:17.179592 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 645/1269] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:17.185091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22295f-f49a-499a-aff1-f32383415fa7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:17.296862 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22295f-f49a-499a-aff1-f32383415fa7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:17.333154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f567314-6145-4813-b038-70ba9c0f7815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:17.333843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f567314-6145-4813-b038-70ba9c0f7815 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:17.334132 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f567314-6145-4813-b038-70ba9c0f7815 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:17.334404 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f567314-6145-4813-b038-70ba9c0f7815 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:17.335187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f567314-6145-4813-b038-70ba9c0f7815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:17.335544 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f567314-6145-4813-b038-70ba9c0f7815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:17.336927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f567314-6145-4813-b038-70ba9c0f7815 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:17.348700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 625/1270] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:17.355031 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513309da-4938-46ef-ae12-893ae2576193 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:17.387821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:17.466064 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513309da-4938-46ef-ae12-893ae2576193 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:17.502126 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada06ddc-0924-4488-8a88-4a3150786a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:17.502968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada06ddc-0924-4488-8a88-4a3150786a38 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:17.503234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada06ddc-0924-4488-8a88-4a3150786a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:17.503515 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada06ddc-0924-4488-8a88-4a3150786a38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:17.510650 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada06ddc-0924-4488-8a88-4a3150786a38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:17.512535 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada06ddc-0924-4488-8a88-4a3150786a38 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:17.526930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-ada06ddc-0924-4488-8a88-4a3150786a38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:58:17.526930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:17.526930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:17.526930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:17.526930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:17.526930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:17.526930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:17.526930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:17.526930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:17.526930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:17.526930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:17.526930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:17.526930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:58:17.526930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:58:17.526930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:58:17.528007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:58:17.528007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:17.528007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:17.528007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:17.528007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:17.528007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:17.528007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:17.528007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:17.528007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:58:17.528007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:17.528007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:17.528007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:17.528007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:17.528007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:17.528007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:17.528007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:17.528007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:17.529572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:58:17.529572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:58:17.529572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:58:17.529572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:58:17.529572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:58:17.529572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:58:17.529572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:58:17.529572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:58:17.529572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 646/1271] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:58:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:17.538014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f567314-6145-4813-b038-70ba9c0f7815 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:17.610812 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:17.657574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f567314-6145-4813-b038-70ba9c0f7815 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:17.692860 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbbaad-a822-4eaa-babd-3db88651e23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:17.693560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbbaad-a822-4eaa-babd-3db88651e23f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:17.693838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbbaad-a822-4eaa-babd-3db88651e23f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:17.694150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbbaad-a822-4eaa-babd-3db88651e23f None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:17.694953 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbbaad-a822-4eaa-babd-3db88651e23f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:17.695262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbbaad-a822-4eaa-babd-3db88651e23f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:17.696705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbbaad-a822-4eaa-babd-3db88651e23f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:17.709838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 626/1272] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:58:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:17.716487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada06ddc-0924-4488-8a88-4a3150786a38 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:17.813664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:17.823654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada06ddc-0924-4488-8a88-4a3150786a38 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:17.861183 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d664-111c-40bb-819e-9a89ea7f97cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:17.862027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d664-111c-40bb-819e-9a89ea7f97cd None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:17.862306 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d664-111c-40bb-819e-9a89ea7f97cd None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:17.862579 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d664-111c-40bb-819e-9a89ea7f97cd None admin] PATH_INFO: `/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/e8952f35c21c4a2eaf1fbc601fe76242/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:17.864781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762d664-111c-40bb-819e-9a89ea7f97cd None admin] RBAC: Authorizing `identity:create_grant(project_id=2c23678abd4f4dacaf35d73c5184e72e, user_id=e8952f35c21c4a2eaf1fbc601fe76242, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:17.866268 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762d664-111c-40bb-819e-9a89ea7f97cd None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:17.881663 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 647/1273] 10.222.0.61 () {58 vars in 1439 bytes} [Thu May 26 20:58:17 2022] PUT /identity/v3/projects/2c23678abd4f4dacaf35d73c5184e72e/users/e8952f35c21c4a2eaf1fbc601fe76242/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:58:20.108410 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e314f-8287-4f31-9d15-89971cebc29d None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:20.108942 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e314f-8287-4f31-9d15-89971cebc29d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:20.108942 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e314f-8287-4f31-9d15-89971cebc29d None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:20.110281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 627/1274] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:58:20.116539 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d13b0a-2b44-4a91-9d93-9c1f4376b2ca None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:20.117276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d13b0a-2b44-4a91-9d93-9c1f4376b2ca None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:20.117431 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d13b0a-2b44-4a91-9d93-9c1f4376b2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:20.142544 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-87d13b0a-2b44-4a91-9d93-9c1f4376b2ca None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:58:20.143734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-87d13b0a-2b44-4a91-9d93-9c1f4376b2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:58:20.220626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 648/1275] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:58:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:58:20.244452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e314f-8287-4f31-9d15-89971cebc29d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:20.354263 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e314f-8287-4f31-9d15-89971cebc29d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:20.373097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:20.400440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162551ee-58b7-4e9e-a462-32896e16e206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:20.401239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162551ee-58b7-4e9e-a462-32896e16e206 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:20.401524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162551ee-58b7-4e9e-a462-32896e16e206 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:20.401827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162551ee-58b7-4e9e-a462-32896e16e206 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:20.412717 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162551ee-58b7-4e9e-a462-32896e16e206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:58:20.420344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-162551ee-58b7-4e9e-a462-32896e16e206 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:58:20.420344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:20.420344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:20.420344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:20.420344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:20.420344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:20.420344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:20.420344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:20.420344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:20.420344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:20.420344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:20.420344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:20.420344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:58:20.420344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:58:20.420344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:58:20.420344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:58:20.421398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:58:20.421398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:58:20.421398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:58:20.421398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:58:20.421398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:20.421398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:20.421398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:20.421398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:20.421398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:20.421398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:20.421398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:20.421398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:58:20.421398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:20.421398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:20.421398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:20.421398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:20.422376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:20.422376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:20.422376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:20.422376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:20.422376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:58:20.422376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:58:20.422376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:58:20.422376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:58:20.422376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:58:20.422376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:58:20.422376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:58:20.422376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:20.422376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 628/1276] 10.222.0.61 () {56 vars in 1096 bytes} [Thu May 26 20:58:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:20.429680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d13b0a-2b44-4a91-9d93-9c1f4376b2ca None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:20.536498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:20.556679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d13b0a-2b44-4a91-9d93-9c1f4376b2ca None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:20.601297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c75b3-5a55-4a21-9ece-672a15c4454c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:20.602136 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c75b3-5a55-4a21-9ece-672a15c4454c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:20.602628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c75b3-5a55-4a21-9ece-672a15c4454c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:20.602922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c75b3-5a55-4a21-9ece-672a15c4454c None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:20.603731 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c75b3-5a55-4a21-9ece-672a15c4454c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:20.604238 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c75b3-5a55-4a21-9ece-672a15c4454c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:20.606151 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c75b3-5a55-4a21-9ece-672a15c4454c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:20.616986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 649/1277] 10.222.0.61 () {56 vars in 1099 bytes} [Thu May 26 20:58:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:20.623387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162551ee-58b7-4e9e-a462-32896e16e206 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:20.733725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162551ee-58b7-4e9e-a462-32896e16e206 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:20.770105 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318056dd-7dd9-41e8-8df3-e1275153464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:20.770913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318056dd-7dd9-41e8-8df3-e1275153464d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:20.771187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318056dd-7dd9-41e8-8df3-e1275153464d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:20.771458 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318056dd-7dd9-41e8-8df3-e1275153464d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:20.783077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318056dd-7dd9-41e8-8df3-e1275153464d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:20.784525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318056dd-7dd9-41e8-8df3-e1275153464d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:20.801591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-318056dd-7dd9-41e8-8df3-e1275153464d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:20.801591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:20.801591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:20.801591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:20.801591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:20.801591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:20.801591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:20.801591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:20.801591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:20.801591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:20.801591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:20.801591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:20.801591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:58:20.801591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:58:20.801591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:58:20.802535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:58:20.802535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:20.802535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:20.802535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:20.802535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:20.802535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:20.802535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:20.802535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:20.802535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:58:20.802535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:20.802535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:20.802535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:20.802535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:20.802535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:20.802535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:20.802535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:20.802535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:20.803519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:58:20.803519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:58:20.803519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:20.803519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:20.803519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 629/1278] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:20.809070 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c75b3-5a55-4a21-9ece-672a15c4454c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:20.911465 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c75b3-5a55-4a21-9ece-672a15c4454c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:20.950289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba8293-5d77-4034-9054-94d817b3982f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:20.950949 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8293-5d77-4034-9054-94d817b3982f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:20.951228 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8293-5d77-4034-9054-94d817b3982f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:20.951502 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8293-5d77-4034-9054-94d817b3982f None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:20.952219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba8293-5d77-4034-9054-94d817b3982f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:20.952525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba8293-5d77-4034-9054-94d817b3982f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:20.953932 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba8293-5d77-4034-9054-94d817b3982f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:20.966732 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 650/1279] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:20.972860 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318056dd-7dd9-41e8-8df3-e1275153464d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:21.006802 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:21.088459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318056dd-7dd9-41e8-8df3-e1275153464d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:21.127008 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8270bf-9fea-4450-a5ab-304472ed40ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:21.127810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8270bf-9fea-4450-a5ab-304472ed40ee None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:21.128083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8270bf-9fea-4450-a5ab-304472ed40ee None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:21.128355 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8270bf-9fea-4450-a5ab-304472ed40ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:21.136263 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8270bf-9fea-4450-a5ab-304472ed40ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:21.138370 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8270bf-9fea-4450-a5ab-304472ed40ee None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:21.153133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-1b8270bf-9fea-4450-a5ab-304472ed40ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 20:58:21.153133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:21.153133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:21.153133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:21.153133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:21.153133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:21.153133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:21.153133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:21.153133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:21.153133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:21.153133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:21.153133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:21.153133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:58:21.153133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:58:21.153133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:58:21.153133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:21.154196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:21.155312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:21.155312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:21.155312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:58:21.155312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:58:21.155312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:58:21.155312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:58:21.155312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:58:21.155312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:58:21.155312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 20:58:21.155312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:21.155312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 630/1280] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:58:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:21.161001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba8293-5d77-4034-9054-94d817b3982f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:21.167338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:21.276179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba8293-5d77-4034-9054-94d817b3982f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:21.320956 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618785bf-596a-418d-9129-03d1cacd9850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:21.322030 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618785bf-596a-418d-9129-03d1cacd9850 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:21.322446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618785bf-596a-418d-9129-03d1cacd9850 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:21.322851 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618785bf-596a-418d-9129-03d1cacd9850 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:21.324202 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618785bf-596a-418d-9129-03d1cacd9850 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:21.324690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618785bf-596a-418d-9129-03d1cacd9850 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:21.327043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618785bf-596a-418d-9129-03d1cacd9850 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:21.350442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 651/1281] 10.222.0.61 () {56 vars in 1143 bytes} [Thu May 26 20:58:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:21.356522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8270bf-9fea-4450-a5ab-304472ed40ee None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:21.454085 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:21.465047 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8270bf-9fea-4450-a5ab-304472ed40ee None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:21.500379 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f635f-7be4-4e0d-a9d7-4a09ee5033ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:21.501030 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f635f-7be4-4e0d-a9d7-4a09ee5033ab None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:21.501317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f635f-7be4-4e0d-a9d7-4a09ee5033ab None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:21.501592 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f635f-7be4-4e0d-a9d7-4a09ee5033ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:21.575334 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f635f-7be4-4e0d-a9d7-4a09ee5033ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:21.576801 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f635f-7be4-4e0d-a9d7-4a09ee5033ab None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:21.668478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:21.679998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 631/1282] 10.222.0.61 () {58 vars in 1282 bytes} [Thu May 26 20:58:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:58:21.689450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618785bf-596a-418d-9129-03d1cacd9850 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:21.757877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:21.799946 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618785bf-596a-418d-9129-03d1cacd9850 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:21.836345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f4253-20dc-4e90-b211-e068fe6ff936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:21.837148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f4253-20dc-4e90-b211-e068fe6ff936 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:21.837446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f4253-20dc-4e90-b211-e068fe6ff936 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:21.837707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f4253-20dc-4e90-b211-e068fe6ff936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:21.848369 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f4253-20dc-4e90-b211-e068fe6ff936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:21.849841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f4253-20dc-4e90-b211-e068fe6ff936 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:21.867678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-775f4253-20dc-4e90-b211-e068fe6ff936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:21.867678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:21.867678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:21.867678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:21.867678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:21.867678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:21.867678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:21.867678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:21.867678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:21.867678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:21.867678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:21.867678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:21.867678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:58:21.867678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:58:21.867678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:58:21.868736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:58:21.868736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:21.868736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:21.868736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:21.868736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:21.868736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:21.868736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:21.868736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:21.868736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:58:21.868736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:21.868736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:21.868736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:21.868736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:21.868736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:21.868736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:21.868736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:21.868736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:21.869649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:58:21.869649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:58:21.869649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:58:21.869649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:58:21.869649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 652/1283] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 20:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:21.877456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f635f-7be4-4e0d-a9d7-4a09ee5033ab None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:21.999578 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f635f-7be4-4e0d-a9d7-4a09ee5033ab None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:22.038888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de4f38-2bb3-4650-9e97-0e3321304879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:22.039494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4f38-2bb3-4650-9e97-0e3321304879 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:22.039781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4f38-2bb3-4650-9e97-0e3321304879 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:22.040054 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4f38-2bb3-4650-9e97-0e3321304879 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:22.040785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de4f38-2bb3-4650-9e97-0e3321304879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:22.041092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de4f38-2bb3-4650-9e97-0e3321304879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:22.042603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de4f38-2bb3-4650-9e97-0e3321304879 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:22.055068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 632/1284] 10.222.0.61 () {56 vars in 1109 bytes} [Thu May 26 20:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:22.062887 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f4253-20dc-4e90-b211-e068fe6ff936 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:22.173105 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f4253-20dc-4e90-b211-e068fe6ff936 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:22.187570 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:22.210184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb0846-d17e-4835-83e1-f9048d35e8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:22.210984 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb0846-d17e-4835-83e1-f9048d35e8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:22.211260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb0846-d17e-4835-83e1-f9048d35e8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:22.211534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb0846-d17e-4835-83e1-f9048d35e8a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:22.219172 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb0846-d17e-4835-83e1-f9048d35e8a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:22.220633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb0846-d17e-4835-83e1-f9048d35e8a8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:22.238836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-4dfb0846-d17e-4835-83e1-f9048d35e8a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:58:22.238836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:22.238836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:22.238836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:22.238836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:22.238836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:22.238836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:22.238836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:22.238836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:22.238836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:22.238836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:22.238836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:22.238836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:58:22.238836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:58:22.238836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:58:22.239923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:58:22.239923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:22.239923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:22.239923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:22.239923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:22.239923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:22.239923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:22.239923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:22.239923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( May 26 20:58:22.239923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:22.239923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:22.239923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:22.239923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:22.239923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:22.239923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:22.239923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:22.239923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:22.241132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:58:22.241132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:58:22.241132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:58:22.241132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:58:22.241132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:58:22.241132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:58:22.241132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:58:22.241132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application May 26 20:58:22.241132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 653/1285] 10.222.0.61 () {56 vars in 1111 bytes} [Thu May 26 20:58:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:22.247072 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de4f38-2bb3-4650-9e97-0e3321304879 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:22.310487 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:22.367282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de4f38-2bb3-4650-9e97-0e3321304879 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:22.411278 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612c118-79f3-4b79-8fcc-39fd6f4915f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:22.412270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612c118-79f3-4b79-8fcc-39fd6f4915f9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:22.412703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612c118-79f3-4b79-8fcc-39fd6f4915f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:22.413145 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612c118-79f3-4b79-8fcc-39fd6f4915f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:22.414426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612c118-79f3-4b79-8fcc-39fd6f4915f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:22.414893 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612c118-79f3-4b79-8fcc-39fd6f4915f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:22.417166 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612c118-79f3-4b79-8fcc-39fd6f4915f9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:22.430239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 633/1286] 10.222.0.61 () {56 vars in 1148 bytes} [Thu May 26 20:58:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:22.440300 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb0846-d17e-4835-83e1-f9048d35e8a8 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:22.551223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb0846-d17e-4835-83e1-f9048d35e8a8 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:22.586360 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810da6e7-630d-420d-a52b-a654314060e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:22.586951 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810da6e7-630d-420d-a52b-a654314060e9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:22.587233 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810da6e7-630d-420d-a52b-a654314060e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:22.587508 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810da6e7-630d-420d-a52b-a654314060e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:22.588343 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810da6e7-630d-420d-a52b-a654314060e9 None admin] RBAC: Adding query filter params (role.id=aefba81d87bf47258c17064af7d9a05f, scope.project.id=2c23678abd4f4dacaf35d73c5184e72e, user.id=e8952f35c21c4a2eaf1fbc601fe76242) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:22.588652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810da6e7-630d-420d-a52b-a654314060e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:22.590142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810da6e7-630d-420d-a52b-a654314060e9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:22.596208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 654/1287] 10.222.0.61 () {56 vars in 1374 bytes} [Thu May 26 20:58:22 2022] GET /identity/v3/role_assignments?user.id=e8952f35c21c4a2eaf1fbc601fe76242&scope.project.id=2c23678abd4f4dacaf35d73c5184e72e&role.id=aefba81d87bf47258c17064af7d9a05f => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:24.793629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f93d50-59e7-489a-b37e-7904800e15d0 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:24.794236 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f93d50-59e7-489a-b37e-7904800e15d0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:24.794236 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f93d50-59e7-489a-b37e-7904800e15d0 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:24.795615 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 634/1288] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:58:24.801069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4dc5-c16c-4216-8ee6-26a8180b6f6b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:24.801510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4dc5-c16c-4216-8ee6-26a8180b6f6b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:24.801600 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4dc5-c16c-4216-8ee6-26a8180b6f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:24.821204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a0fd4dc5-c16c-4216-8ee6-26a8180b6f6b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:58:24.822411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a0fd4dc5-c16c-4216-8ee6-26a8180b6f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:58:24.857083 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:24.904645 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 655/1289] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:58:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:58:24.939124 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f93d50-59e7-489a-b37e-7904800e15d0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:25.051779 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f93d50-59e7-489a-b37e-7904800e15d0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:25.063208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:25.089270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044434ce-9a87-4cbb-8fea-52ae85ab8c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:25.090149 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044434ce-9a87-4cbb-8fea-52ae85ab8c57 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:25.090434 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044434ce-9a87-4cbb-8fea-52ae85ab8c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:25.090706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044434ce-9a87-4cbb-8fea-52ae85ab8c57 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:25.091356 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044434ce-9a87-4cbb-8fea-52ae85ab8c57 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:25.092741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044434ce-9a87-4cbb-8fea-52ae85ab8c57 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:25.104710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-044434ce-9a87-4cbb-8fea-52ae85ab8c57 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:58:25.104710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:25.104710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:58:25.104710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:58:25.104710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:58:25.104710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:58:25.104710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:58:25.104710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:58:25.104710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:58:25.104710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:25.104710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:58:25.104710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:25.104710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:25.104710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:25.104710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:25.104710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:25.104710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:25.105938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:25.105938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:25.105938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:25.105938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:25.105938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:25.105938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:25.105938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:58:25.105938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:58:25.105938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:58:25.105938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:58:25.105938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:25.105938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:25.105938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:25.105938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:25.105938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:25.105938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:25.106955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:25.106955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:58:25.106955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:25.106955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:25.106955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:25.106955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:25.106955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:25.106955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:25.106955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:25.106955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:25.106955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:58:25.106955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:58:25.106955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:58:25.106955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:25.110148 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 635/1290] 10.222.0.61 () {56 vars in 1117 bytes} [Thu May 26 20:58:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:25.112854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd4dc5-c16c-4216-8ee6-26a8180b6f6b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:25.220707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd4dc5-c16c-4216-8ee6-26a8180b6f6b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:25.256915 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001c6ee-7c87-4515-ae10-be86d45efbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:25.257590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001c6ee-7c87-4515-ae10-be86d45efbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:25.257911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001c6ee-7c87-4515-ae10-be86d45efbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:25.258184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001c6ee-7c87-4515-ae10-be86d45efbf1 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:25.258899 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001c6ee-7c87-4515-ae10-be86d45efbf1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:25.259207 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001c6ee-7c87-4515-ae10-be86d45efbf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:25.260623 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001c6ee-7c87-4515-ae10-be86d45efbf1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:25.266050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 656/1291] 10.222.0.61 () {56 vars in 1116 bytes} [Thu May 26 20:58:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:25.275340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044434ce-9a87-4cbb-8fea-52ae85ab8c57 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:25.395361 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044434ce-9a87-4cbb-8fea-52ae85ab8c57 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:25.430918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dae846-55b3-40af-9cf4-0f90ba0616aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:25.431585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dae846-55b3-40af-9cf4-0f90ba0616aa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:25.431873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dae846-55b3-40af-9cf4-0f90ba0616aa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:25.432148 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dae846-55b3-40af-9cf4-0f90ba0616aa None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:25.432858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dae846-55b3-40af-9cf4-0f90ba0616aa None admin] RBAC: Adding query filter params (type=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:25.433167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dae846-55b3-40af-9cf4-0f90ba0616aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:25.434614 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dae846-55b3-40af-9cf4-0f90ba0616aa None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:25.439348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 636/1292] 10.222.0.61 () {56 vars in 1116 bytes} [Thu May 26 20:58:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:27.630673 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a8f66-99b9-4b25-8028-805b67758a2f None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:27.631519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a8f66-99b9-4b25-8028-805b67758a2f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:27.631519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a8f66-99b9-4b25-8028-805b67758a2f None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:27.633532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 657/1293] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:58:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:58:27.640271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a56b7-c92b-42bd-b4d0-e9fc07bce6c2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:27.640739 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a56b7-c92b-42bd-b4d0-e9fc07bce6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:27.640851 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a56b7-c92b-42bd-b4d0-e9fc07bce6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:27.658414 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b18a56b7-c92b-42bd-b4d0-e9fc07bce6c2 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:58:27.659581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b18a56b7-c92b-42bd-b4d0-e9fc07bce6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:58:27.694905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:27.734875 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 637/1294] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:58:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:58:27.763774 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a8f66-99b9-4b25-8028-805b67758a2f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:27.805351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:27.880579 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a8f66-99b9-4b25-8028-805b67758a2f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:27.916962 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b881b-ebd7-4a6c-b95c-fede8bf78da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:27.917560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b881b-ebd7-4a6c-b95c-fede8bf78da4 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:27.917861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b881b-ebd7-4a6c-b95c-fede8bf78da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:27.918144 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b881b-ebd7-4a6c-b95c-fede8bf78da4 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:27.918898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b881b-ebd7-4a6c-b95c-fede8bf78da4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:27.920301 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b881b-ebd7-4a6c-b95c-fede8bf78da4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:27.938775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 658/1295] 10.222.0.61 () {60 vars in 1141 bytes} [Thu May 26 20:58:27 2022] POST /identity/v3/services => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:58:30.136428 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da105fca-27e8-40cf-a263-badba74aeeff None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:30.137390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da105fca-27e8-40cf-a263-badba74aeeff None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:30.137390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da105fca-27e8-40cf-a263-badba74aeeff None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:30.139508 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 638/1296] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:58:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:58:30.147483 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514bb4e-9b27-437d-ad4f-fc9827a2d290 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:30.147923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514bb4e-9b27-437d-ad4f-fc9827a2d290 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:30.148013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514bb4e-9b27-437d-ad4f-fc9827a2d290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:30.169582 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6514bb4e-9b27-437d-ad4f-fc9827a2d290 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:58:30.170793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6514bb4e-9b27-437d-ad4f-fc9827a2d290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:58:30.245759 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 659/1297] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:58:30 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:58:30.268463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da105fca-27e8-40cf-a263-badba74aeeff None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:30.384308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da105fca-27e8-40cf-a263-badba74aeeff None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:30.419846 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60b3a5-25d5-4e57-b821-e8bcebfb81d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:30.420576 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60b3a5-25d5-4e57-b821-e8bcebfb81d3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:30.420855 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60b3a5-25d5-4e57-b821-e8bcebfb81d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:30.421129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60b3a5-25d5-4e57-b821-e8bcebfb81d3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:30.421785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60b3a5-25d5-4e57-b821-e8bcebfb81d3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:30.423204 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60b3a5-25d5-4e57-b821-e8bcebfb81d3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:30.435453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-bb60b3a5-25d5-4e57-b821-e8bcebfb81d3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:58:30.435453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:30.435453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:58:30.435453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:58:30.435453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:58:30.435453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:58:30.435453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:58:30.435453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:58:30.435453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:58:30.435453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:30.435453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:58:30.435453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:30.435453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:30.435453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:30.435453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:30.435453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:30.435453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:30.436561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:30.436561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:30.436561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:30.436561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:30.436561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:30.436561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:30.436561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:58:30.436561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:58:30.436561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:58:30.436561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:58:30.436561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:30.436561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:30.436561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:30.436561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:30.436561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:30.436561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:30.437528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:30.437528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:58:30.437528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:30.437528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:30.437528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:30.437528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:30.437528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:30.437528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:30.437528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:30.437528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:30.437528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:58:30.437528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:58:30.437528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:58:30.437528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:30.437528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 639/1298] 10.222.0.61 () {56 vars in 1117 bytes} [Thu May 26 20:58:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:30.443618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514bb4e-9b27-437d-ad4f-fc9827a2d290 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:30.470969 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:30.555377 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514bb4e-9b27-437d-ad4f-fc9827a2d290 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:30.590929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55255ac3-0fe6-4a51-96da-77504ada11e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:30.591596 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55255ac3-0fe6-4a51-96da-77504ada11e8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:30.591874 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55255ac3-0fe6-4a51-96da-77504ada11e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:30.592149 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55255ac3-0fe6-4a51-96da-77504ada11e8 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:30.592861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55255ac3-0fe6-4a51-96da-77504ada11e8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:30.593167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55255ac3-0fe6-4a51-96da-77504ada11e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:30.594582 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55255ac3-0fe6-4a51-96da-77504ada11e8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:30.599873 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 660/1299] 10.222.0.61 () {56 vars in 1116 bytes} [Thu May 26 20:58:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:30.606273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60b3a5-25d5-4e57-b821-e8bcebfb81d3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:30.640161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:30.720909 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60b3a5-25d5-4e57-b821-e8bcebfb81d3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:30.758035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22682fff-8ea7-41c3-95de-4a72d8d52e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:30.758693 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22682fff-8ea7-41c3-95de-4a72d8d52e1f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:30.758975 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22682fff-8ea7-41c3-95de-4a72d8d52e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:30.759249 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22682fff-8ea7-41c3-95de-4a72d8d52e1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:30.760046 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22682fff-8ea7-41c3-95de-4a72d8d52e1f None admin] RBAC: Adding query filter params (interface=public, service_id=61df020956b843efb698d2c8f6c50a5e, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:30.760355 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22682fff-8ea7-41c3-95de-4a72d8d52e1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:30.762009 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22682fff-8ea7-41c3-95de-4a72d8d52e1f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:30.767597 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 640/1300] 10.222.0.61 () {56 vars in 1251 bytes} [Thu May 26 20:58:30 2022] GET /identity/v3/endpoints?service_id=61df020956b843efb698d2c8f6c50a5e&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:30.773690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55255ac3-0fe6-4a51-96da-77504ada11e8 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:30.866616 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:30.887095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55255ac3-0fe6-4a51-96da-77504ada11e8 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:30.921820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc7338-cdab-4b5f-8da2-41a3450dd19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:30.922491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc7338-cdab-4b5f-8da2-41a3450dd19b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:30.922765 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc7338-cdab-4b5f-8da2-41a3450dd19b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:30.923028 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc7338-cdab-4b5f-8da2-41a3450dd19b None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:30.923710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc7338-cdab-4b5f-8da2-41a3450dd19b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:30.925277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc7338-cdab-4b5f-8da2-41a3450dd19b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:30.932240 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 661/1301] 10.222.0.61 () {56 vars in 1087 bytes} [Thu May 26 20:58:30 2022] GET /identity/v3/services => generated 2191 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:58:33.105959 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef002fb8-7550-46ca-a599-b4ace58ab5ba None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:33.106502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef002fb8-7550-46ca-a599-b4ace58ab5ba None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:33.106502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef002fb8-7550-46ca-a599-b4ace58ab5ba None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:33.107840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 641/1302] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:58:33.114478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc07a-903c-4833-a9e0-20d1a49f4b98 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:33.115187 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc07a-903c-4833-a9e0-20d1a49f4b98 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:33.115319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc07a-903c-4833-a9e0-20d1a49f4b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:33.142305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-bd1cc07a-903c-4833-a9e0-20d1a49f4b98 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:58:33.143506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bd1cc07a-903c-4833-a9e0-20d1a49f4b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:58:33.221503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 662/1303] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:58:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:58:33.245169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef002fb8-7550-46ca-a599-b4ace58ab5ba None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:33.349660 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:33.358467 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef002fb8-7550-46ca-a599-b4ace58ab5ba None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:33.394658 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca4d06-0071-489e-b1bd-e3e6ab1ed738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:33.395458 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca4d06-0071-489e-b1bd-e3e6ab1ed738 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:33.395743 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca4d06-0071-489e-b1bd-e3e6ab1ed738 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:33.396018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca4d06-0071-489e-b1bd-e3e6ab1ed738 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:33.396671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca4d06-0071-489e-b1bd-e3e6ab1ed738 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:33.398096 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca4d06-0071-489e-b1bd-e3e6ab1ed738 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:33.410345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a2ca4d06-0071-489e-b1bd-e3e6ab1ed738 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:58:33.410345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:33.410345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:58:33.410345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:58:33.410345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:58:33.410345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:58:33.410345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:58:33.410345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:58:33.410345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:58:33.410345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:33.410345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:58:33.410345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:33.410345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:58:33.410345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:58:33.410345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:58:33.410345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:58:33.410345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:58:33.411452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:58:33.411452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:58:33.411452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:58:33.411452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:58:33.411452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:58:33.411452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:58:33.411452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:58:33.411452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:58:33.411452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:58:33.411452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:58:33.411452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:58:33.411452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:58:33.411452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:58:33.411452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:58:33.411452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:58:33.411452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:58:33.412639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:58:33.412639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( May 26 20:58:33.412639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:58:33.412639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() May 26 20:58:33.412639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:58:33.412639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:58:33.412639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:58:33.412639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() May 26 20:58:33.412639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:58:33.412639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( May 26 20:58:33.412639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:58:33.412639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:58:33.412639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:58:33.412639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application May 26 20:58:33.412639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 642/1304] 10.222.0.61 () {56 vars in 1117 bytes} [Thu May 26 20:58:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:58:33.422279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cc07a-903c-4833-a9e0-20d1a49f4b98 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:33.507828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:33.534062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cc07a-903c-4833-a9e0-20d1a49f4b98 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:33.570166 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498986b4-a1d1-413e-88ce-48f104ce76db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:33.570834 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498986b4-a1d1-413e-88ce-48f104ce76db None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:33.571117 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498986b4-a1d1-413e-88ce-48f104ce76db None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:33.571392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498986b4-a1d1-413e-88ce-48f104ce76db None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:33.572109 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498986b4-a1d1-413e-88ce-48f104ce76db None admin] RBAC: Adding query filter params (name=placement) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:58:33.572415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498986b4-a1d1-413e-88ce-48f104ce76db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:33.574027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498986b4-a1d1-413e-88ce-48f104ce76db None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:33.579336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 663/1305] 10.222.0.61 () {56 vars in 1116 bytes} [Thu May 26 20:58:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:58:33.586456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca4d06-0071-489e-b1bd-e3e6ab1ed738 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:58:33.697041 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca4d06-0071-489e-b1bd-e3e6ab1ed738 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:58:33.733107 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ec2fc-b20d-4cb3-a4e7-f7a3876dee5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:58:33.733751 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ec2fc-b20d-4cb3-a4e7-f7a3876dee5c None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:58:33.734062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ec2fc-b20d-4cb3-a4e7-f7a3876dee5c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:58:33.734331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ec2fc-b20d-4cb3-a4e7-f7a3876dee5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:58:33.735061 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ec2fc-b20d-4cb3-a4e7-f7a3876dee5c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:58:33.736431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ec2fc-b20d-4cb3-a4e7-f7a3876dee5c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:58:33.758908 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 643/1306] 10.222.0.61 () {60 vars in 1144 bytes} [Thu May 26 20:58:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:58:43.576165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=30 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:58:43.754197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:59:38.094954 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b62ea4-2b72-4613-81d8-81aa28864780 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:38.095494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b62ea4-2b72-4613-81d8-81aa28864780 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:38.095494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b62ea4-2b72-4613-81d8-81aa28864780 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:38.102434 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e5d9b-5cab-4847-bf33-d98f1fde66cc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:38.102886 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e5d9b-5cab-4847-bf33-d98f1fde66cc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:38.102998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e5d9b-5cab-4847-bf33-d98f1fde66cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:38.107056 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 664/1307] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:59:38 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:59:38.232440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-531e5d9b-5cab-4847-bf33-d98f1fde66cc None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:59:38.234752 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-531e5d9b-5cab-4847-bf33-d98f1fde66cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:38.454880 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 644/1308] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:59:38.498777 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa8cef-8591-489d-a1aa-62baf69170a3 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:38.499571 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa8cef-8591-489d-a1aa-62baf69170a3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:38.500027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa8cef-8591-489d-a1aa-62baf69170a3 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:38.501554 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 665/1309] 10.222.0.61 () {54 vars in 964 bytes} [Thu May 26 20:59:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:59:38.508599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a6b41-cef5-464b-900a-da4fcf2f08f1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:38.509041 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a6b41-cef5-464b-900a-da4fcf2f08f1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:38.509458 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a6b41-cef5-464b-900a-da4fcf2f08f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:38.609560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c62a6b41-cef5-464b-900a-da4fcf2f08f1 None None] MFA Rules not processed for user `e3514a1833104114894abe6c41ea30a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:59:38.610734 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c62a6b41-cef5-464b-900a-da4fcf2f08f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:38.642731 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:59:38.710601 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 645/1310] 10.222.0.61 () {58 vars in 1061 bytes} [Thu May 26 20:59:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:59:38.719884 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa8cef-8591-489d-a1aa-62baf69170a3 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:59:38.722000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ddfa8cef-8591-489d-a1aa-62baf69170a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:38.860787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa8cef-8591-489d-a1aa-62baf69170a3 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:59:38.944120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e519bf-0060-40b9-9dfd-0d9e7df5d909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:59:38.945171 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e519bf-0060-40b9-9dfd-0d9e7df5d909 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:38.945465 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e519bf-0060-40b9-9dfd-0d9e7df5d909 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:38.945747 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e519bf-0060-40b9-9dfd-0d9e7df5d909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:38.947814 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-87e519bf-0060-40b9-9dfd-0d9e7df5d909 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:39.008764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:59:39.086107 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e519bf-0060-40b9-9dfd-0d9e7df5d909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:59:39.087842 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e519bf-0060-40b9-9dfd-0d9e7df5d909 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:59:39.109948 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 666/1311] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 20:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:59:41.655618 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469e4f2-0212-454e-9181-f016c1a5e8a4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:41.656630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469e4f2-0212-454e-9181-f016c1a5e8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:41.657323 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469e4f2-0212-454e-9181-f016c1a5e8a4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:41.659224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 646/1312] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:59:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:59:41.665064 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c472f4-520c-4bce-b07d-61b4b7b42bd5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:41.665537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c472f4-520c-4bce-b07d-61b4b7b42bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:41.665783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c472f4-520c-4bce-b07d-61b4b7b42bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:41.741889 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-69c472f4-520c-4bce-b07d-61b4b7b42bd5 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:59:41.743121 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-69c472f4-520c-4bce-b07d-61b4b7b42bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:41.847000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 667/1313] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:59:41.885329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469e4f2-0212-454e-9181-f016c1a5e8a4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:59:41.886951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f469e4f2-0212-454e-9181-f016c1a5e8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:41.999463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469e4f2-0212-454e-9181-f016c1a5e8a4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:59:42.071229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:59:42.073854 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7325328-e47a-49e0-9872-4d44d5502481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:59:42.074495 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7325328-e47a-49e0-9872-4d44d5502481 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:42.074801 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7325328-e47a-49e0-9872-4d44d5502481 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:42.075075 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7325328-e47a-49e0-9872-4d44d5502481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:42.077292 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d7325328-e47a-49e0-9872-4d44d5502481 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:42.190565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7325328-e47a-49e0-9872-4d44d5502481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:59:42.192011 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7325328-e47a-49e0-9872-4d44d5502481 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:59:42.212166 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 647/1314] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 20:59:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:59:44.734473 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad4336-21fc-462b-b4f8-d78b61c9f8eb None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:44.735073 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad4336-21fc-462b-b4f8-d78b61c9f8eb None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:44.735073 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad4336-21fc-462b-b4f8-d78b61c9f8eb None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:44.736439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 668/1315] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:59:44.742063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945d063-9d18-4d64-a07a-1a0d3d6135b2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:44.742479 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945d063-9d18-4d64-a07a-1a0d3d6135b2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:44.742601 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945d063-9d18-4d64-a07a-1a0d3d6135b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:44.818221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b945d063-9d18-4d64-a07a-1a0d3d6135b2 None None] MFA Rules not processed for user `fa17abe1a5354190bf763fadfd8bdc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:59:44.819440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b945d063-9d18-4d64-a07a-1a0d3d6135b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:44.885074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:59:44.942565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 648/1316] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:59:44 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:59:44.982709 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad4336-21fc-462b-b4f8-d78b61c9f8eb None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:59:44.985181 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6dad4336-21fc-462b-b4f8-d78b61c9f8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:45.000781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:59:45.117618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad4336-21fc-462b-b4f8-d78b61c9f8eb None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:59:45.196565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252d0d9-fb50-4fec-ae37-c464b46defa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:59:45.197276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252d0d9-fb50-4fec-ae37-c464b46defa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:45.197593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252d0d9-fb50-4fec-ae37-c464b46defa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:45.197829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252d0d9-fb50-4fec-ae37-c464b46defa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:45.199529 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2252d0d9-fb50-4fec-ae37-c464b46defa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:45.265451 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:59:45.321139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252d0d9-fb50-4fec-ae37-c464b46defa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:59:45.322691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252d0d9-fb50-4fec-ae37-c464b46defa0 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:59:45.344271 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 669/1317] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 20:59:44 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:59:48.105564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29356c17-97ed-4d8c-992a-1fd6ed3a62c4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:48.106128 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29356c17-97ed-4d8c-992a-1fd6ed3a62c4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:48.106128 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29356c17-97ed-4d8c-992a-1fd6ed3a62c4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:48.108185 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 649/1318] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:59:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:59:48.117037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe6d74-359e-4de4-abba-ca2c6c02b6f9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:48.117453 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe6d74-359e-4de4-abba-ca2c6c02b6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:48.117643 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe6d74-359e-4de4-abba-ca2c6c02b6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:48.194618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-38fe6d74-359e-4de4-abba-ca2c6c02b6f9 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:59:48.195830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-38fe6d74-359e-4de4-abba-ca2c6c02b6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:48.301858 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 670/1319] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:59:48.352058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635d7b6-9e67-43aa-88af-8eb0dd9794e4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:48.352323 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635d7b6-9e67-43aa-88af-8eb0dd9794e4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:48.352632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635d7b6-9e67-43aa-88af-8eb0dd9794e4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:48.354231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 650/1320] 10.222.0.61 () {54 vars in 964 bytes} [Thu May 26 20:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:59:48.361000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bfea1-d51d-4a15-afaa-53cc38b523aa None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:48.361348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bfea1-d51d-4a15-afaa-53cc38b523aa None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:48.361834 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bfea1-d51d-4a15-afaa-53cc38b523aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:48.386482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:59:48.445246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3b0bfea1-d51d-4a15-afaa-53cc38b523aa None None] MFA Rules not processed for user `e3514a1833104114894abe6c41ea30a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:59:48.446472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3b0bfea1-d51d-4a15-afaa-53cc38b523aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:48.544969 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 671/1321] 10.222.0.61 () {58 vars in 1061 bytes} [Thu May 26 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:59:48.555002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635d7b6-9e67-43aa-88af-8eb0dd9794e4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:59:48.557385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4635d7b6-9e67-43aa-88af-8eb0dd9794e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:48.677246 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635d7b6-9e67-43aa-88af-8eb0dd9794e4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:59:48.756810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd6b9d-b05e-424d-87db-87b8898cfdcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:59:48.757498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd6b9d-b05e-424d-87db-87b8898cfdcc service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:48.757769 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd6b9d-b05e-424d-87db-87b8898cfdcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:48.758057 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd6b9d-b05e-424d-87db-87b8898cfdcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:48.759984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-72fd6b9d-b05e-424d-87db-87b8898cfdcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:48.769764 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:59:48.880018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd6b9d-b05e-424d-87db-87b8898cfdcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:59:48.881471 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd6b9d-b05e-424d-87db-87b8898cfdcc service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:59:48.901762 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 651/1322] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 20:59:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:59:52.247756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85d01a-f66b-4fc2-bb71-a922c3000113 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:52.248347 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85d01a-f66b-4fc2-bb71-a922c3000113 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:52.248347 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85d01a-f66b-4fc2-bb71-a922c3000113 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:52.249687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 672/1323] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:59:52.255095 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb91d22-a3ad-4d16-81ab-511bb92b683d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:52.255556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb91d22-a3ad-4d16-81ab-511bb92b683d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:52.255666 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb91d22-a3ad-4d16-81ab-511bb92b683d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:52.321895 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-aeb91d22-a3ad-4d16-81ab-511bb92b683d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:59:52.323173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aeb91d22-a3ad-4d16-81ab-511bb92b683d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:52.383125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:59:52.426394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 652/1324] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:59:52.461935 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85d01a-f66b-4fc2-bb71-a922c3000113 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:59:52.463787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0e85d01a-f66b-4fc2-bb71-a922c3000113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:52.581349 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85d01a-f66b-4fc2-bb71-a922c3000113 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:59:52.594639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:59:52.659126 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5fc0b-5ec4-437e-af62-dd28d38c750f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:59:52.659793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5fc0b-5ec4-437e-af62-dd28d38c750f service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:52.660075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5fc0b-5ec4-437e-af62-dd28d38c750f service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:52.660351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5fc0b-5ec4-437e-af62-dd28d38c750f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:52.662050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a5b5fc0b-5ec4-437e-af62-dd28d38c750f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:52.779770 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5fc0b-5ec4-437e-af62-dd28d38c750f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:59:52.781299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5fc0b-5ec4-437e-af62-dd28d38c750f service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:59:52.802517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 673/1325] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 20:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:59:55.045676 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adfc89-12c7-4e35-befe-5ec71c7f000f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:55.046248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adfc89-12c7-4e35-befe-5ec71c7f000f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:55.046248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adfc89-12c7-4e35-befe-5ec71c7f000f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:55.047556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 653/1326] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:59:55.053259 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d12bcc-03cf-4360-9587-779d322fb9d9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:55.053721 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d12bcc-03cf-4360-9587-779d322fb9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:55.053968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d12bcc-03cf-4360-9587-779d322fb9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:55.101322 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:59:55.120926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-c5d12bcc-03cf-4360-9587-779d322fb9d9 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:59:55.122202 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c5d12bcc-03cf-4360-9587-779d322fb9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:55.231233 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 674/1327] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:59:55.266873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adfc89-12c7-4e35-befe-5ec71c7f000f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:59:55.268460 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-47adfc89-12c7-4e35-befe-5ec71c7f000f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:55.379624 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adfc89-12c7-4e35-befe-5ec71c7f000f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:59:55.455119 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d5486-bf24-48f6-b360-3db85f409a29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:59:55.456089 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d5486-bf24-48f6-b360-3db85f409a29 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:55.456403 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d5486-bf24-48f6-b360-3db85f409a29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:55.456673 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d5486-bf24-48f6-b360-3db85f409a29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:55.458347 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-426d5486-bf24-48f6-b360-3db85f409a29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:55.475357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:59:55.574189 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d5486-bf24-48f6-b360-3db85f409a29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:59:55.575688 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d5486-bf24-48f6-b360-3db85f409a29 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:59:55.595420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 654/1328] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 20:59:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:59:57.823580 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936193aa-ea6b-418c-be0b-b1ab03cbb8bf None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:57.824148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936193aa-ea6b-418c-be0b-b1ab03cbb8bf None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:57.824148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936193aa-ea6b-418c-be0b-b1ab03cbb8bf None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:57.825575 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 675/1329] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 20:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:59:57.831305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012a6ec-a41c-4bc3-b00a-fd10a8a38950 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:57.831702 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012a6ec-a41c-4bc3-b00a-fd10a8a38950 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:57.831937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012a6ec-a41c-4bc3-b00a-fd10a8a38950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:57.902755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c012a6ec-a41c-4bc3-b00a-fd10a8a38950 None None] MFA Rules not processed for user `fa17abe1a5354190bf763fadfd8bdc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:59:57.903971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c012a6ec-a41c-4bc3-b00a-fd10a8a38950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:57.979548 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:59:58.014285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 655/1330] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 20:59:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:59:58.051584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936193aa-ea6b-418c-be0b-b1ab03cbb8bf None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:59:58.053125 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-936193aa-ea6b-418c-be0b-b1ab03cbb8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:58.163204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936193aa-ea6b-418c-be0b-b1ab03cbb8bf None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:59:58.184595 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:59:58.243071 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8e184-c103-45c0-8ecb-978859e1dca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:59:58.243885 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8e184-c103-45c0-8ecb-978859e1dca0 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:59:58.244172 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8e184-c103-45c0-8ecb-978859e1dca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:59:58.244454 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8e184-c103-45c0-8ecb-978859e1dca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:59:58.246165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ebb8e184-c103-45c0-8ecb-978859e1dca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:59:58.356963 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8e184-c103-45c0-8ecb-978859e1dca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:59:58.358444 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8e184-c103-45c0-8ecb-978859e1dca0 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:59:58.377208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 676/1331] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 20:59:58 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:00.821456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8f03-1250-4bd7-a75a-d7fc33742471 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:00.822200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8f03-1250-4bd7-a75a-d7fc33742471 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:00.822200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8f03-1250-4bd7-a75a-d7fc33742471 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:00.823514 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 656/1332] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:00.832847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8fb92-b851-477e-96c6-9dd8d6ac9c6f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:00.833570 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8fb92-b851-477e-96c6-9dd8d6ac9c6f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:00.833749 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8fb92-b851-477e-96c6-9dd8d6ac9c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:00.908350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:00.911372 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-8da8fb92-b851-477e-96c6-9dd8d6ac9c6f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:00.913441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8da8fb92-b851-477e-96c6-9dd8d6ac9c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:01.017976 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 677/1333] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:01.055810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f8f03-1250-4bd7-a75a-d7fc33742471 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:01.057728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-268f8f03-1250-4bd7-a75a-d7fc33742471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:01.175498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f8f03-1250-4bd7-a75a-d7fc33742471 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:01.262859 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebb3f0-1be0-4ac3-bfd7-551e11092308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:01.263506 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebb3f0-1be0-4ac3-bfd7-551e11092308 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:01.263779 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebb3f0-1be0-4ac3-bfd7-551e11092308 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:01.264047 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebb3f0-1be0-4ac3-bfd7-551e11092308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:01.265678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-23ebb3f0-1be0-4ac3-bfd7-551e11092308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:01.293259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:01.391279 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebb3f0-1be0-4ac3-bfd7-551e11092308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:01.392787 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebb3f0-1be0-4ac3-bfd7-551e11092308 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:01.419005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 657/1334] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:03.659754 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4edf-323a-47e7-b4e9-7638ad361534 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:03.660327 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4edf-323a-47e7-b4e9-7638ad361534 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:03.660327 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4edf-323a-47e7-b4e9-7638ad361534 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:03.661700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 678/1335] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:03.668919 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57324f67-d238-4cce-bb96-3593fd792c54 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:03.669718 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57324f67-d238-4cce-bb96-3593fd792c54 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:03.669911 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57324f67-d238-4cce-bb96-3593fd792c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:03.751605 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-57324f67-d238-4cce-bb96-3593fd792c54 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:03.752823 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-57324f67-d238-4cce-bb96-3593fd792c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:03.836775 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:03.861841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 658/1336] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:03.903680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d4edf-323a-47e7-b4e9-7638ad361534 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:03.905248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c59d4edf-323a-47e7-b4e9-7638ad361534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:04.025915 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d4edf-323a-47e7-b4e9-7638ad361534 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:04.055524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:04.104208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ded89a-83fd-4523-af09-135544e117f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:04.104863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ded89a-83fd-4523-af09-135544e117f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:04.105148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ded89a-83fd-4523-af09-135544e117f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:04.105421 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ded89a-83fd-4523-af09-135544e117f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:04.107113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d8ded89a-83fd-4523-af09-135544e117f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:04.226409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ded89a-83fd-4523-af09-135544e117f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:04.227902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ded89a-83fd-4523-af09-135544e117f3 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:04.248448 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 679/1337] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:06.908792 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa1859-0b32-47ba-98f1-e8a2232b670d None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:06.909395 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa1859-0b32-47ba-98f1-e8a2232b670d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:06.909395 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa1859-0b32-47ba-98f1-e8a2232b670d None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:06.910769 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 659/1338] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:06.919902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4df2c-2bdb-4013-a785-b9ac34ca17dd None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:06.920691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4df2c-2bdb-4013-a785-b9ac34ca17dd None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:06.920877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4df2c-2bdb-4013-a785-b9ac34ca17dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:06.993776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f5c4df2c-2bdb-4013-a785-b9ac34ca17dd None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:06.995094 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f5c4df2c-2bdb-4013-a785-b9ac34ca17dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:07.003671 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:07.105220 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 680/1339] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:07.147718 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa1859-0b32-47ba-98f1-e8a2232b670d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:07.150173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-66aa1859-0b32-47ba-98f1-e8a2232b670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:07.268720 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa1859-0b32-47ba-98f1-e8a2232b670d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:07.351538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8aaa2-fa8c-4af7-822e-4026f9a246a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:07.352192 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8aaa2-fa8c-4af7-822e-4026f9a246a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:07.352471 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8aaa2-fa8c-4af7-822e-4026f9a246a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:07.352739 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8aaa2-fa8c-4af7-822e-4026f9a246a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:07.354556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-92e8aaa2-fa8c-4af7-822e-4026f9a246a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:07.393681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:07.479113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8aaa2-fa8c-4af7-822e-4026f9a246a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:07.480746 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8aaa2-fa8c-4af7-822e-4026f9a246a6 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:07.500655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 660/1340] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:11.823390 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5db58a-2151-4fde-b648-e5825b30b1ed None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:11.823976 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5db58a-2151-4fde-b648-e5825b30b1ed None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:11.823976 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5db58a-2151-4fde-b648-e5825b30b1ed None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:11.825259 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 681/1341] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:11.830702 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a2184-54e8-437f-839c-81f137edba36 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:11.831491 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a2184-54e8-437f-839c-81f137edba36 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:11.831598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a2184-54e8-437f-839c-81f137edba36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:11.906636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cb2a2184-54e8-437f-839c-81f137edba36 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:11.907755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cb2a2184-54e8-437f-839c-81f137edba36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:12.004740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:12.018711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 661/1342] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:12.057058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5db58a-2151-4fde-b648-e5825b30b1ed None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:12.059213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2a5db58a-2151-4fde-b648-e5825b30b1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:12.161575 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5db58a-2151-4fde-b648-e5825b30b1ed None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:12.165293 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0af280-a6f4-4a96-ad0f-6d0800743fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:12.166160 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0af280-a6f4-4a96-ad0f-6d0800743fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:12.166257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0af280-a6f4-4a96-ad0f-6d0800743fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:12.166674 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0af280-a6f4-4a96-ad0f-6d0800743fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:12.176533 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0af280-a6f4-4a96-ad0f-6d0800743fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:12.178027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0af280-a6f4-4a96-ad0f-6d0800743fc9 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:12.188110 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 682/1343] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:15.118849 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906075e4-21ed-477e-8a75-0e400ed6aeda None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:15.119452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906075e4-21ed-477e-8a75-0e400ed6aeda None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:15.119452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906075e4-21ed-477e-8a75-0e400ed6aeda None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:15.120767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 662/1344] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:15.126356 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45628a32-93dd-48c8-bcbd-90e95c3cf55e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:15.126882 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45628a32-93dd-48c8-bcbd-90e95c3cf55e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:15.126991 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45628a32-93dd-48c8-bcbd-90e95c3cf55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:15.157643 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-45628a32-93dd-48c8-bcbd-90e95c3cf55e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:15.158917 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-45628a32-93dd-48c8-bcbd-90e95c3cf55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:15.190201 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:15.242649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 683/1345] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:15.279775 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906075e4-21ed-477e-8a75-0e400ed6aeda None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:15.281669 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-906075e4-21ed-477e-8a75-0e400ed6aeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:15.295766 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906075e4-21ed-477e-8a75-0e400ed6aeda None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:15.299827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddcb61-3b6e-4a07-8709-b45650521094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:15.300489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddcb61-3b6e-4a07-8709-b45650521094 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:15.300774 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddcb61-3b6e-4a07-8709-b45650521094 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:15.301050 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddcb61-3b6e-4a07-8709-b45650521094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:15.311033 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddcb61-3b6e-4a07-8709-b45650521094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:15.312472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddcb61-3b6e-4a07-8709-b45650521094 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:15.322138 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 663/1346] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:19.463387 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280475f6-cd72-460b-8bba-bcbad8214d49 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:19.463950 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280475f6-cd72-460b-8bba-bcbad8214d49 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:19.463950 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280475f6-cd72-460b-8bba-bcbad8214d49 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:19.465320 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 684/1347] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:19.471160 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07457215-86a4-4aab-b789-e88c12dcff7f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:19.471654 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07457215-86a4-4aab-b789-e88c12dcff7f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:19.471781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07457215-86a4-4aab-b789-e88c12dcff7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:19.492189 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-07457215-86a4-4aab-b789-e88c12dcff7f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:19.493383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-07457215-86a4-4aab-b789-e88c12dcff7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:19.502463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 664/1348] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:19.549181 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280475f6-cd72-460b-8bba-bcbad8214d49 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:19.561995 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280475f6-cd72-460b-8bba-bcbad8214d49 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:19.566367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55fed1-02b8-4d6c-8f6f-99499eb94f37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:19.567103 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55fed1-02b8-4d6c-8f6f-99499eb94f37 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:19.567491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55fed1-02b8-4d6c-8f6f-99499eb94f37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:19.567813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55fed1-02b8-4d6c-8f6f-99499eb94f37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:19.580683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55fed1-02b8-4d6c-8f6f-99499eb94f37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:19.582552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55fed1-02b8-4d6c-8f6f-99499eb94f37 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:19.595011 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 685/1349] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:25.057196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1211ee5-7863-4663-91d6-6b2baf8fabec None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:25.057699 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1211ee5-7863-4663-91d6-6b2baf8fabec None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:25.057830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1211ee5-7863-4663-91d6-6b2baf8fabec None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:25.059148 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 665/1350] 10.222.0.61 () {54 vars in 921 bytes} [Thu May 26 21:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:25.064902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e11989-4387-43d1-8f23-6bac80fb921d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:25.065347 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e11989-4387-43d1-8f23-6bac80fb921d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:25.065656 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e11989-4387-43d1-8f23-6bac80fb921d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:25.146596 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-81e11989-4387-43d1-8f23-6bac80fb921d None None] MFA Rules not processed for user `e8952f35c21c4a2eaf1fbc601fe76242`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:25.147945 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-81e11989-4387-43d1-8f23-6bac80fb921d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:25.232025 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 686/1351] 10.222.0.61 () {58 vars in 1018 bytes} [Thu May 26 21:00:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:00:29.486484 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=13 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:29.517667 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907e356-795a-42b6-b1f9-88575f730212 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:29.517959 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907e356-795a-42b6-b1f9-88575f730212 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:29.518244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907e356-795a-42b6-b1f9-88575f730212 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:29.519824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 666/1352] 10.222.0.61 () {54 vars in 921 bytes} [Thu May 26 21:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:29.524694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbccb7-c64d-4a95-80da-3cd37ef70fb1 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:29.525174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbccb7-c64d-4a95-80da-3cd37ef70fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:29.525570 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbccb7-c64d-4a95-80da-3cd37ef70fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:29.544384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-dbcbccb7-c64d-4a95-80da-3cd37ef70fb1 None None] MFA Rules not processed for user `e8952f35c21c4a2eaf1fbc601fe76242`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:29.545692 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-dbcbccb7-c64d-4a95-80da-3cd37ef70fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:29.555424 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 687/1353] 10.222.0.61 () {58 vars in 1018 bytes} [Thu May 26 21:00:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:31.082852 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d5edf-7988-4e03-b43d-ec1ddf9f2d7f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:31.083442 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d5edf-7988-4e03-b43d-ec1ddf9f2d7f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:31.083442 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d5edf-7988-4e03-b43d-ec1ddf9f2d7f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:31.084775 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 667/1354] 10.222.0.61 () {54 vars in 921 bytes} [Thu May 26 21:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:31.090432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839eb15-5c9a-4e76-827b-153275b9ee71 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:31.091003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839eb15-5c9a-4e76-827b-153275b9ee71 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:31.091003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839eb15-5c9a-4e76-827b-153275b9ee71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:31.109440 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f839eb15-5c9a-4e76-827b-153275b9ee71 None None] MFA Rules not processed for user `e8952f35c21c4a2eaf1fbc601fe76242`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:31.110670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f839eb15-5c9a-4e76-827b-153275b9ee71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:31.121043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 688/1355] 10.222.0.61 () {58 vars in 1018 bytes} [Thu May 26 21:00:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:00:35.077910 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f8f10-88af-4938-95cd-c99570f9ddb9 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:35.077910 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f8f10-88af-4938-95cd-c99570f9ddb9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:35.077910 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f8f10-88af-4938-95cd-c99570f9ddb9 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:35.079663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 668/1356] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:35.086361 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b900a5a-804f-44cd-832d-6107ad2e6359 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:35.087298 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b900a5a-804f-44cd-832d-6107ad2e6359 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:35.087817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b900a5a-804f-44cd-832d-6107ad2e6359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:35.120110 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0b900a5a-804f-44cd-832d-6107ad2e6359 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:35.126966 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0b900a5a-804f-44cd-832d-6107ad2e6359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:35.146419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 689/1357] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:35.219004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a752da-5d5c-445e-ba05-e0eacacdfdd3 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:35.220636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a752da-5d5c-445e-ba05-e0eacacdfdd3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:35.221193 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a752da-5d5c-445e-ba05-e0eacacdfdd3 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:35.224434 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 669/1358] 10.222.0.61 () {54 vars in 961 bytes} [Thu May 26 21:00:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:35.232297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40e81-287f-43da-aa08-7543a73cc30c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:35.233520 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40e81-287f-43da-aa08-7543a73cc30c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:35.233826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40e81-287f-43da-aa08-7543a73cc30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:35.295285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:35.306265 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-08d40e81-287f-43da-aa08-7543a73cc30c None None] MFA Rules not processed for user `a99b767501244338bc48fb5428a589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:35.308903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-08d40e81-287f-43da-aa08-7543a73cc30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:35.400342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 690/1359] 10.222.0.61 () {58 vars in 1058 bytes} [Thu May 26 21:00:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:35.408486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a752da-5d5c-445e-ba05-e0eacacdfdd3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:35.423311 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a752da-5d5c-445e-ba05-e0eacacdfdd3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:35.428781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ffd4c-2a2d-4b9d-b03e-41f56b084ed2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:35.429501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ffd4c-2a2d-4b9d-b03e-41f56b084ed2 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:35.429943 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ffd4c-2a2d-4b9d-b03e-41f56b084ed2 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:35.430440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ffd4c-2a2d-4b9d-b03e-41f56b084ed2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:35.439369 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ffd4c-2a2d-4b9d-b03e-41f56b084ed2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:35.441162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ffd4c-2a2d-4b9d-b03e-41f56b084ed2 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:35.451345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 670/1360] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:37.882397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ddf92-6729-453d-a7b1-52e1b82f8130 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:37.882971 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ddf92-6729-453d-a7b1-52e1b82f8130 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:37.882971 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ddf92-6729-453d-a7b1-52e1b82f8130 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:37.884494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 691/1361] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:37.889990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d91fee-acbf-4d41-a146-3c57a6a6d8e2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:37.890448 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d91fee-acbf-4d41-a146-3c57a6a6d8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:37.890530 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d91fee-acbf-4d41-a146-3c57a6a6d8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:37.910178 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-41d91fee-acbf-4d41-a146-3c57a6a6d8e2 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:37.911368 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-41d91fee-acbf-4d41-a146-3c57a6a6d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:37.919598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 671/1362] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:37.965037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ddf92-6729-453d-a7b1-52e1b82f8130 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:37.980353 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ddf92-6729-453d-a7b1-52e1b82f8130 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:37.985923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00dcc2-ce34-44b0-9382-696a13cf5ac4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:37.986673 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00dcc2-ce34-44b0-9382-696a13cf5ac4 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:37.987050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00dcc2-ce34-44b0-9382-696a13cf5ac4 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:37.987435 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00dcc2-ce34-44b0-9382-696a13cf5ac4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:37.997152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00dcc2-ce34-44b0-9382-696a13cf5ac4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:37.998957 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00dcc2-ce34-44b0-9382-696a13cf5ac4 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:38.009872 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 692/1363] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:40.523251 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609c04e-2ce7-4df1-a9f1-b2fb000ed0a6 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:40.523738 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609c04e-2ce7-4df1-a9f1-b2fb000ed0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:40.523825 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609c04e-2ce7-4df1-a9f1-b2fb000ed0a6 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:40.525219 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 672/1364] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:40.537197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb9509-fe7e-4fce-857a-4a4b6853e37c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:40.537629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb9509-fe7e-4fce-857a-4a4b6853e37c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:40.537857 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb9509-fe7e-4fce-857a-4a4b6853e37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:40.571068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1ddb9509-fe7e-4fce-857a-4a4b6853e37c None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:40.573078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1ddb9509-fe7e-4fce-857a-4a4b6853e37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:40.593817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 693/1365] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:40.635869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284ba3e-e2ce-4a90-98ed-a60cd37d5a6e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:40.636064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284ba3e-e2ce-4a90-98ed-a60cd37d5a6e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:40.636330 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284ba3e-e2ce-4a90-98ed-a60cd37d5a6e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:40.637760 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 673/1366] 10.222.0.61 () {54 vars in 961 bytes} [Thu May 26 21:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:40.643370 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d069b-5516-4779-a4d0-d0b8ea6c2f9e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:40.643660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d069b-5516-4779-a4d0-d0b8ea6c2f9e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:40.643936 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d069b-5516-4779-a4d0-d0b8ea6c2f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:40.662451 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-183d069b-5516-4779-a4d0-d0b8ea6c2f9e None None] MFA Rules not processed for user `a99b767501244338bc48fb5428a589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:40.663634 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-183d069b-5516-4779-a4d0-d0b8ea6c2f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:40.673629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 694/1367] 10.222.0.61 () {58 vars in 1058 bytes} [Thu May 26 21:00:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:40.681726 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284ba3e-e2ce-4a90-98ed-a60cd37d5a6e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:40.698762 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284ba3e-e2ce-4a90-98ed-a60cd37d5a6e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:40.704850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b546c-226c-4aa9-be94-432329e87cd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:40.705518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b546c-226c-4aa9-be94-432329e87cd2 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:40.705782 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b546c-226c-4aa9-be94-432329e87cd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:40.706100 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b546c-226c-4aa9-be94-432329e87cd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:40.715167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b546c-226c-4aa9-be94-432329e87cd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:40.716811 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b546c-226c-4aa9-be94-432329e87cd2 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:40.726765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 674/1368] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:42.973245 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b4d3a-6640-4240-a3fd-6f0e21d3b4f6 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:42.973876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b4d3a-6640-4240-a3fd-6f0e21d3b4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:42.973876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b4d3a-6640-4240-a3fd-6f0e21d3b4f6 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:42.975332 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 695/1369] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:42.980952 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ba268-0a91-4c57-b8a3-8dc7769e21eb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:42.981417 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ba268-0a91-4c57-b8a3-8dc7769e21eb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:42.981510 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ba268-0a91-4c57-b8a3-8dc7769e21eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:43.001696 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5f3ba268-0a91-4c57-b8a3-8dc7769e21eb None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:43.002996 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5f3ba268-0a91-4c57-b8a3-8dc7769e21eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:43.012361 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 675/1370] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:43.058204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b4d3a-6640-4240-a3fd-6f0e21d3b4f6 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:43.072942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b4d3a-6640-4240-a3fd-6f0e21d3b4f6 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:43.078557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d1261-abbc-41f3-b874-bb728c4e1130 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:43.079308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d1261-abbc-41f3-b874-bb728c4e1130 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:43.079662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d1261-abbc-41f3-b874-bb728c4e1130 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:43.080026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d1261-abbc-41f3-b874-bb728c4e1130 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:43.090381 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d1261-abbc-41f3-b874-bb728c4e1130 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:43.092045 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d1261-abbc-41f3-b874-bb728c4e1130 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:43.103704 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 696/1371] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:43.284569 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb8e2-7e52-4b7c-ae1d-cc9fcba0ab5a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:43.284841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb8e2-7e52-4b7c-ae1d-cc9fcba0ab5a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:43.285104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb8e2-7e52-4b7c-ae1d-cc9fcba0ab5a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:43.286827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 676/1372] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:43.293362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4cfcd-d78c-44eb-b8c9-e200e76c5efb None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:43.293706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4cfcd-d78c-44eb-b8c9-e200e76c5efb None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:43.293982 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4cfcd-d78c-44eb-b8c9-e200e76c5efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:43.315046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-25e4cfcd-d78c-44eb-b8c9-e200e76c5efb None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:43.316335 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-25e4cfcd-d78c-44eb-b8c9-e200e76c5efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:43.325829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 697/1373] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:43.638756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1331b7-4f3a-47b6-afef-2f77592ef6b7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:43.638756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1331b7-4f3a-47b6-afef-2f77592ef6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:43.638756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1331b7-4f3a-47b6-afef-2f77592ef6b7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:43.641464 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 677/1374] 10.222.0.61 () {54 vars in 963 bytes} [Thu May 26 21:00:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:43.646806 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb99e7-986a-423f-b5e7-bb746367478b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:43.647288 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb99e7-986a-423f-b5e7-bb746367478b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:43.647727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb99e7-986a-423f-b5e7-bb746367478b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:43.703851 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b8eb99e7-986a-423f-b5e7-bb746367478b None None] MFA Rules not processed for user `e877e97dae064fe9ad3d378296b78ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:43.705370 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b8eb99e7-986a-423f-b5e7-bb746367478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:43.781982 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 698/1375] 10.222.0.61 () {58 vars in 1060 bytes} [Thu May 26 21:00:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:43.790869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1331b7-4f3a-47b6-afef-2f77592ef6b7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:43.802754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1331b7-4f3a-47b6-afef-2f77592ef6b7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:43.806852 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ebc07-e1bb-42c1-9fc7-cf3820fc4d98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:43.807603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ebc07-e1bb-42c1-9fc7-cf3820fc4d98 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:43.807949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ebc07-e1bb-42c1-9fc7-cf3820fc4d98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:43.808286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ebc07-e1bb-42c1-9fc7-cf3820fc4d98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:43.818376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ebc07-e1bb-42c1-9fc7-cf3820fc4d98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:43.819927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ebc07-e1bb-42c1-9fc7-cf3820fc4d98 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:43.830268 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 678/1376] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:45.342412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba75ce-d7ec-4f03-943e-10a909f88762 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:45.343022 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba75ce-d7ec-4f03-943e-10a909f88762 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:45.343022 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba75ce-d7ec-4f03-943e-10a909f88762 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:45.344739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 699/1377] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:45.350676 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3397a-e512-41ce-8519-3b556ec8fe42 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:45.351245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3397a-e512-41ce-8519-3b556ec8fe42 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:45.351245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3397a-e512-41ce-8519-3b556ec8fe42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:45.371725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f9f3397a-e512-41ce-8519-3b556ec8fe42 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:45.372960 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f9f3397a-e512-41ce-8519-3b556ec8fe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:45.382152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 679/1378] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:45.428210 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba75ce-d7ec-4f03-943e-10a909f88762 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:45.443599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba75ce-d7ec-4f03-943e-10a909f88762 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:45.449889 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d61067-9eee-48b3-8937-7e3020259263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:45.450585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61067-9eee-48b3-8937-7e3020259263 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:45.450867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61067-9eee-48b3-8937-7e3020259263 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:45.451134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61067-9eee-48b3-8937-7e3020259263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:45.460827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d61067-9eee-48b3-8937-7e3020259263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:45.462501 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d61067-9eee-48b3-8937-7e3020259263 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:45.467104 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:45.474393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 700/1379] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:47.740033 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf7947-111a-4518-b129-f360fbe7865b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:47.740595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf7947-111a-4518-b129-f360fbe7865b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:47.740595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf7947-111a-4518-b129-f360fbe7865b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:47.742024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 680/1380] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:47.747719 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032e259-3014-4af2-804b-a39753d062a9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:47.748172 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032e259-3014-4af2-804b-a39753d062a9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:47.748478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032e259-3014-4af2-804b-a39753d062a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:47.770616 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d032e259-3014-4af2-804b-a39753d062a9 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:47.772311 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d032e259-3014-4af2-804b-a39753d062a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:47.780927 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 701/1381] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:47.824988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf7947-111a-4518-b129-f360fbe7865b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:47.842004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf7947-111a-4518-b129-f360fbe7865b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:47.848200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ee4be-4769-4347-8b87-7c0e06a10055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:47.849165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ee4be-4769-4347-8b87-7c0e06a10055 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:47.849549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ee4be-4769-4347-8b87-7c0e06a10055 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:47.849955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ee4be-4769-4347-8b87-7c0e06a10055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:47.860000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ee4be-4769-4347-8b87-7c0e06a10055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:47.861623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ee4be-4769-4347-8b87-7c0e06a10055 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:47.871841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 681/1382] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:50.099720 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b77539-1e27-4145-821a-2c991f5cb07d None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:50.100257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b77539-1e27-4145-821a-2c991f5cb07d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:50.100443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b77539-1e27-4145-821a-2c991f5cb07d None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.101997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 702/1383] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:50.108119 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b26e63-45b9-4119-9440-3fb5d689dc0f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:50.108616 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b26e63-45b9-4119-9440-3fb5d689dc0f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:50.108741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b26e63-45b9-4119-9440-3fb5d689dc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.130155 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-70b26e63-45b9-4119-9440-3fb5d689dc0f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:50.131477 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-70b26e63-45b9-4119-9440-3fb5d689dc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:50.141232 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 682/1384] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:50.183552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b77539-1e27-4145-821a-2c991f5cb07d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:50.201838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b77539-1e27-4145-821a-2c991f5cb07d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:50.208053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa6328-39bd-4b22-a43b-4c2809244938 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:50.208706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa6328-39bd-4b22-a43b-4c2809244938 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:50.209014 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa6328-39bd-4b22-a43b-4c2809244938 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:50.209296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa6328-39bd-4b22-a43b-4c2809244938 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:50.219524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa6328-39bd-4b22-a43b-4c2809244938 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:50.221173 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa6328-39bd-4b22-a43b-4c2809244938 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:50.232657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 703/1385] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:52.529342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3d6c9-bc2c-42e3-b33a-7aa6996cc1c8 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:52.530096 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3d6c9-bc2c-42e3-b33a-7aa6996cc1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:52.530096 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3d6c9-bc2c-42e3-b33a-7aa6996cc1c8 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:52.531443 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 683/1386] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:52.537431 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574d955-9f90-4bfc-b9f7-f26239b1849f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:52.537908 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574d955-9f90-4bfc-b9f7-f26239b1849f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:52.538249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574d955-9f90-4bfc-b9f7-f26239b1849f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:52.561769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1574d955-9f90-4bfc-b9f7-f26239b1849f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:52.563398 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1574d955-9f90-4bfc-b9f7-f26239b1849f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:52.575065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 704/1387] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:52.620914 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3d6c9-bc2c-42e3-b33a-7aa6996cc1c8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:52.638107 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3d6c9-bc2c-42e3-b33a-7aa6996cc1c8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:52.645078 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd155b5-5b39-4379-98c2-2ef88e491967 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:52.646264 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd155b5-5b39-4379-98c2-2ef88e491967 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:52.646632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd155b5-5b39-4379-98c2-2ef88e491967 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:52.646986 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd155b5-5b39-4379-98c2-2ef88e491967 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:52.659388 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd155b5-5b39-4379-98c2-2ef88e491967 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:52.661530 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd155b5-5b39-4379-98c2-2ef88e491967 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:52.673944 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 684/1388] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:55.020476 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264a65d-fc11-4442-94ca-ab22c7917a0f None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:55.021177 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264a65d-fc11-4442-94ca-ab22c7917a0f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:55.021177 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264a65d-fc11-4442-94ca-ab22c7917a0f None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:55.023064 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 705/1389] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:55.029023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e404e4-16a1-4148-b5ff-9b7d38ea3bb8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:55.029608 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e404e4-16a1-4148-b5ff-9b7d38ea3bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:55.029608 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e404e4-16a1-4148-b5ff-9b7d38ea3bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:55.048814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-79e404e4-16a1-4148-b5ff-9b7d38ea3bb8 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:55.050095 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-79e404e4-16a1-4148-b5ff-9b7d38ea3bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:55.058159 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 685/1390] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:55.103510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264a65d-fc11-4442-94ca-ab22c7917a0f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:55.122816 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264a65d-fc11-4442-94ca-ab22c7917a0f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:55.130867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b903e-8da2-478b-9b36-caf4aa636da2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:55.131689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b903e-8da2-478b-9b36-caf4aa636da2 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:55.132304 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b903e-8da2-478b-9b36-caf4aa636da2 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:55.132651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b903e-8da2-478b-9b36-caf4aa636da2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:55.144573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b903e-8da2-478b-9b36-caf4aa636da2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:55.146975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b903e-8da2-478b-9b36-caf4aa636da2 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:55.163242 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 706/1391] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:00:57.442702 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101139f9-5bf5-4568-b3ba-be16b77640be None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:57.443355 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101139f9-5bf5-4568-b3ba-be16b77640be None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:57.443355 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101139f9-5bf5-4568-b3ba-be16b77640be None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:57.444649 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 686/1392] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:57.451200 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b031822-fd8a-4c70-948c-96367a0af874 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:57.451686 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b031822-fd8a-4c70-948c-96367a0af874 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:57.451686 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b031822-fd8a-4c70-948c-96367a0af874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:57.471556 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2b031822-fd8a-4c70-948c-96367a0af874 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:57.472768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2b031822-fd8a-4c70-948c-96367a0af874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:57.481323 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 707/1393] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:57.525501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101139f9-5bf5-4568-b3ba-be16b77640be None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:57.541270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101139f9-5bf5-4568-b3ba-be16b77640be None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:57.547274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0de8b4-fd84-45f7-b37d-e5bddd84de1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:57.547933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0de8b4-fd84-45f7-b37d-e5bddd84de1e service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:57.548219 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0de8b4-fd84-45f7-b37d-e5bddd84de1e service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:57.548628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0de8b4-fd84-45f7-b37d-e5bddd84de1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:57.558273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0de8b4-fd84-45f7-b37d-e5bddd84de1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:57.559915 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0de8b4-fd84-45f7-b37d-e5bddd84de1e service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:57.570494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 687/1394] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:59.426896 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab99111-fe7c-49b6-bd83-625ba4d6d4e6 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:59.427469 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab99111-fe7c-49b6-bd83-625ba4d6d4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:59.427578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab99111-fe7c-49b6-bd83-625ba4d6d4e6 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:59.428997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 708/1395] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:59.434770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161576e-aa44-43f0-a21c-24e752702e72 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:59.435180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161576e-aa44-43f0-a21c-24e752702e72 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:59.435334 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161576e-aa44-43f0-a21c-24e752702e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:59.455001 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3161576e-aa44-43f0-a21c-24e752702e72 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:59.456217 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3161576e-aa44-43f0-a21c-24e752702e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:59.465537 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 688/1396] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:59.521747 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def4c48-8b4e-4bfd-908f-bc4beee2de8a None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:59.522070 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def4c48-8b4e-4bfd-908f-bc4beee2de8a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:59.522325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def4c48-8b4e-4bfd-908f-bc4beee2de8a None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:59.523730 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 709/1397] 10.222.0.61 () {54 vars in 962 bytes} [Thu May 26 21:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:59.529080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93b990-5b42-4cb6-be9f-d3e738cf8cc9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:59.529372 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93b990-5b42-4cb6-be9f-d3e738cf8cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:59.529646 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93b990-5b42-4cb6-be9f-d3e738cf8cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:59.536093 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=55 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:00:59.585149 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0e93b990-5b42-4cb6-be9f-d3e738cf8cc9 None None] MFA Rules not processed for user `7d7e1c8c42cd4f6dab8b27829e5fc5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:59.586384 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0e93b990-5b42-4cb6-be9f-d3e738cf8cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:59.655191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 689/1398] 10.222.0.61 () {58 vars in 1059 bytes} [Thu May 26 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:00:59.664085 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def4c48-8b4e-4bfd-908f-bc4beee2de8a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:59.675071 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def4c48-8b4e-4bfd-908f-bc4beee2de8a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:59.678880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf8dee-f887-4b0f-8802-393d9a32e638 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7e1c8c42cd4f6dab8b27829e5fc5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:59.679476 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf8dee-f887-4b0f-8802-393d9a32e638 service glance] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:59.679755 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf8dee-f887-4b0f-8802-393d9a32e638 service glance] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:59.680026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf8dee-f887-4b0f-8802-393d9a32e638 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:59.689902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf8dee-f887-4b0f-8802-393d9a32e638 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:59.691353 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf8dee-f887-4b0f-8802-393d9a32e638 service glance] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:59.701228 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 710/1399] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:00:59.807363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be697a3-d2a1-463e-a163-a1d6dbdb0b4c None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:59.807653 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be697a3-d2a1-463e-a163-a1d6dbdb0b4c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:59.807933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be697a3-d2a1-463e-a163-a1d6dbdb0b4c None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:59.809386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 690/1400] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:00:59.814969 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593d5b1-efa4-4693-97e6-c4ad9aec66de None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:59.815326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593d5b1-efa4-4693-97e6-c4ad9aec66de None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:59.815682 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593d5b1-efa4-4693-97e6-c4ad9aec66de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:59.835028 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1593d5b1-efa4-4693-97e6-c4ad9aec66de None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:00:59.836255 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1593d5b1-efa4-4693-97e6-c4ad9aec66de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:00:59.845020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 711/1401] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:00:59.889277 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be697a3-d2a1-463e-a163-a1d6dbdb0b4c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:00:59.905171 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be697a3-d2a1-463e-a163-a1d6dbdb0b4c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:00:59.910700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c369435-5b40-4a6a-bb89-d03f263aec49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:00:59.911361 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c369435-5b40-4a6a-bb89-d03f263aec49 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:00:59.911650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c369435-5b40-4a6a-bb89-d03f263aec49 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:00:59.911929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c369435-5b40-4a6a-bb89-d03f263aec49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:00:59.920745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c369435-5b40-4a6a-bb89-d03f263aec49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:00:59.922397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c369435-5b40-4a6a-bb89-d03f263aec49 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:00:59.932333 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 691/1402] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:00.251693 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80d146-8b23-4118-ac35-28b2fa96c213 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:00.252000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80d146-8b23-4118-ac35-28b2fa96c213 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:00.252281 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80d146-8b23-4118-ac35-28b2fa96c213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:00.303938 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-5c80d146-8b23-4118-ac35-28b2fa96c213 None None] MFA Rules not processed for user `3953b14656774edb92da1ecdb4bbbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:00.305129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5c80d146-8b23-4118-ac35-28b2fa96c213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:00.373186 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 712/1403] 10.222.0.61 () {58 vars in 1009 bytes} [Thu May 26 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:00.418178 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5f594-6bb0-4eab-92fa-104cb64bfc5b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:00.418534 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5f594-6bb0-4eab-92fa-104cb64bfc5b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:00.418923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5f594-6bb0-4eab-92fa-104cb64bfc5b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:00.420397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 692/1404] 10.222.0.61 () {54 vars in 942 bytes} [Thu May 26 21:01:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:01:00.427120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f429837-70ef-4529-ade5-6664886561e7 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:00.427612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f429837-70ef-4529-ade5-6664886561e7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:00.427707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f429837-70ef-4529-ade5-6664886561e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:00.480596 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-8f429837-70ef-4529-ade5-6664886561e7 None None] MFA Rules not processed for user `57a63879ec1242d08bba1ccad6212788`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:00.481726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8f429837-70ef-4529-ade5-6664886561e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:00.519317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:00.559351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 713/1405] 10.222.0.61 () {58 vars in 1039 bytes} [Thu May 26 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:00.568847 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5f594-6bb0-4eab-92fa-104cb64bfc5b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:00.584732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5f594-6bb0-4eab-92fa-104cb64bfc5b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:00.590376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61019dd0-d538-473d-adf6-22f028d448c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a63879ec1242d08bba1ccad6212788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:00.591035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61019dd0-d538-473d-adf6-22f028d448c5 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:00.591314 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61019dd0-d538-473d-adf6-22f028d448c5 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:00.591583 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61019dd0-d538-473d-adf6-22f028d448c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:00.600203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61019dd0-d538-473d-adf6-22f028d448c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:00.601935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61019dd0-d538-473d-adf6-22f028d448c5 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:00.612641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 693/1406] 10.222.0.61 () {60 vars in 1384 bytes} [Thu May 26 21:01:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:01:02.182290 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec836f2f-4d04-4a03-8e58-8746a06cc8d7 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:02.183119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec836f2f-4d04-4a03-8e58-8746a06cc8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:02.183119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec836f2f-4d04-4a03-8e58-8746a06cc8d7 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:02.184550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 714/1407] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:01:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:02.190788 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef616e-6a68-4207-b619-f4809f911b4c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:02.191646 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef616e-6a68-4207-b619-f4809f911b4c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:02.192130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef616e-6a68-4207-b619-f4809f911b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:02.212774 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-08ef616e-6a68-4207-b619-f4809f911b4c None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:02.214335 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-08ef616e-6a68-4207-b619-f4809f911b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:02.225835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 694/1408] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:02.268774 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec836f2f-4d04-4a03-8e58-8746a06cc8d7 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:02.293133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec836f2f-4d04-4a03-8e58-8746a06cc8d7 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:02.308583 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f697d-6b4c-4fbc-8074-2e1fb3c0874a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:02.309414 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f697d-6b4c-4fbc-8074-2e1fb3c0874a service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:02.309770 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f697d-6b4c-4fbc-8074-2e1fb3c0874a service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:02.311447 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f697d-6b4c-4fbc-8074-2e1fb3c0874a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:02.335202 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f697d-6b4c-4fbc-8074-2e1fb3c0874a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:02.335202 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f697d-6b4c-4fbc-8074-2e1fb3c0874a service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:02.353377 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 715/1409] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:12.206488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=52 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:12.342251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=21 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:23.885652 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b45ff-b979-483c-b72b-78f343f67558 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:23.886527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b45ff-b979-483c-b72b-78f343f67558 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:23.887089 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b45ff-b979-483c-b72b-78f343f67558 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:23.888534 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 695/1410] 10.222.0.61 () {54 vars in 918 bytes} [Thu May 26 21:01:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:23.895904 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeff598-4fda-40dc-93b7-6d9978dcf9ba None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:23.896413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeff598-4fda-40dc-93b7-6d9978dcf9ba None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:23.896413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeff598-4fda-40dc-93b7-6d9978dcf9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:23.920446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6aeff598-4fda-40dc-93b7-6d9978dcf9ba None None] MFA Rules not processed for user `e8952f35c21c4a2eaf1fbc601fe76242`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:23.921642 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6aeff598-4fda-40dc-93b7-6d9978dcf9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:23.931903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 716/1411] 10.222.0.61 () {58 vars in 1015 bytes} [Thu May 26 21:01:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:23.951793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298b9c4-ca5d-4e65-90c6-bf167d7955f2 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:23.952081 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298b9c4-ca5d-4e65-90c6-bf167d7955f2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:23.952349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298b9c4-ca5d-4e65-90c6-bf167d7955f2 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:23.953728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 696/1412] 10.222.0.61 () {54 vars in 918 bytes} [Thu May 26 21:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:23.959030 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b60e44-3453-4428-9244-bb6d7747f1fc None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:23.959350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b60e44-3453-4428-9244-bb6d7747f1fc None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:23.959632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b60e44-3453-4428-9244-bb6d7747f1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:23.979388 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-53b60e44-3453-4428-9244-bb6d7747f1fc None None] MFA Rules not processed for user `a99b767501244338bc48fb5428a589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:23.980638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-53b60e44-3453-4428-9244-bb6d7747f1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:23.990601 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 717/1413] 10.222.0.61 () {58 vars in 1015 bytes} [Thu May 26 21:01:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:26.688406 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04f484-fe8d-4f5e-ab5e-b7276ce3fed5 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:26.689019 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04f484-fe8d-4f5e-ab5e-b7276ce3fed5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:26.689019 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04f484-fe8d-4f5e-ab5e-b7276ce3fed5 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:26.690359 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:26.698046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82711f50-944a-4f9b-b933-00bd6dbcccb2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:26.698793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82711f50-944a-4f9b-b933-00bd6dbcccb2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:26.698793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82711f50-944a-4f9b-b933-00bd6dbcccb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:26.718348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-82711f50-944a-4f9b-b933-00bd6dbcccb2 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:26.719557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-82711f50-944a-4f9b-b933-00bd6dbcccb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:26.728578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:01:26.772714 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04f484-fe8d-4f5e-ab5e-b7276ce3fed5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:26.787961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04f484-fe8d-4f5e-ab5e-b7276ce3fed5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:26.793622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb0e34-973b-42b3-954c-2b859c0acc6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:26.794302 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb0e34-973b-42b3-954c-2b859c0acc6c service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:26.794582 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb0e34-973b-42b3-954c-2b859c0acc6c service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:26.794850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb0e34-973b-42b3-954c-2b859c0acc6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:26.803031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb0e34-973b-42b3-954c-2b859c0acc6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:26.804610 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb0e34-973b-42b3-954c-2b859c0acc6c service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:26.814772 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 698/1416] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:27.776962 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224ee94-5b3a-488a-9588-6cf39d7e8895 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:27.777455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224ee94-5b3a-488a-9588-6cf39d7e8895 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:27.777562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224ee94-5b3a-488a-9588-6cf39d7e8895 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:27.778954 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:27.785178 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e260bd-e2c9-4d26-bccf-7be1eb1cbec5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:27.785840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e260bd-e2c9-4d26-bccf-7be1eb1cbec5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:27.785956 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e260bd-e2c9-4d26-bccf-7be1eb1cbec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:27.808014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f9e260bd-e2c9-4d26-bccf-7be1eb1cbec5 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:27.809219 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f9e260bd-e2c9-4d26-bccf-7be1eb1cbec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:27.818775 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:27.983274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224ee94-5b3a-488a-9588-6cf39d7e8895 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:28.002985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224ee94-5b3a-488a-9588-6cf39d7e8895 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:28.008855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa584e0-db43-4ba0-9db7-32a8f00def87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:28.009498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa584e0-db43-4ba0-9db7-32a8f00def87 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:28.009780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa584e0-db43-4ba0-9db7-32a8f00def87 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:28.010090 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa584e0-db43-4ba0-9db7-32a8f00def87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:28.018796 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa584e0-db43-4ba0-9db7-32a8f00def87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:28.020420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa584e0-db43-4ba0-9db7-32a8f00def87 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:28.030195 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 720/1419] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:28.981570 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c30a7-2d31-4445-aa38-922f128fc57f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:28.982184 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c30a7-2d31-4445-aa38-922f128fc57f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:28.982184 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c30a7-2d31-4445-aa38-922f128fc57f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:28.984193 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:01:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:28.991540 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da99c75-c833-4dbd-b3c4-1b8910ada05d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:28.991925 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da99c75-c833-4dbd-b3c4-1b8910ada05d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:28.992118 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da99c75-c833-4dbd-b3c4-1b8910ada05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:29.013087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-9da99c75-c833-4dbd-b3c4-1b8910ada05d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:29.014376 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9da99c75-c833-4dbd-b3c4-1b8910ada05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:29.024276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:29.176569 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c30a7-2d31-4445-aa38-922f128fc57f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:29.193839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c30a7-2d31-4445-aa38-922f128fc57f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:29.200567 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee3461-9ba1-489f-8247-853cb1b5ffef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:29.201215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee3461-9ba1-489f-8247-853cb1b5ffef service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:29.201497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee3461-9ba1-489f-8247-853cb1b5ffef service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:29.201776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee3461-9ba1-489f-8247-853cb1b5ffef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:29.210623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee3461-9ba1-489f-8247-853cb1b5ffef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:29.212210 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee3461-9ba1-489f-8247-853cb1b5ffef service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:29.221970 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 701/1422] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:30.126447 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbd8c6-1945-48d4-8b8e-c7285a66d8a3 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:30.127273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbd8c6-1945-48d4-8b8e-c7285a66d8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:30.127273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbd8c6-1945-48d4-8b8e-c7285a66d8a3 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:30.129378 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:01:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:30.137833 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625e575-c206-43ae-98d4-5eadb3274e98 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:30.138241 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625e575-c206-43ae-98d4-5eadb3274e98 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:30.138426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625e575-c206-43ae-98d4-5eadb3274e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:30.162201 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7625e575-c206-43ae-98d4-5eadb3274e98 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:30.163407 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7625e575-c206-43ae-98d4-5eadb3274e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:30.172064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:30.330966 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbd8c6-1945-48d4-8b8e-c7285a66d8a3 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:30.348341 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbd8c6-1945-48d4-8b8e-c7285a66d8a3 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:30.355316 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e0830-e8b4-4f53-b93f-ca5fbcfc43d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:30.355963 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e0830-e8b4-4f53-b93f-ca5fbcfc43d5 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:30.356243 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e0830-e8b4-4f53-b93f-ca5fbcfc43d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:30.356518 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e0830-e8b4-4f53-b93f-ca5fbcfc43d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:30.365559 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e0830-e8b4-4f53-b93f-ca5fbcfc43d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:30.367204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e0830-e8b4-4f53-b93f-ca5fbcfc43d5 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:30.376769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 723/1425] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:31.294112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e31c45-2a35-4a34-9631-17f8f6ca7cfe None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:31.294718 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e31c45-2a35-4a34-9631-17f8f6ca7cfe None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:31.294718 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e31c45-2a35-4a34-9631-17f8f6ca7cfe None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:31.296827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:01:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:31.305340 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378cbc4-c4d5-4908-a1d3-3f051c33383e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:31.305743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378cbc4-c4d5-4908-a1d3-3f051c33383e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:31.306036 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378cbc4-c4d5-4908-a1d3-3f051c33383e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:31.333521 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3378cbc4-c4d5-4908-a1d3-3f051c33383e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:31.334818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3378cbc4-c4d5-4908-a1d3-3f051c33383e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:31.345715 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:31.501374 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e31c45-2a35-4a34-9631-17f8f6ca7cfe None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:31.524556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e31c45-2a35-4a34-9631-17f8f6ca7cfe None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:31.531678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256cdb-2daf-4553-acec-87ab1255215d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:31.532336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256cdb-2daf-4553-acec-87ab1255215d service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:31.532624 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256cdb-2daf-4553-acec-87ab1255215d service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:31.532862 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256cdb-2daf-4553-acec-87ab1255215d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:31.541511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b256cdb-2daf-4553-acec-87ab1255215d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:31.543677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b256cdb-2daf-4553-acec-87ab1255215d service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:31.553748 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 704/1428] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:32.432091 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8bc95-85ec-4732-8d16-66b62458b387 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:32.432800 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8bc95-85ec-4732-8d16-66b62458b387 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:32.432800 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8bc95-85ec-4732-8d16-66b62458b387 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:32.434254 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:01:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:32.442496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f4b0a-aee1-4b19-be8b-d3c6db072397 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:32.442920 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f4b0a-aee1-4b19-be8b-d3c6db072397 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:32.443069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f4b0a-aee1-4b19-be8b-d3c6db072397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:32.470703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5d5f4b0a-aee1-4b19-be8b-d3c6db072397 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:32.471898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5d5f4b0a-aee1-4b19-be8b-d3c6db072397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:32.481869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:32.638284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8bc95-85ec-4732-8d16-66b62458b387 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:32.659563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8bc95-85ec-4732-8d16-66b62458b387 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:32.665742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6989d8-0fe9-4502-be1f-313bee660813 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:32.666433 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6989d8-0fe9-4502-be1f-313bee660813 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:32.666719 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6989d8-0fe9-4502-be1f-313bee660813 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:32.666995 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6989d8-0fe9-4502-be1f-313bee660813 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:32.676832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6989d8-0fe9-4502-be1f-313bee660813 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:32.678496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6989d8-0fe9-4502-be1f-313bee660813 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:32.688616 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 726/1431] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:33.533374 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46785934-9146-48cc-abde-f0295e9b7fce None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:33.533983 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46785934-9146-48cc-abde-f0295e9b7fce None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:33.533983 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46785934-9146-48cc-abde-f0295e9b7fce None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:33.535351 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:33.543355 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7af29b-f02c-418c-ab46-16c03b03ed12 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:33.543822 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7af29b-f02c-418c-ab46-16c03b03ed12 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:33.543924 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7af29b-f02c-418c-ab46-16c03b03ed12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:33.568396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1a7af29b-f02c-418c-ab46-16c03b03ed12 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:33.569607 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1a7af29b-f02c-418c-ab46-16c03b03ed12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:33.578616 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:01:33.731082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46785934-9146-48cc-abde-f0295e9b7fce None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:33.748229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46785934-9146-48cc-abde-f0295e9b7fce None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:33.754254 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8111f0-c20a-4c79-94b6-a681c4f56b6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:33.754904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8111f0-c20a-4c79-94b6-a681c4f56b6d service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:33.755207 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8111f0-c20a-4c79-94b6-a681c4f56b6d service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:33.755482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8111f0-c20a-4c79-94b6-a681c4f56b6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:33.765232 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8111f0-c20a-4c79-94b6-a681c4f56b6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:33.767039 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8111f0-c20a-4c79-94b6-a681c4f56b6d service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:33.777324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 707/1434] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:34.634765 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806450a-1cb4-4181-8504-2f6ddc7c0345 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:34.635239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806450a-1cb4-4181-8504-2f6ddc7c0345 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:34.635341 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806450a-1cb4-4181-8504-2f6ddc7c0345 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:34.636884 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:34.643058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4bd99-569c-491e-95d0-d07d5653e92e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:34.643755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4bd99-569c-491e-95d0-d07d5653e92e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:34.643845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4bd99-569c-491e-95d0-d07d5653e92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:34.666380 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0ac4bd99-569c-491e-95d0-d07d5653e92e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:34.667730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0ac4bd99-569c-491e-95d0-d07d5653e92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:34.676741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:34.830898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806450a-1cb4-4181-8504-2f6ddc7c0345 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:34.850817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806450a-1cb4-4181-8504-2f6ddc7c0345 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:34.856908 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0c77d-cc6f-426a-ad92-f1418bc83e73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:34.857567 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0c77d-cc6f-426a-ad92-f1418bc83e73 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:34.857901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0c77d-cc6f-426a-ad92-f1418bc83e73 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:34.858172 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0c77d-cc6f-426a-ad92-f1418bc83e73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:34.867707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0c77d-cc6f-426a-ad92-f1418bc83e73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:34.869246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0c77d-cc6f-426a-ad92-f1418bc83e73 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:34.879373 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 729/1437] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:35.751195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ba892-2334-4d0b-88c3-7ec43e41d033 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:35.751804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ba892-2334-4d0b-88c3-7ec43e41d033 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:35.751804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ba892-2334-4d0b-88c3-7ec43e41d033 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:35.754127 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:01:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:35.762024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91aaf9-96cb-4135-9cf9-ef5871b10ca9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:35.762456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91aaf9-96cb-4135-9cf9-ef5871b10ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:35.762605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91aaf9-96cb-4135-9cf9-ef5871b10ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:35.781716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1a91aaf9-96cb-4135-9cf9-ef5871b10ca9 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:35.782948 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1a91aaf9-96cb-4135-9cf9-ef5871b10ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:35.791907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:35.945752 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ba892-2334-4d0b-88c3-7ec43e41d033 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:35.961418 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ba892-2334-4d0b-88c3-7ec43e41d033 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:35.970226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedb9fc-8762-4ac2-9872-2cb1ca70bf6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:35.971199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedb9fc-8762-4ac2-9872-2cb1ca70bf6f service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:35.971582 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedb9fc-8762-4ac2-9872-2cb1ca70bf6f service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:35.971979 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedb9fc-8762-4ac2-9872-2cb1ca70bf6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:35.984171 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedb9fc-8762-4ac2-9872-2cb1ca70bf6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:35.985775 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedb9fc-8762-4ac2-9872-2cb1ca70bf6f service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:35.995785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 710/1440] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:01:38.059504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63169d-4c20-4a21-a3ee-efe29362cd2d None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:38.060072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63169d-4c20-4a21-a3ee-efe29362cd2d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:38.060072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63169d-4c20-4a21-a3ee-efe29362cd2d None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:38.061354 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:38.068672 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfac07-1605-41af-88a3-faf2cb62d277 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:38.069396 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfac07-1605-41af-88a3-faf2cb62d277 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:38.069574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfac07-1605-41af-88a3-faf2cb62d277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:38.090483 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7ebfac07-1605-41af-88a3-faf2cb62d277 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:38.091703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7ebfac07-1605-41af-88a3-faf2cb62d277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:38.100713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:38.140503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63169d-4c20-4a21-a3ee-efe29362cd2d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:38.158653 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63169d-4c20-4a21-a3ee-efe29362cd2d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:38.164778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940dbc4-77f3-41f7-a2c3-8de5b9f46746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:38.165643 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940dbc4-77f3-41f7-a2c3-8de5b9f46746 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:38.166033 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940dbc4-77f3-41f7-a2c3-8de5b9f46746 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:38.166354 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940dbc4-77f3-41f7-a2c3-8de5b9f46746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:38.176902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940dbc4-77f3-41f7-a2c3-8de5b9f46746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:38.178420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940dbc4-77f3-41f7-a2c3-8de5b9f46746 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:38.189098 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 732/1443] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:40.624866 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc24336-5658-4586-a24d-29c9e0061b99 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:40.625481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc24336-5658-4586-a24d-29c9e0061b99 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:40.625481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc24336-5658-4586-a24d-29c9e0061b99 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:40.626868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:40.632829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b27bd7-3c22-4561-9933-2485d411cd1a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:40.633298 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b27bd7-3c22-4561-9933-2485d411cd1a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:40.633402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b27bd7-3c22-4561-9933-2485d411cd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:40.659505 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-77b27bd7-3c22-4561-9933-2485d411cd1a None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:40.660738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-77b27bd7-3c22-4561-9933-2485d411cd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:40.670453 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:40.708360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc24336-5658-4586-a24d-29c9e0061b99 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:40.720111 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc24336-5658-4586-a24d-29c9e0061b99 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:40.724221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30363d48-1bf8-4f6e-897f-f47cda5b4a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:40.724871 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30363d48-1bf8-4f6e-897f-f47cda5b4a0d service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:40.725155 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30363d48-1bf8-4f6e-897f-f47cda5b4a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:40.725433 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30363d48-1bf8-4f6e-897f-f47cda5b4a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:40.734834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30363d48-1bf8-4f6e-897f-f47cda5b4a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:40.736272 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30363d48-1bf8-4f6e-897f-f47cda5b4a0d service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:40.745747 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 713/1446] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:43.266257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544c52a-6e28-4be6-803a-aff89d8affc5 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:43.266941 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544c52a-6e28-4be6-803a-aff89d8affc5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:43.266941 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544c52a-6e28-4be6-803a-aff89d8affc5 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:43.268822 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:01:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:43.274334 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f5d38-8425-4929-a507-e62752bc4cc9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:43.274782 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f5d38-8425-4929-a507-e62752bc4cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:43.274931 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f5d38-8425-4929-a507-e62752bc4cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:43.298557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-465f5d38-8425-4929-a507-e62752bc4cc9 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:43.299765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-465f5d38-8425-4929-a507-e62752bc4cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:43.308791 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:43.347924 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544c52a-6e28-4be6-803a-aff89d8affc5 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:43.360318 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544c52a-6e28-4be6-803a-aff89d8affc5 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:43.364869 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a13017-b6a5-40ba-bc52-286a22aaf6df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:43.365512 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a13017-b6a5-40ba-bc52-286a22aaf6df service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:43.365815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a13017-b6a5-40ba-bc52-286a22aaf6df service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:43.366095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a13017-b6a5-40ba-bc52-286a22aaf6df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:43.376066 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a13017-b6a5-40ba-bc52-286a22aaf6df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:43.377520 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a13017-b6a5-40ba-bc52-286a22aaf6df service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:43.387304 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 735/1449] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:45.716914 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f18f4-a6e9-4469-89bd-268594311ced None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:45.717521 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f18f4-a6e9-4469-89bd-268594311ced None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:45.717521 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f18f4-a6e9-4469-89bd-268594311ced None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:45.718950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:45.724712 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cc7dd-5f12-48d6-9207-a7a74a1d5832 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:45.725186 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cc7dd-5f12-48d6-9207-a7a74a1d5832 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:45.725287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cc7dd-5f12-48d6-9207-a7a74a1d5832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:45.744784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-200cc7dd-5f12-48d6-9207-a7a74a1d5832 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:45.746551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-200cc7dd-5f12-48d6-9207-a7a74a1d5832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:45.755358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:45.794986 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f18f4-a6e9-4469-89bd-268594311ced None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:45.806618 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f18f4-a6e9-4469-89bd-268594311ced None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:45.811041 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3814210-93fb-4566-9dac-5c06109d9d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:45.811692 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3814210-93fb-4566-9dac-5c06109d9d1b service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:45.811973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3814210-93fb-4566-9dac-5c06109d9d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:45.812249 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3814210-93fb-4566-9dac-5c06109d9d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:45.822425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3814210-93fb-4566-9dac-5c06109d9d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:45.824115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3814210-93fb-4566-9dac-5c06109d9d1b service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:45.834367 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 716/1452] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:48.072298 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54263-e25f-4c69-9bba-de0165941016 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:48.072855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54263-e25f-4c69-9bba-de0165941016 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:48.072855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54263-e25f-4c69-9bba-de0165941016 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:48.074553 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:48.084227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ecae2-1cc7-43b3-9a03-604879d98832 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:48.084927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ecae2-1cc7-43b3-9a03-604879d98832 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:48.085066 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ecae2-1cc7-43b3-9a03-604879d98832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:48.105516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-813ecae2-1cc7-43b3-9a03-604879d98832 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:48.106767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-813ecae2-1cc7-43b3-9a03-604879d98832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:48.116239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:48.161640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f54263-e25f-4c69-9bba-de0165941016 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:48.174165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f54263-e25f-4c69-9bba-de0165941016 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:48.178223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730df0b-66a3-4d2a-8dee-56043d032c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:48.178869 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730df0b-66a3-4d2a-8dee-56043d032c29 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:48.179159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730df0b-66a3-4d2a-8dee-56043d032c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:48.179438 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730df0b-66a3-4d2a-8dee-56043d032c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:48.189015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730df0b-66a3-4d2a-8dee-56043d032c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:48.190552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730df0b-66a3-4d2a-8dee-56043d032c29 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:48.200218 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 738/1455] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:50.438045 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bf9bf-6cdd-43b2-9e97-897921b16773 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:50.438670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bf9bf-6cdd-43b2-9e97-897921b16773 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:50.438670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bf9bf-6cdd-43b2-9e97-897921b16773 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:50.439995 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:50.446342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b05c2-877b-4b34-a0a6-c35cc48a4af2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:50.446780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b05c2-877b-4b34-a0a6-c35cc48a4af2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:50.446890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b05c2-877b-4b34-a0a6-c35cc48a4af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:50.472507 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-af8b05c2-877b-4b34-a0a6-c35cc48a4af2 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:50.474395 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-af8b05c2-877b-4b34-a0a6-c35cc48a4af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:50.486375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:50.528933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bf9bf-6cdd-43b2-9e97-897921b16773 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:50.549674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bf9bf-6cdd-43b2-9e97-897921b16773 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:50.556593 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c80b4-f8ab-4ce7-b01f-e225ac58c3ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:50.557529 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c80b4-f8ab-4ce7-b01f-e225ac58c3ba service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:50.558427 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c80b4-f8ab-4ce7-b01f-e225ac58c3ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:50.558713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c80b4-f8ab-4ce7-b01f-e225ac58c3ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:50.568387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c80b4-f8ab-4ce7-b01f-e225ac58c3ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:50.569861 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c80b4-f8ab-4ce7-b01f-e225ac58c3ba service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:50.580030 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 719/1458] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:52.805246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918b090-f677-4aa9-b227-16457af5a65f None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:52.805838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918b090-f677-4aa9-b227-16457af5a65f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:52.805838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918b090-f677-4aa9-b227-16457af5a65f None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:52.807197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:52.814129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f61603-e5b0-4081-9d86-7e6c9d818d7f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:52.814891 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f61603-e5b0-4081-9d86-7e6c9d818d7f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:52.814992 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f61603-e5b0-4081-9d86-7e6c9d818d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:52.826087 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=70 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:52.845056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-12f61603-e5b0-4081-9d86-7e6c9d818d7f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:52.846320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-12f61603-e5b0-4081-9d86-7e6c9d818d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:52.855802 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:52.896514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918b090-f677-4aa9-b227-16457af5a65f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:52.904745 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=73 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:01:52.911473 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918b090-f677-4aa9-b227-16457af5a65f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:52.915545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e031e-51f1-41d9-b716-cbcb2848fdbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:52.916202 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e031e-51f1-41d9-b716-cbcb2848fdbd service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:52.916487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e031e-51f1-41d9-b716-cbcb2848fdbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:52.916767 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e031e-51f1-41d9-b716-cbcb2848fdbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:52.926565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e031e-51f1-41d9-b716-cbcb2848fdbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:52.928080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e031e-51f1-41d9-b716-cbcb2848fdbd service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:52.938296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 741/1461] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:55.168842 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78f02b-fb46-4a6b-802c-6d5c271f44cf None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:55.169406 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78f02b-fb46-4a6b-802c-6d5c271f44cf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:55.169406 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78f02b-fb46-4a6b-802c-6d5c271f44cf None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:55.171072 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:01:55.178204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e0df9-9538-4075-b030-9739a5f996ee None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:55.178667 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e0df9-9538-4075-b030-9739a5f996ee None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:55.178769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e0df9-9538-4075-b030-9739a5f996ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:55.197813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1c6e0df9-9538-4075-b030-9739a5f996ee None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:55.199881 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1c6e0df9-9538-4075-b030-9739a5f996ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:55.208398 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:55.257371 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78f02b-fb46-4a6b-802c-6d5c271f44cf None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:55.270764 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78f02b-fb46-4a6b-802c-6d5c271f44cf None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:55.274887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f036f-5858-401d-b93b-92a0995d4169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:55.275533 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f036f-5858-401d-b93b-92a0995d4169 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:55.275815 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f036f-5858-401d-b93b-92a0995d4169 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:55.276089 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f036f-5858-401d-b93b-92a0995d4169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:55.286089 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f036f-5858-401d-b93b-92a0995d4169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:55.287537 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f036f-5858-401d-b93b-92a0995d4169 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:55.297824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 722/1464] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:57.502978 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ae6cc-1caf-4461-8669-29875868a61d None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:57.503923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ae6cc-1caf-4461-8669-29875868a61d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:57.503923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ae6cc-1caf-4461-8669-29875868a61d None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:57.506163 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:01:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:57.514448 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19007292-3dd1-40c5-9253-d1e0221f08ca None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:57.514877 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19007292-3dd1-40c5-9253-d1e0221f08ca None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:57.515003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19007292-3dd1-40c5-9253-d1e0221f08ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:57.540805 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-19007292-3dd1-40c5-9253-d1e0221f08ca None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:57.542187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-19007292-3dd1-40c5-9253-d1e0221f08ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:57.550741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:01:57.595235 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ae6cc-1caf-4461-8669-29875868a61d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:01:57.612376 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ae6cc-1caf-4461-8669-29875868a61d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:01:57.618194 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b514a-51f0-4952-9bb0-669cab461c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:01:57.619149 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b514a-51f0-4952-9bb0-669cab461c62 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:57.619562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b514a-51f0-4952-9bb0-669cab461c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:57.619963 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b514a-51f0-4952-9bb0-669cab461c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:57.635332 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b514a-51f0-4952-9bb0-669cab461c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:01:57.637049 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b514a-51f0-4952-9bb0-669cab461c62 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:01:57.646982 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 744/1467] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:01:59.950463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94966d9-f89f-4990-ae9f-7da09542c59a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:59.951073 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94966d9-f89f-4990-ae9f-7da09542c59a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:59.951073 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94966d9-f89f-4990-ae9f-7da09542c59a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:59.952455 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:01:59.959328 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c08e79-c711-40c5-892d-f6e6f16e861e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:01:59.960092 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c08e79-c711-40c5-892d-f6e6f16e861e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:01:59.960281 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c08e79-c711-40c5-892d-f6e6f16e861e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:01:59.986286 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-21c08e79-c711-40c5-892d-f6e6f16e861e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:01:59.987617 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-21c08e79-c711-40c5-892d-f6e6f16e861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:01:59.996325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:02:00.034301 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94966d9-f89f-4990-ae9f-7da09542c59a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:00.049393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94966d9-f89f-4990-ae9f-7da09542c59a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:00.054004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e067b-f214-44f6-a3cb-799765db9902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:00.054679 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e067b-f214-44f6-a3cb-799765db9902 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:00.054967 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e067b-f214-44f6-a3cb-799765db9902 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:00.055211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e067b-f214-44f6-a3cb-799765db9902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:00.065901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e067b-f214-44f6-a3cb-799765db9902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:00.067372 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e067b-f214-44f6-a3cb-799765db9902 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:00.077840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 725/1470] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:02:09.980637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=17 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:10.073139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=17 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:33.089211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c41e3-1d01-46ac-92d3-46190c86f47a None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:33.090189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c41e3-1d01-46ac-92d3-46190c86f47a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:33.090189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c41e3-1d01-46ac-92d3-46190c86f47a None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:33.092351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 746/1471] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:02:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:33.097586 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016b013-811a-4b06-8b8d-e5adabc90b7f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:33.098087 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016b013-811a-4b06-8b8d-e5adabc90b7f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:33.098183 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016b013-811a-4b06-8b8d-e5adabc90b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:33.117669 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b016b013-811a-4b06-8b8d-e5adabc90b7f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:33.118872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b016b013-811a-4b06-8b8d-e5adabc90b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:33.127572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 726/1472] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:02:33.178225 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e214a-68ae-429f-bbd8-a98d266b6026 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:33.178636 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e214a-68ae-429f-bbd8-a98d266b6026 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:33.179032 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e214a-68ae-429f-bbd8-a98d266b6026 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:33.181242 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 747/1473] 10.222.0.61 () {54 vars in 962 bytes} [Thu May 26 21:02:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:33.186909 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3678f60-2df8-481f-9f63-d8b6958794f1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:33.187199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3678f60-2df8-481f-9f63-d8b6958794f1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:33.187476 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3678f60-2df8-481f-9f63-d8b6958794f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:33.206032 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e3678f60-2df8-481f-9f63-d8b6958794f1 None None] MFA Rules not processed for user `7d7e1c8c42cd4f6dab8b27829e5fc5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:33.207208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e3678f60-2df8-481f-9f63-d8b6958794f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:33.214458 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 727/1474] 10.222.0.61 () {58 vars in 1059 bytes} [Thu May 26 21:02:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:02:33.221838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e214a-68ae-429f-bbd8-a98d266b6026 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:33.234091 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e214a-68ae-429f-bbd8-a98d266b6026 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:33.237878 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235232d9-1830-4bac-b47e-a98e8e6184db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7e1c8c42cd4f6dab8b27829e5fc5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:33.238504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235232d9-1830-4bac-b47e-a98e8e6184db service glance] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:33.238789 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235232d9-1830-4bac-b47e-a98e8e6184db service glance] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:33.239065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235232d9-1830-4bac-b47e-a98e8e6184db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:33.248405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235232d9-1830-4bac-b47e-a98e8e6184db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:33.249859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235232d9-1830-4bac-b47e-a98e8e6184db service glance] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:33.259225 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 748/1475] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:02:35.520142 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2c2ab-62e1-451a-b7ce-c773e9befb20 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:35.520737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2c2ab-62e1-451a-b7ce-c773e9befb20 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:35.520737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2c2ab-62e1-451a-b7ce-c773e9befb20 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:35.522865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 728/1476] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:02:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:35.530798 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de358b-1025-4907-b0ac-55d45286b32f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:35.531200 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de358b-1025-4907-b0ac-55d45286b32f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:35.531481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de358b-1025-4907-b0ac-55d45286b32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:35.559170 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-48de358b-1025-4907-b0ac-55d45286b32f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:35.560382 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-48de358b-1025-4907-b0ac-55d45286b32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:35.569915 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 749/1477] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:02:35.594824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2c2ab-62e1-451a-b7ce-c773e9befb20 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:35.610320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2c2ab-62e1-451a-b7ce-c773e9befb20 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:35.615939 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb7aab-9910-47a6-9d51-0d2ffcf96d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:35.616629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb7aab-9910-47a6-9d51-0d2ffcf96d60 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:35.616917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb7aab-9910-47a6-9d51-0d2ffcf96d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:35.617216 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb7aab-9910-47a6-9d51-0d2ffcf96d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:35.618108 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb7aab-9910-47a6-9d51-0d2ffcf96d60 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:35.620091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-90cb7aab-9910-47a6-9d51-0d2ffcf96d60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:02:35.620091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: warnings.warn(msg) May 26 21:02:35.620091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: May 26 21:02:35.621435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb7aab-9910-47a6-9d51-0d2ffcf96d60 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:35.643510 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 729/1478] 10.222.0.61 () {56 vars in 1108 bytes} [Thu May 26 21:02:35 2022] GET /identity/v3/projects => generated 2553 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:02:37.864198 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99aed1-6a29-46ea-80e5-821641e8d70b None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:37.864787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99aed1-6a29-46ea-80e5-821641e8d70b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:37.864787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99aed1-6a29-46ea-80e5-821641e8d70b None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:37.866059 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 750/1479] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:37.872389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6ab34-e0ef-48b7-821a-3ecf51cf4661 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:37.873091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6ab34-e0ef-48b7-821a-3ecf51cf4661 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:37.873231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6ab34-e0ef-48b7-821a-3ecf51cf4661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:37.901421 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bcb6ab34-e0ef-48b7-821a-3ecf51cf4661 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:37.902679 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bcb6ab34-e0ef-48b7-821a-3ecf51cf4661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:37.910702 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 730/1480] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:02:37.953929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99aed1-6a29-46ea-80e5-821641e8d70b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:37.969942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99aed1-6a29-46ea-80e5-821641e8d70b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:37.977948 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88da8b-44d3-4653-840c-6657b59b2104 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:37.978888 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88da8b-44d3-4653-840c-6657b59b2104 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:37.979262 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88da8b-44d3-4653-840c-6657b59b2104 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:37.979559 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88da8b-44d3-4653-840c-6657b59b2104 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:37.988752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88da8b-44d3-4653-840c-6657b59b2104 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:37.990437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88da8b-44d3-4653-840c-6657b59b2104 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:38.000614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 751/1481] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:02:40.390786 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ccbbe-cf31-4c24-b47d-9fcc4fec1245 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:40.391352 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ccbbe-cf31-4c24-b47d-9fcc4fec1245 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:40.391352 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ccbbe-cf31-4c24-b47d-9fcc4fec1245 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:40.392676 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 731/1482] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:40.399193 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f7db1-f21d-4f84-9fb8-fbcebaef354d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:40.399918 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f7db1-f21d-4f84-9fb8-fbcebaef354d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:40.400108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f7db1-f21d-4f84-9fb8-fbcebaef354d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:40.425017 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-963f7db1-f21d-4f84-9fb8-fbcebaef354d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:40.426273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-963f7db1-f21d-4f84-9fb8-fbcebaef354d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:40.434999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 752/1483] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:02:40.474381 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ccbbe-cf31-4c24-b47d-9fcc4fec1245 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:40.488466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ccbbe-cf31-4c24-b47d-9fcc4fec1245 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:40.492536 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787048fa-c46e-47a4-97e1-e3d4d9420951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:40.493183 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787048fa-c46e-47a4-97e1-e3d4d9420951 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:40.493469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787048fa-c46e-47a4-97e1-e3d4d9420951 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:40.493746 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787048fa-c46e-47a4-97e1-e3d4d9420951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:40.504259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787048fa-c46e-47a4-97e1-e3d4d9420951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:40.505705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787048fa-c46e-47a4-97e1-e3d4d9420951 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:40.515816 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 732/1484] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:02:42.743842 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ff4e3-c25d-4025-8ebf-f3e01e5ce1fd None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:42.744426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ff4e3-c25d-4025-8ebf-f3e01e5ce1fd None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:42.744426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ff4e3-c25d-4025-8ebf-f3e01e5ce1fd None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:42.746811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 753/1485] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:02:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:42.754986 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779db66-c50e-435c-a954-daa9cd4840d1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:42.755462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779db66-c50e-435c-a954-daa9cd4840d1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:42.755556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779db66-c50e-435c-a954-daa9cd4840d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:42.774469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8779db66-c50e-435c-a954-daa9cd4840d1 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:42.775666 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8779db66-c50e-435c-a954-daa9cd4840d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:42.784658 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 733/1486] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:02:42.828021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ff4e3-c25d-4025-8ebf-f3e01e5ce1fd None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:42.843653 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ff4e3-c25d-4025-8ebf-f3e01e5ce1fd None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:42.847316 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10d880-0cdb-4570-a19c-91c6a8f20ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:42.847964 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10d880-0cdb-4570-a19c-91c6a8f20ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:42.848251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10d880-0cdb-4570-a19c-91c6a8f20ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:42.848519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10d880-0cdb-4570-a19c-91c6a8f20ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:42.857754 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10d880-0cdb-4570-a19c-91c6a8f20ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:42.859242 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10d880-0cdb-4570-a19c-91c6a8f20ce0 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:42.868455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 754/1487] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:02:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:02:45.182403 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866c3cf-150c-4b8b-8fb4-31bf4db15236 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:45.183143 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866c3cf-150c-4b8b-8fb4-31bf4db15236 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:45.183262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866c3cf-150c-4b8b-8fb4-31bf4db15236 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:45.185139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 734/1488] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:02:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:45.190892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea92c46-ea5c-43ef-b8c0-8cd5de0aca14 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:45.191407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea92c46-ea5c-43ef-b8c0-8cd5de0aca14 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:45.191630 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea92c46-ea5c-43ef-b8c0-8cd5de0aca14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:45.220809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1ea92c46-ea5c-43ef-b8c0-8cd5de0aca14 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:45.222564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1ea92c46-ea5c-43ef-b8c0-8cd5de0aca14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:45.236746 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 755/1489] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:02:45.276571 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866c3cf-150c-4b8b-8fb4-31bf4db15236 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:45.289376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866c3cf-150c-4b8b-8fb4-31bf4db15236 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:45.293989 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aed870-b567-4111-bd29-fc49e68f6703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:45.294696 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aed870-b567-4111-bd29-fc49e68f6703 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:45.294974 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aed870-b567-4111-bd29-fc49e68f6703 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:45.295235 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aed870-b567-4111-bd29-fc49e68f6703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:45.305646 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aed870-b567-4111-bd29-fc49e68f6703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:45.307130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aed870-b567-4111-bd29-fc49e68f6703 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:45.317079 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 735/1490] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:02:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:02:47.693593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0fabb-fab4-48d5-b4d2-90354381df31 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:47.694229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0fabb-fab4-48d5-b4d2-90354381df31 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:47.694229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0fabb-fab4-48d5-b4d2-90354381df31 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:47.695547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 756/1491] 10.222.0.61 () {54 vars in 926 bytes} [Thu May 26 21:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:02:47.701386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd151bb-c369-4014-8372-5636c2a2aba1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:47.701879 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd151bb-c369-4014-8372-5636c2a2aba1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:47.701985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd151bb-c369-4014-8372-5636c2a2aba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:47.730201 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8fd151bb-c369-4014-8372-5636c2a2aba1 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:02:47.731456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8fd151bb-c369-4014-8372-5636c2a2aba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:02:47.740266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 736/1492] 10.222.0.61 () {58 vars in 1023 bytes} [Thu May 26 21:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:02:47.779821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0fabb-fab4-48d5-b4d2-90354381df31 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:02:47.795684 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0fabb-fab4-48d5-b4d2-90354381df31 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:02:47.799651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba474c-9502-4b69-85cc-107fbb430156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:02:47.800304 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba474c-9502-4b69-85cc-107fbb430156 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:02:47.800581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba474c-9502-4b69-85cc-107fbb430156 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:02:47.800853 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba474c-9502-4b69-85cc-107fbb430156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:02:47.810670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba474c-9502-4b69-85cc-107fbb430156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:02:47.812129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba474c-9502-4b69-85cc-107fbb430156 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:02:47.822046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 757/1493] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:02:57.721476 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=33 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:02:57.817458 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=33 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:04:30.667636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804c66d-5914-41cd-94f6-0e71baec662d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:04:30.668525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804c66d-5914-41cd-94f6-0e71baec662d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:04:30.668525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804c66d-5914-41cd-94f6-0e71baec662d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:04:30.695861 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9804c66d-5914-41cd-94f6-0e71baec662d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:04:30.697740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9804c66d-5914-41cd-94f6-0e71baec662d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:04:30.708205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 737/1494] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:04:30.717853 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496c6dc-8642-437d-8b39-052ba80ac400 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:04:30.718418 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496c6dc-8642-437d-8b39-052ba80ac400 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:04:30.718418 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496c6dc-8642-437d-8b39-052ba80ac400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:04:30.738238 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-c496c6dc-8642-437d-8b39-052ba80ac400 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:04:30.739472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c496c6dc-8642-437d-8b39-052ba80ac400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:04:30.748975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 758/1495] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:04:30.753721 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804c66d-5914-41cd-94f6-0e71baec662d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:04:30.763969 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804c66d-5914-41cd-94f6-0e71baec662d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:04:30.769698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b5a7e-ee75-4a35-bd16-b06fb9331ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:04:30.770437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b5a7e-ee75-4a35-bd16-b06fb9331ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:04:30.770706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b5a7e-ee75-4a35-bd16-b06fb9331ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:04:30.770995 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b5a7e-ee75-4a35-bd16-b06fb9331ed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:04:30.771997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b5a7e-ee75-4a35-bd16-b06fb9331ed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:04:30.772118 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b5a7e-ee75-4a35-bd16-b06fb9331ed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:04:30.773273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-592b5a7e-ee75-4a35-bd16-b06fb9331ed8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:04:30.773273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: warnings.warn(msg) May 26 21:04:30.773273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: May 26 21:04:30.774173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b5a7e-ee75-4a35-bd16-b06fb9331ed8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:04:30.786894 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 738/1496] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:04:30.795119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496c6dc-8642-437d-8b39-052ba80ac400 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:04:30.804209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496c6dc-8642-437d-8b39-052ba80ac400 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:04:30.809562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f9735-e126-475d-bed1-2e400b41e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:04:30.810259 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f9735-e126-475d-bed1-2e400b41e5be admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:04:30.810532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f9735-e126-475d-bed1-2e400b41e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:04:30.810824 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f9735-e126-475d-bed1-2e400b41e5be admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:04:30.811500 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f9735-e126-475d-bed1-2e400b41e5be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:04:30.813319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: WARNING py.warnings [None req-2f2f9735-e126-475d-bed1-2e400b41e5be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:04:30.813319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: warnings.warn(msg) May 26 21:04:30.813319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: May 26 21:04:30.814564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f9735-e126-475d-bed1-2e400b41e5be admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:04:30.853121 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 759/1497] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:04:30 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:04:30.858179 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b5a7e-ee75-4a35-bd16-b06fb9331ed8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:04:30.869546 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b5a7e-ee75-4a35-bd16-b06fb9331ed8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:04:30.931350 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752cf2e-41cf-430f-8615-a0b388a124af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:04:30.932032 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752cf2e-41cf-430f-8615-a0b388a124af admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:04:30.932315 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752cf2e-41cf-430f-8615-a0b388a124af admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:04:30.932586 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752cf2e-41cf-430f-8615-a0b388a124af admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:04:30.933270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752cf2e-41cf-430f-8615-a0b388a124af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:04:30.934611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-8752cf2e-41cf-430f-8615-a0b388a124af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:04:30.934611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: warnings.warn(msg) May 26 21:04:30.934611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: May 26 21:04:30.936055 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752cf2e-41cf-430f-8615-a0b388a124af admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:04:30.958695 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 739/1498] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:04:30 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:04:30.963082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f9735-e126-475d-bed1-2e400b41e5be admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:04:30.974295 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f9735-e126-475d-bed1-2e400b41e5be admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:04:30.979507 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109bf83-1b2d-4c49-a129-28427f596592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:04:30.980173 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109bf83-1b2d-4c49-a129-28427f596592 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:04:30.980673 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109bf83-1b2d-4c49-a129-28427f596592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:04:30.980959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109bf83-1b2d-4c49-a129-28427f596592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:04:30.981689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109bf83-1b2d-4c49-a129-28427f596592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:04:30.982783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: WARNING py.warnings [None req-d109bf83-1b2d-4c49-a129-28427f596592 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:04:30.982783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: warnings.warn(msg) May 26 21:04:30.982783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: May 26 21:04:30.983655 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109bf83-1b2d-4c49-a129-28427f596592 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:04:30.997513 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 760/1499] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:04:31.003758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752cf2e-41cf-430f-8615-a0b388a124af admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:04:31.019039 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752cf2e-41cf-430f-8615-a0b388a124af admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:04:31.027222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b216ac-2882-4b53-ae29-ec0f630877d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:04:31.027950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b216ac-2882-4b53-ae29-ec0f630877d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:04:31.028264 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b216ac-2882-4b53-ae29-ec0f630877d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:04:31.028540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b216ac-2882-4b53-ae29-ec0f630877d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:04:31.029265 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b216ac-2882-4b53-ae29-ec0f630877d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:04:31.030325 dv-cinder-828806-3-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-53b216ac-2882-4b53-ae29-ec0f630877d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:04:31.030325 dv-cinder-828806-3-smb devstack@keystone.service[80323]: warnings.warn(msg) May 26 21:04:31.030325 dv-cinder-828806-3-smb devstack@keystone.service[80323]: May 26 21:04:31.031225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b216ac-2882-4b53-ae29-ec0f630877d8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:04:31.046360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 740/1500] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:04:31.050849 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109bf83-1b2d-4c49-a129-28427f596592 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:04:31.061317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109bf83-1b2d-4c49-a129-28427f596592 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:04:31.066435 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1797ad-7e7b-42c7-bf4e-786bcc292e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:04:31.067319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1797ad-7e7b-42c7-bf4e-786bcc292e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:04:31.067597 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1797ad-7e7b-42c7-bf4e-786bcc292e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:04:31.067869 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1797ad-7e7b-42c7-bf4e-786bcc292e94 admin admin] PATH_INFO: `/v3/projects/b16d1dae94f64cbe929549e7bc7c8fe6/users/8385df67b52543fd97534f45bf16157a/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:04:31.083822 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1797ad-7e7b-42c7-bf4e-786bcc292e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16d1dae94f64cbe929549e7bc7c8fe6, user_id=8385df67b52543fd97534f45bf16157a, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:04:31.084893 dv-cinder-828806-3-smb devstack@keystone.service[80324]: WARNING py.warnings [None req-ce1797ad-7e7b-42c7-bf4e-786bcc292e94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:04:31.084893 dv-cinder-828806-3-smb devstack@keystone.service[80324]: warnings.warn(msg) May 26 21:04:31.084893 dv-cinder-828806-3-smb devstack@keystone.service[80324]: May 26 21:04:31.086877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1797ad-7e7b-42c7-bf4e-786bcc292e94 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:04:31.104321 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 761/1501] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:04:31 2022] PUT /identity/v3/projects/b16d1dae94f64cbe929549e7bc7c8fe6/users/8385df67b52543fd97534f45bf16157a/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:04:31.116366 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c9ca8-97c5-4523-ade2-0dec22daf011 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:04:31.116665 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c9ca8-97c5-4523-ade2-0dec22daf011 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:04:31.117636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c9ca8-97c5-4523-ade2-0dec22daf011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:04:31.146843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5f3c9ca8-97c5-4523-ade2-0dec22daf011 None None] MFA Rules not processed for user `8385df67b52543fd97534f45bf16157a`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:04:31.148074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5f3c9ca8-97c5-4523-ade2-0dec22daf011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:04:31.218115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 741/1502] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:04:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:04:31.232099 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0b87e-7e3e-4954-8fa2-e5ae6d4f3c9b None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:04:31.232392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0b87e-7e3e-4954-8fa2-e5ae6d4f3c9b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:04:31.232665 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0b87e-7e3e-4954-8fa2-e5ae6d4f3c9b None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:04:31.234092 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 762/1503] 10.222.0.61 () {54 vars in 963 bytes} [Thu May 26 21:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:04:31.239052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fd279-7a66-436a-ae8c-eeec717fe7d9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:04:31.239345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fd279-7a66-436a-ae8c-eeec717fe7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:04:31.239647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fd279-7a66-436a-ae8c-eeec717fe7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:04:31.258939 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-146fd279-7a66-436a-ae8c-eeec717fe7d9 None None] MFA Rules not processed for user `e877e97dae064fe9ad3d378296b78ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:04:31.260149 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-146fd279-7a66-436a-ae8c-eeec717fe7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:04:31.304957 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:04:31.313690 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 742/1504] 10.222.0.61 () {58 vars in 1060 bytes} [Thu May 26 21:04:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:04:31.321835 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0b87e-7e3e-4954-8fa2-e5ae6d4f3c9b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:04:31.336356 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0b87e-7e3e-4954-8fa2-e5ae6d4f3c9b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:04:31.339005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64ed03-91d2-406b-88cb-a02fdb3ccc2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:04:31.339653 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64ed03-91d2-406b-88cb-a02fdb3ccc2e service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:04:31.339932 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64ed03-91d2-406b-88cb-a02fdb3ccc2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:04:31.340207 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64ed03-91d2-406b-88cb-a02fdb3ccc2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:04:31.348747 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64ed03-91d2-406b-88cb-a02fdb3ccc2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:04:31.350244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64ed03-91d2-406b-88cb-a02fdb3ccc2e service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:04:31.359256 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 763/1505] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:04:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:04:31.402006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e8893-9cda-4b00-a5a4-82157ffa3df0 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:04:31.402300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e8893-9cda-4b00-a5a4-82157ffa3df0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:04:31.402578 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e8893-9cda-4b00-a5a4-82157ffa3df0 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:04:31.404507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 743/1506] 10.222.0.61 () {52 vars in 829 bytes} [Thu May 26 21:04:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:04:31.408275 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64ed03-91d2-406b-88cb-a02fdb3ccc2e service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:04:31.474706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64ed03-91d2-406b-88cb-a02fdb3ccc2e service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:04:31.480075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bd774-118e-4d06-ad0a-7c2701468585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:04:31.480959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bd774-118e-4d06-ad0a-7c2701468585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:04:31.481698 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bd774-118e-4d06-ad0a-7c2701468585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:04:31.482033 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bd774-118e-4d06-ad0a-7c2701468585 admin admin] PATH_INFO: `/v3/users/8385df67b52543fd97534f45bf16157a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:04:31.483328 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827bd774-118e-4d06-ad0a-7c2701468585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8385df67b52543fd97534f45bf16157a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:04:31.484379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: WARNING py.warnings [None req-827bd774-118e-4d06-ad0a-7c2701468585 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:04:31.484379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: warnings.warn(msg) May 26 21:04:31.484379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: May 26 21:04:31.485603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827bd774-118e-4d06-ad0a-7c2701468585 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:04:31.564181 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-827bd774-118e-4d06-ad0a-7c2701468585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8385df67b52543fd97534f45bf16157a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:04:31.582544 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-827bd774-118e-4d06-ad0a-7c2701468585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8385df67b52543fd97534f45bf16157a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:04:31.583638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-827bd774-118e-4d06-ad0a-7c2701468585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8385df67b52543fd97534f45bf16157a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:04:31.595658 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-827bd774-118e-4d06-ad0a-7c2701468585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8385df67b52543fd97534f45bf16157a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:04:31.605765 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:04:31.612036 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-827bd774-118e-4d06-ad0a-7c2701468585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8385df67b52543fd97534f45bf16157a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:04:31.619799 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 764/1507] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:04:31 2022] DELETE /identity/v3/users/8385df67b52543fd97534f45bf16157a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:04:31.624532 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627b5b2-3473-4627-9869-43af475adccb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:04:31.624831 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627b5b2-3473-4627-9869-43af475adccb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:04:31.625112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627b5b2-3473-4627-9869-43af475adccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:04:31.643911 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a627b5b2-3473-4627-9869-43af475adccb None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:04:31.645119 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a627b5b2-3473-4627-9869-43af475adccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:04:31.717696 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 744/1508] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:04:31.729657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bd774-118e-4d06-ad0a-7c2701468585 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:04:31.731454 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-827bd774-118e-4d06-ad0a-7c2701468585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:04:31.799655 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bd774-118e-4d06-ad0a-7c2701468585 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:04:31.803653 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a40703-45a6-41dd-9dce-1608b733b6fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:04:31.804307 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a40703-45a6-41dd-9dce-1608b733b6fc service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:04:31.804589 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a40703-45a6-41dd-9dce-1608b733b6fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:04:31.804859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a40703-45a6-41dd-9dce-1608b733b6fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:04:31.814996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a40703-45a6-41dd-9dce-1608b733b6fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:04:31.816458 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a40703-45a6-41dd-9dce-1608b733b6fc service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:04:31.826880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 765/1509] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:04:32.161203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627b5b2-3473-4627-9869-43af475adccb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:04:32.162820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a627b5b2-3473-4627-9869-43af475adccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:04:32.176790 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627b5b2-3473-4627-9869-43af475adccb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:04:32.183320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741ead0-bc53-49a6-9c1b-6428909606fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:04:32.184296 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741ead0-bc53-49a6-9c1b-6428909606fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:04:32.185322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741ead0-bc53-49a6-9c1b-6428909606fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:04:32.185594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741ead0-bc53-49a6-9c1b-6428909606fc admin admin] PATH_INFO: `/v3/projects/b16d1dae94f64cbe929549e7bc7c8fe6` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:04:32.187465 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741ead0-bc53-49a6-9c1b-6428909606fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b16d1dae94f64cbe929549e7bc7c8fe6)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:04:32.188561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-5741ead0-bc53-49a6-9c1b-6428909606fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:04:32.188561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: warnings.warn(msg) May 26 21:04:32.188561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: May 26 21:04:32.189751 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741ead0-bc53-49a6-9c1b-6428909606fc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:04:32.257835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5741ead0-bc53-49a6-9c1b-6428909606fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b16d1dae94f64cbe929549e7bc7c8fe6', 'request_id': 'req-5741ead0-bc53-49a6-9c1b-6428909606fc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:04:32.269565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5741ead0-bc53-49a6-9c1b-6428909606fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b16d1dae94f64cbe929549e7bc7c8fe6', 'request_id': 'req-5741ead0-bc53-49a6-9c1b-6428909606fc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:04:32.286412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5741ead0-bc53-49a6-9c1b-6428909606fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b16d1dae94f64cbe929549e7bc7c8fe6', 'request_id': 'req-5741ead0-bc53-49a6-9c1b-6428909606fc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:04:32.298739 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5741ead0-bc53-49a6-9c1b-6428909606fc admin admin] The token cache is being invalidate because project b16d1dae94f64cbe929549e7bc7c8fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:04:32.299036 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5741ead0-bc53-49a6-9c1b-6428909606fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:04:32.299812 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5741ead0-bc53-49a6-9c1b-6428909606fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:04:32.301411 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 745/1510] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:04:32 2022] DELETE /identity/v3/projects/b16d1dae94f64cbe929549e7bc7c8fe6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:04:41.821927 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=29 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:04:42.295667 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:06:20.131549 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf37131-d624-4d4a-950e-a219a3aa9861 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:20.132436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf37131-d624-4d4a-950e-a219a3aa9861 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:20.132436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf37131-d624-4d4a-950e-a219a3aa9861 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:20.134838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:06:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:06:20.140806 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a0acb-994a-41d3-8dd1-37f71821987f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:20.141553 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a0acb-994a-41d3-8dd1-37f71821987f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:20.141647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a0acb-994a-41d3-8dd1-37f71821987f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:20.168480 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7d4a0acb-994a-41d3-8dd1-37f71821987f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:06:20.169723 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7d4a0acb-994a-41d3-8dd1-37f71821987f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:06:20.234509 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:06:20.406761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf37131-d624-4d4a-950e-a219a3aa9861 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:06:20.409792 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2cf37131-d624-4d4a-950e-a219a3aa9861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:06:20.501313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf37131-d624-4d4a-950e-a219a3aa9861 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:06:20.507373 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ccd76-da5e-40dd-9873-f3e2ed1e4403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:06:20.508030 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ccd76-da5e-40dd-9873-f3e2ed1e4403 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:20.508312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ccd76-da5e-40dd-9873-f3e2ed1e4403 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:20.508586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ccd76-da5e-40dd-9873-f3e2ed1e4403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:20.516953 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ccd76-da5e-40dd-9873-f3e2ed1e4403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:06:20.518619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ccd76-da5e-40dd-9873-f3e2ed1e4403 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:06:20.528046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 767/1513] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:06:20.817040 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa83e47-cac2-4f55-aaa8-7622c016d3cd None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:20.817298 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa83e47-cac2-4f55-aaa8-7622c016d3cd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:20.817631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa83e47-cac2-4f55-aaa8-7622c016d3cd None None] PATH_INFO: `/v3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:20.819074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 747/1514] 10.222.0.67 () {54 vars in 925 bytes} [Thu May 26 21:06:20 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:06:20.825765 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafeb39-3b23-427f-a417-5d377d0924b0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:20.826068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafeb39-3b23-427f-a417-5d377d0924b0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:20.826368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafeb39-3b23-427f-a417-5d377d0924b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:20.845916 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1bafeb39-3b23-427f-a417-5d377d0924b0 None None] MFA Rules not processed for user `e8952f35c21c4a2eaf1fbc601fe76242`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:06:20.847439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1bafeb39-3b23-427f-a417-5d377d0924b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:06:20.910392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 768/1515] 10.222.0.67 () {58 vars in 1015 bytes} [Thu May 26 21:06:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:06:21.419595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e890c1-bb73-4e47-bfe9-2cb36dd23bbf None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:21.420502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e890c1-bb73-4e47-bfe9-2cb36dd23bbf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:21.420502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e890c1-bb73-4e47-bfe9-2cb36dd23bbf None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:21.422838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 748/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:06:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:06:21.429955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ebcb7-a15d-4b73-a696-4bbb58e25d00 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:21.430429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ebcb7-a15d-4b73-a696-4bbb58e25d00 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:21.430534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ebcb7-a15d-4b73-a696-4bbb58e25d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:21.459286 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-9a6ebcb7-a15d-4b73-a696-4bbb58e25d00 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:06:21.460511 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9a6ebcb7-a15d-4b73-a696-4bbb58e25d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:06:21.470123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 769/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:06:21.623058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e890c1-bb73-4e47-bfe9-2cb36dd23bbf None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:06:21.641931 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e890c1-bb73-4e47-bfe9-2cb36dd23bbf None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:06:21.647810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59141e-7ba3-4805-8c3d-345d6afe1c58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:06:21.648465 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59141e-7ba3-4805-8c3d-345d6afe1c58 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:21.648752 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59141e-7ba3-4805-8c3d-345d6afe1c58 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:21.649030 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59141e-7ba3-4805-8c3d-345d6afe1c58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:21.657610 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59141e-7ba3-4805-8c3d-345d6afe1c58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:06:21.659278 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59141e-7ba3-4805-8c3d-345d6afe1c58 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:06:21.669125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 749/1518] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:06:29.714429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90cbc1-eea2-4444-946b-26dadda02aed None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:29.714986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90cbc1-eea2-4444-946b-26dadda02aed None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:29.714986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90cbc1-eea2-4444-946b-26dadda02aed None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:29.716365 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 770/1519] 10.222.0.61 () {54 vars in 960 bytes} [Thu May 26 21:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:06:29.722487 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479e2d1-ee5d-46d2-a920-549e739c9911 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:29.722926 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479e2d1-ee5d-46d2-a920-549e739c9911 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:29.723021 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479e2d1-ee5d-46d2-a920-549e739c9911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:29.745180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c479e2d1-ee5d-46d2-a920-549e739c9911 None None] MFA Rules not processed for user `e8952f35c21c4a2eaf1fbc601fe76242`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:06:29.746463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c479e2d1-ee5d-46d2-a920-549e739c9911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:06:29.756731 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 750/1520] 10.222.0.61 () {58 vars in 1057 bytes} [Thu May 26 21:06:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:06:29.764599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90cbc1-eea2-4444-946b-26dadda02aed None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:06:29.780153 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90cbc1-eea2-4444-946b-26dadda02aed None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:06:29.787144 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65182d38-7ec5-4867-be95-be4fb71a4da2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8952f35c21c4a2eaf1fbc601fe76242', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:06:29.788020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65182d38-7ec5-4867-be95-be4fb71a4da2 service placement] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:29.788403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65182d38-7ec5-4867-be95-be4fb71a4da2 service placement] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:29.788684 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65182d38-7ec5-4867-be95-be4fb71a4da2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:29.797934 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65182d38-7ec5-4867-be95-be4fb71a4da2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:06:29.799572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65182d38-7ec5-4867-be95-be4fb71a4da2 service placement] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:06:29.810082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 771/1521] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:06:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:06:32.991226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d77b8f-c102-4392-95f4-1b94b8da8066 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:32.992127 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d77b8f-c102-4392-95f4-1b94b8da8066 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:32.992412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d77b8f-c102-4392-95f4-1b94b8da8066 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:32.994794 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 751/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:06:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:06:33.000750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9400d-b683-4c3b-9f9f-06780644a887 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:33.001211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9400d-b683-4c3b-9f9f-06780644a887 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:33.001337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9400d-b683-4c3b-9f9f-06780644a887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:33.021910 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-45d9400d-b683-4c3b-9f9f-06780644a887 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:06:33.023019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-45d9400d-b683-4c3b-9f9f-06780644a887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:06:33.031300 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 772/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:06:33.184655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d77b8f-c102-4392-95f4-1b94b8da8066 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:06:33.206146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d77b8f-c102-4392-95f4-1b94b8da8066 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:06:33.213288 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac70887-ba85-445b-92c9-b3ba863eaab1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:06:33.213971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac70887-ba85-445b-92c9-b3ba863eaab1 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:33.214258 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac70887-ba85-445b-92c9-b3ba863eaab1 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:33.214534 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac70887-ba85-445b-92c9-b3ba863eaab1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:33.222914 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac70887-ba85-445b-92c9-b3ba863eaab1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:06:33.224554 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac70887-ba85-445b-92c9-b3ba863eaab1 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:06:33.234457 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 752/1524] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:06:34.124022 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bde98-a796-4383-be02-ebce2cb04689 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:34.124594 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bde98-a796-4383-be02-ebce2cb04689 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:34.124594 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bde98-a796-4383-be02-ebce2cb04689 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:34.125856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 773/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 21:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:06:34.132309 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e05a13-2294-4db9-ae1b-02abf0fad79a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:34.133086 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e05a13-2294-4db9-ae1b-02abf0fad79a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:34.133195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e05a13-2294-4db9-ae1b-02abf0fad79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:34.160678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-04e05a13-2294-4db9-ae1b-02abf0fad79a None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:06:34.162410 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-04e05a13-2294-4db9-ae1b-02abf0fad79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:06:34.175155 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 753/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 21:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:06:34.342786 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bde98-a796-4383-be02-ebce2cb04689 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:06:34.368723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bde98-a796-4383-be02-ebce2cb04689 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:06:34.377520 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07042f-3b8e-4a9e-9188-4f53d131d2d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:06:34.378502 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07042f-3b8e-4a9e-9188-4f53d131d2d3 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:34.378971 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07042f-3b8e-4a9e-9188-4f53d131d2d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:34.379426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07042f-3b8e-4a9e-9188-4f53d131d2d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:34.389402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07042f-3b8e-4a9e-9188-4f53d131d2d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:06:34.391059 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07042f-3b8e-4a9e-9188-4f53d131d2d3 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:06:34.400826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 774/1527] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:06:38.495596 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e89ecb-cfca-485b-8431-f760e484f43e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:38.496162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e89ecb-cfca-485b-8431-f760e484f43e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:38.496162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e89ecb-cfca-485b-8431-f760e484f43e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:38.497557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 754/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 21:06:38.503235 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4c2eb-8698-4789-a562-80eb89cf0a88 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:38.503688 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4c2eb-8698-4789-a562-80eb89cf0a88 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:38.503774 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4c2eb-8698-4789-a562-80eb89cf0a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:38.536261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-edf4c2eb-8698-4789-a562-80eb89cf0a88 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:06:38.537552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-edf4c2eb-8698-4789-a562-80eb89cf0a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:06:38.545523 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 775/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:06:38.585008 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e89ecb-cfca-485b-8431-f760e484f43e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:06:38.587081 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-06e89ecb-cfca-485b-8431-f760e484f43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:06:38.647034 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e89ecb-cfca-485b-8431-f760e484f43e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:06:38.650868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62c826-f4a6-4235-a7f0-ca93006a5558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:06:38.651523 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62c826-f4a6-4235-a7f0-ca93006a5558 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:38.651803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62c826-f4a6-4235-a7f0-ca93006a5558 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:38.652064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62c826-f4a6-4235-a7f0-ca93006a5558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:38.661657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62c826-f4a6-4235-a7f0-ca93006a5558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:06:38.663292 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62c826-f4a6-4235-a7f0-ca93006a5558 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:06:38.672843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 755/1530] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:06:40.852930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c37b8-518c-4892-8fe3-9c483693112d None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:40.853484 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c37b8-518c-4892-8fe3-9c483693112d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:40.853484 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c37b8-518c-4892-8fe3-9c483693112d None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:40.854919 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 776/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:06:40.860425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc3adc-1bdb-4cf3-a1f4-49739cd62394 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:40.860890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc3adc-1bdb-4cf3-a1f4-49739cd62394 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:40.861003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc3adc-1bdb-4cf3-a1f4-49739cd62394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:40.880633 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-19dc3adc-1bdb-4cf3-a1f4-49739cd62394 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:06:40.882091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-19dc3adc-1bdb-4cf3-a1f4-49739cd62394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:06:40.891593 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 756/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:06:40.928668 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c37b8-518c-4892-8fe3-9c483693112d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:06:40.930847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-634c37b8-518c-4892-8fe3-9c483693112d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:06:40.945871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c37b8-518c-4892-8fe3-9c483693112d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:06:40.949736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c4a69-507f-48ab-91d1-859288e99b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:06:40.950413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c4a69-507f-48ab-91d1-859288e99b0b service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:40.950696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c4a69-507f-48ab-91d1-859288e99b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:40.950972 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c4a69-507f-48ab-91d1-859288e99b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:40.960239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c4a69-507f-48ab-91d1-859288e99b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:06:40.961696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c4a69-507f-48ab-91d1-859288e99b0b service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:06:40.970898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 777/1533] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:06:44.830307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef0a41-8e4b-4923-987e-7909a32570d3 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:44.830879 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef0a41-8e4b-4923-987e-7909a32570d3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:44.830879 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef0a41-8e4b-4923-987e-7909a32570d3 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:44.832904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 757/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:06:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:06:44.840727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fd103-4c10-441b-8a2f-450c234223b6 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:44.841157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fd103-4c10-441b-8a2f-450c234223b6 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:44.841334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fd103-4c10-441b-8a2f-450c234223b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:44.853111 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:06:44.873581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-254fd103-4c10-441b-8a2f-450c234223b6 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:06:44.874834 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-254fd103-4c10-441b-8a2f-450c234223b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:06:44.884305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 778/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:06:45.156595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef0a41-8e4b-4923-987e-7909a32570d3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:06:45.159655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-13ef0a41-8e4b-4923-987e-7909a32570d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:06:45.168425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=75 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:06:45.230716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef0a41-8e4b-4923-987e-7909a32570d3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:06:45.235019 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d4a4d-7d15-4fbd-ac7b-499bbed04a0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:06:45.235900 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d4a4d-7d15-4fbd-ac7b-499bbed04a0e service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:45.236198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d4a4d-7d15-4fbd-ac7b-499bbed04a0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:45.236538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d4a4d-7d15-4fbd-ac7b-499bbed04a0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:45.246852 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d4a4d-7d15-4fbd-ac7b-499bbed04a0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:06:45.248301 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d4a4d-7d15-4fbd-ac7b-499bbed04a0e service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:06:45.258070 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 758/1536] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:06:47.444563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b5819-2d59-4147-8f7c-8156ddd05497 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:47.445469 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b5819-2d59-4147-8f7c-8156ddd05497 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:47.445469 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b5819-2d59-4147-8f7c-8156ddd05497 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:47.446783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 779/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 21:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:06:47.452217 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ff285-a581-4e5c-914d-983489f19ba1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:47.452668 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ff285-a581-4e5c-914d-983489f19ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:47.452774 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ff285-a581-4e5c-914d-983489f19ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:47.482782 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d92ff285-a581-4e5c-914d-983489f19ba1 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:06:47.484014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d92ff285-a581-4e5c-914d-983489f19ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:06:47.494922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 759/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 21:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:06:47.772460 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b5819-2d59-4147-8f7c-8156ddd05497 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:06:47.775008 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d74b5819-2d59-4147-8f7c-8156ddd05497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:06:47.790756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b5819-2d59-4147-8f7c-8156ddd05497 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:06:47.794766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb78363-1f33-4b36-b5eb-a96e4e7b9274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:06:47.795434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb78363-1f33-4b36-b5eb-a96e4e7b9274 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:06:47.795713 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb78363-1f33-4b36-b5eb-a96e4e7b9274 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:06:47.795987 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb78363-1f33-4b36-b5eb-a96e4e7b9274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:06:47.806904 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb78363-1f33-4b36-b5eb-a96e4e7b9274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:06:47.809256 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb78363-1f33-4b36-b5eb-a96e4e7b9274 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:06:47.822296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 780/1539] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:06:57.475463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=28 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:06:57.817828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=8 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:22.191777 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93696d-03e3-4b88-9263-9be42393f938 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:22.192705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93696d-03e3-4b88-9263-9be42393f938 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:22.192705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93696d-03e3-4b88-9263-9be42393f938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:22.248644 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8f93696d-03e3-4b88-9263-9be42393f938 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:22.251409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8f93696d-03e3-4b88-9263-9be42393f938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:22.267354 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 760/1540] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:08:22.279760 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aeada-a02f-4ce9-bf61-9a6967f4d22a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:22.280667 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aeada-a02f-4ce9-bf61-9a6967f4d22a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:22.280838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aeada-a02f-4ce9-bf61-9a6967f4d22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:22.332035 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-794aeada-a02f-4ce9-bf61-9a6967f4d22a None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:22.334439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-794aeada-a02f-4ce9-bf61-9a6967f4d22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:22.362317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 781/1541] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:08:22.367308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93696d-03e3-4b88-9263-9be42393f938 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:22.383145 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93696d-03e3-4b88-9263-9be42393f938 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:22.394831 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2493e4b-0fbe-4a17-9e52-5ad163bc2f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:22.395969 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2493e4b-0fbe-4a17-9e52-5ad163bc2f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:22.396472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2493e4b-0fbe-4a17-9e52-5ad163bc2f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:22.396976 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2493e4b-0fbe-4a17-9e52-5ad163bc2f39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:22.397989 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2493e4b-0fbe-4a17-9e52-5ad163bc2f39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:08:22.398526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2493e4b-0fbe-4a17-9e52-5ad163bc2f39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:22.400398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2493e4b-0fbe-4a17-9e52-5ad163bc2f39 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:22.427090 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 761/1542] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:08:22.437620 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aeada-a02f-4ce9-bf61-9a6967f4d22a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:22.467267 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aeada-a02f-4ce9-bf61-9a6967f4d22a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:22.488823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a96ce-bd57-4245-bef7-2a03bb064323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:22.490021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a96ce-bd57-4245-bef7-2a03bb064323 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:22.490515 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a96ce-bd57-4245-bef7-2a03bb064323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:22.491018 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a96ce-bd57-4245-bef7-2a03bb064323 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:22.493859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a96ce-bd57-4245-bef7-2a03bb064323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:22.496835 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a96ce-bd57-4245-bef7-2a03bb064323 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:22.505540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3dba1-6ecf-4d92-a61a-557268dc786c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:22.506027 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3dba1-6ecf-4d92-a61a-557268dc786c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:22.506425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3dba1-6ecf-4d92-a61a-557268dc786c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:22.573467 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 782/1543] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:22 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:22.573761 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-91f3dba1-6ecf-4d92-a61a-557268dc786c None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:22.575842 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6f31d-db24-4915-93f4-7f91441ecd2e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:22.576052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-91f3dba1-6ecf-4d92-a61a-557268dc786c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:22.576161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6f31d-db24-4915-93f4-7f91441ecd2e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:22.576452 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6f31d-db24-4915-93f4-7f91441ecd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:22.619762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-64a6f31d-db24-4915-93f4-7f91441ecd2e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:22.620891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-64a6f31d-db24-4915-93f4-7f91441ecd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:22.810580 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 783/1544] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:22.812002 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6f31d-db24-4915-93f4-7f91441ecd2e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:22.835406 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6f31d-db24-4915-93f4-7f91441ecd2e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:22.844572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3885b2-f8a6-4f04-9e42-805fa73f67b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:22.845719 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3885b2-f8a6-4f04-9e42-805fa73f67b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:22.846288 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3885b2-f8a6-4f04-9e42-805fa73f67b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:22.846777 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3885b2-f8a6-4f04-9e42-805fa73f67b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:22.847718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3885b2-f8a6-4f04-9e42-805fa73f67b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:22.848841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 762/1545] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:08:22.849699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: WARNING py.warnings [None req-8a3885b2-f8a6-4f04-9e42-805fa73f67b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:08:22.849699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: warnings.warn(msg) May 26 21:08:22.849699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: May 26 21:08:22.854229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e45390-3248-4060-87e0-1b5f517ea8f0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:22.854229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e45390-3248-4060-87e0-1b5f517ea8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:22.854229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e45390-3248-4060-87e0-1b5f517ea8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:22.856369 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3885b2-f8a6-4f04-9e42-805fa73f67b6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:22.894308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-85e45390-3248-4060-87e0-1b5f517ea8f0 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:22.896451 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-85e45390-3248-4060-87e0-1b5f517ea8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:22.911922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 784/1546] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:22 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:22.915276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b362dfb-6af8-435f-9b04-c22c058cd222 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:22.916755 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b362dfb-6af8-435f-9b04-c22c058cd222 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:22.919152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b362dfb-6af8-435f-9b04-c22c058cd222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:22.931425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 763/1547] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:22.941314 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a5a43-ca4d-4dba-aa74-e87732ed9976 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:22.942655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a5a43-ca4d-4dba-aa74-e87732ed9976 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:22.943475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a5a43-ca4d-4dba-aa74-e87732ed9976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:22.958718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3b362dfb-6af8-435f-9b04-c22c058cd222 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:22.962192 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3b362dfb-6af8-435f-9b04-c22c058cd222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:22.982101 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 785/1548] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:22.983527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1226c17-998b-469f-86c2-23bdc2b48bce None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:22.983822 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1226c17-998b-469f-86c2-23bdc2b48bce None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:22.984105 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1226c17-998b-469f-86c2-23bdc2b48bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:22.986852 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ad4a5a43-ca4d-4dba-aa74-e87732ed9976 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:22.988924 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ad4a5a43-ca4d-4dba-aa74-e87732ed9976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:23.003467 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 764/1549] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:23.005562 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a5a43-ca4d-4dba-aa74-e87732ed9976 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.023300 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-c1226c17-998b-469f-86c2-23bdc2b48bce None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:23.024394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a5a43-ca4d-4dba-aa74-e87732ed9976 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.025361 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c1226c17-998b-469f-86c2-23bdc2b48bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:23.032750 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470078e-471a-4c09-8bfc-850e46deeba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.033936 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470078e-471a-4c09-8bfc-850e46deeba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.034399 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470078e-471a-4c09-8bfc-850e46deeba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.034843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470078e-471a-4c09-8bfc-850e46deeba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.036190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470078e-471a-4c09-8bfc-850e46deeba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.039026 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470078e-471a-4c09-8bfc-850e46deeba1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.040580 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 786/1550] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:23.043223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d6e02-1374-4dc1-9e8f-8c93887681a1 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.044711 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d6e02-1374-4dc1-9e8f-8c93887681a1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.045571 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d6e02-1374-4dc1-9e8f-8c93887681a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.061846 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 765/1551] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:23.063863 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56683dd9-6bff-4eea-968f-f5c6d111813b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.064430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56683dd9-6bff-4eea-968f-f5c6d111813b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.064923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56683dd9-6bff-4eea-968f-f5c6d111813b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.079241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1e9d6e02-1374-4dc1-9e8f-8c93887681a1 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:23.080832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1e9d6e02-1374-4dc1-9e8f-8c93887681a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:23.092200 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 787/1552] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:23.093611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bab01-2d53-4b65-937b-ea16d3577330 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.093931 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bab01-2d53-4b65-937b-ea16d3577330 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.094217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bab01-2d53-4b65-937b-ea16d3577330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.095219 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-56683dd9-6bff-4eea-968f-f5c6d111813b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:23.097437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-56683dd9-6bff-4eea-968f-f5c6d111813b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:23.112154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 766/1553] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:23.113626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-bf6bab01-2d53-4b65-937b-ea16d3577330 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:23.114745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461373f4-1ca8-443b-a332-66e1eb5fc314 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.114915 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bf6bab01-2d53-4b65-937b-ea16d3577330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:23.115096 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461373f4-1ca8-443b-a332-66e1eb5fc314 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.115369 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461373f4-1ca8-443b-a332-66e1eb5fc314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.129981 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 788/1554] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:23.129981 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bab01-2d53-4b65-937b-ea16d3577330 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.140979 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bab01-2d53-4b65-937b-ea16d3577330 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.143530 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-461373f4-1ca8-443b-a332-66e1eb5fc314 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:23.144807 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-461373f4-1ca8-443b-a332-66e1eb5fc314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:23.147054 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6f7eb-1fae-4b03-ba6f-305de8ac05ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.147748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f7eb-1fae-4b03-ba6f-305de8ac05ed admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.148204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f7eb-1fae-4b03-ba6f-305de8ac05ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.148489 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f7eb-1fae-4b03-ba6f-305de8ac05ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.149306 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6f7eb-1fae-4b03-ba6f-305de8ac05ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:08:23.149757 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6f7eb-1fae-4b03-ba6f-305de8ac05ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.150890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: WARNING py.warnings [None req-71f6f7eb-1fae-4b03-ba6f-305de8ac05ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:08:23.150890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: warnings.warn(msg) May 26 21:08:23.150890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: May 26 21:08:23.151801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6f7eb-1fae-4b03-ba6f-305de8ac05ed admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.153738 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 767/1555] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:23.159966 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461373f4-1ca8-443b-a332-66e1eb5fc314 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.166816 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461373f4-1ca8-443b-a332-66e1eb5fc314 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.171808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 789/1556] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:08:23.173571 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6f7eb-1fae-4b03-ba6f-305de8ac05ed admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.179637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f20fa-ffaf-4dc7-8756-acf6f3c7f9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.180378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f20fa-ffaf-4dc7-8756-acf6f3c7f9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.181218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f20fa-ffaf-4dc7-8756-acf6f3c7f9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.181218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f20fa-ffaf-4dc7-8756-acf6f3c7f9e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.181852 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f20fa-ffaf-4dc7-8756-acf6f3c7f9e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:08:23.182031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f20fa-ffaf-4dc7-8756-acf6f3c7f9e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.183805 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f20fa-ffaf-4dc7-8756-acf6f3c7f9e8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.193374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6f7eb-1fae-4b03-ba6f-305de8ac05ed admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.197821 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 768/1557] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:08:23.199707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86112a-7e00-4461-8f95-a3f22d66e7c1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.199960 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d24c0-f73e-4213-ba0d-af9b1aff80f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.200323 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86112a-7e00-4461-8f95-a3f22d66e7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.200833 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86112a-7e00-4461-8f95-a3f22d66e7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.200984 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d24c0-f73e-4213-ba0d-af9b1aff80f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.201210 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d24c0-f73e-4213-ba0d-af9b1aff80f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.201565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d24c0-f73e-4213-ba0d-af9b1aff80f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.202441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d24c0-f73e-4213-ba0d-af9b1aff80f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.204250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d24c0-f73e-4213-ba0d-af9b1aff80f5 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.217876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 790/1558] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:23.219585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14547fa3-ac80-4359-8c0c-2b94154e0b4b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.219933 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14547fa3-ac80-4359-8c0c-2b94154e0b4b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.220271 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14547fa3-ac80-4359-8c0c-2b94154e0b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.228112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ac86112a-7e00-4461-8f95-a3f22d66e7c1 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:23.229400 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ac86112a-7e00-4461-8f95-a3f22d66e7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:23.238230 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 769/1559] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:23.239176 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86112a-7e00-4461-8f95-a3f22d66e7c1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.250185 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-14547fa3-ac80-4359-8c0c-2b94154e0b4b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:23.250800 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86112a-7e00-4461-8f95-a3f22d66e7c1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.252312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-14547fa3-ac80-4359-8c0c-2b94154e0b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:23.255610 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dcff34-6aa3-41f9-9985-7b87bb983a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.256360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcff34-6aa3-41f9-9985-7b87bb983a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.256635 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcff34-6aa3-41f9-9985-7b87bb983a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.256906 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcff34-6aa3-41f9-9985-7b87bb983a1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.257636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dcff34-6aa3-41f9-9985-7b87bb983a1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:08:23.257971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dcff34-6aa3-41f9-9985-7b87bb983a1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.259595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dcff34-6aa3-41f9-9985-7b87bb983a1d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.264713 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 791/1560] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:23.266241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd880c-bfaf-4fe5-a02f-f7730484639e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.266524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd880c-bfaf-4fe5-a02f-f7730484639e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.266807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd880c-bfaf-4fe5-a02f-f7730484639e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.281784 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 770/1561] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:08:23.281784 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dcff34-6aa3-41f9-9985-7b87bb983a1d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.294592 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0afd880c-bfaf-4fe5-a02f-f7730484639e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:23.295707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0afd880c-bfaf-4fe5-a02f-f7730484639e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:23.296732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dcff34-6aa3-41f9-9985-7b87bb983a1d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.302946 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dbe4b-4a49-4698-81bf-449fc9edca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.304125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dbe4b-4a49-4698-81bf-449fc9edca41 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.304638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dbe4b-4a49-4698-81bf-449fc9edca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.310397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 792/1562] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:23.310640 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dbe4b-4a49-4698-81bf-449fc9edca41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.310768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd880c-bfaf-4fe5-a02f-f7730484639e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.310866 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dbe4b-4a49-4698-81bf-449fc9edca41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:08:23.310866 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dbe4b-4a49-4698-81bf-449fc9edca41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.311101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dbe4b-4a49-4698-81bf-449fc9edca41 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.321678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd880c-bfaf-4fe5-a02f-f7730484639e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.326731 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 771/1563] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:08:23.328689 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dbe4b-4a49-4698-81bf-449fc9edca41 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.337578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f25f64-f08e-465f-95bd-d8789b35fe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.338435 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f25f64-f08e-465f-95bd-d8789b35fe9e admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.338808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f25f64-f08e-465f-95bd-d8789b35fe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.339187 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f25f64-f08e-465f-95bd-d8789b35fe9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.340671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dbe4b-4a49-4698-81bf-449fc9edca41 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.340887 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f25f64-f08e-465f-95bd-d8789b35fe9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.343212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f25f64-f08e-465f-95bd-d8789b35fe9e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.345562 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee8e96-cd00-47b5-9ff7-eec8fdbba12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.346363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee8e96-cd00-47b5-9ff7-eec8fdbba12e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.346648 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee8e96-cd00-47b5-9ff7-eec8fdbba12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.347093 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee8e96-cd00-47b5-9ff7-eec8fdbba12e admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.347808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee8e96-cd00-47b5-9ff7-eec8fdbba12e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.348843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-6eee8e96-cd00-47b5-9ff7-eec8fdbba12e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:08:23.348843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: warnings.warn(msg) May 26 21:08:23.348843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: May 26 21:08:23.350074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee8e96-cd00-47b5-9ff7-eec8fdbba12e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.380871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 793/1564] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/projects => generated 405 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:23.381990 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f25f64-f08e-465f-95bd-d8789b35fe9e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.385961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 772/1565] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/projects => generated 403 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:23.387812 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07ee11-ed20-44bf-886f-9defec3672b4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.388314 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07ee11-ed20-44bf-886f-9defec3672b4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.388595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07ee11-ed20-44bf-886f-9defec3672b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.407975 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8c07ee11-ed20-44bf-886f-9defec3672b4 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:23.409223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8c07ee11-ed20-44bf-886f-9defec3672b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:23.420659 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:23.446305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:23.469218 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f25f64-f08e-465f-95bd-d8789b35fe9e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.486424 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 773/1566] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:23.487656 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07ee11-ed20-44bf-886f-9defec3672b4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.507067 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07ee11-ed20-44bf-886f-9defec3672b4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.513121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1fd29-4199-43fd-9720-0f8a7d40547b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.513920 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1fd29-4199-43fd-9720-0f8a7d40547b admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.514216 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1fd29-4199-43fd-9720-0f8a7d40547b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.514534 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1fd29-4199-43fd-9720-0f8a7d40547b admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.515237 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1fd29-4199-43fd-9720-0f8a7d40547b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:08:23.515543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1fd29-4199-43fd-9720-0f8a7d40547b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.517209 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1fd29-4199-43fd-9720-0f8a7d40547b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.531806 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 774/1567] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:08:23.532673 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1fd29-4199-43fd-9720-0f8a7d40547b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.550018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1fd29-4199-43fd-9720-0f8a7d40547b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.553762 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f8611-6da0-4b6d-a808-d06424cfa453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.554486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f8611-6da0-4b6d-a808-d06424cfa453 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.554776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f8611-6da0-4b6d-a808-d06424cfa453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.555052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f8611-6da0-4b6d-a808-d06424cfa453 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.555769 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f8611-6da0-4b6d-a808-d06424cfa453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.557708 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f8611-6da0-4b6d-a808-d06424cfa453 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.577126 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3450177-15b9-4da9-a935-ee0814aff0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.578276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3450177-15b9-4da9-a935-ee0814aff0ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.578571 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3450177-15b9-4da9-a935-ee0814aff0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.578878 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3450177-15b9-4da9-a935-ee0814aff0ab admin admin] PATH_INFO: `/v3/projects/ae4a43af89f642c5a2b0985fdbf8305b/users/5cec6311f0fb4d908877ebdb7236ef21/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.592643 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 775/1568] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:23.592643 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f8611-6da0-4b6d-a808-d06424cfa453 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.599876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3450177-15b9-4da9-a935-ee0814aff0ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4a43af89f642c5a2b0985fdbf8305b, user_id=5cec6311f0fb4d908877ebdb7236ef21, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.602679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3450177-15b9-4da9-a935-ee0814aff0ab admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.625227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 794/1569] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:23 2022] PUT /identity/v3/projects/ae4a43af89f642c5a2b0985fdbf8305b/users/5cec6311f0fb4d908877ebdb7236ef21/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:23.626783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3450177-15b9-4da9-a935-ee0814aff0ab admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.667421 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f8611-6da0-4b6d-a808-d06424cfa453 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.701478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3450177-15b9-4da9-a935-ee0814aff0ab admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.706968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e84381-b7b7-41c4-9b84-00365ab411f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.707638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e84381-b7b7-41c4-9b84-00365ab411f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.707921 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e84381-b7b7-41c4-9b84-00365ab411f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.708200 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e84381-b7b7-41c4-9b84-00365ab411f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.708898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e84381-b7b7-41c4-9b84-00365ab411f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.710901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e84381-b7b7-41c4-9b84-00365ab411f8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.742862 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cdab7-bd27-4ee1-a1d5-f2978f54620a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.743269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 795/1570] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:23.744425 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e84381-b7b7-41c4-9b84-00365ab411f8 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.746861 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cdab7-bd27-4ee1-a1d5-f2978f54620a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.747354 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cdab7-bd27-4ee1-a1d5-f2978f54620a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.747642 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cdab7-bd27-4ee1-a1d5-f2978f54620a admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.748525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cdab7-bd27-4ee1-a1d5-f2978f54620a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:08:23.748725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cdab7-bd27-4ee1-a1d5-f2978f54620a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.750427 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cdab7-bd27-4ee1-a1d5-f2978f54620a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.764818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 776/1571] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:08:23.766187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cdab7-bd27-4ee1-a1d5-f2978f54620a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.779800 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cdab7-bd27-4ee1-a1d5-f2978f54620a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.830212 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:23.837105 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:23.852080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427d7cf-42a9-45d3-9a8b-b1a8a2d31bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.852943 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427d7cf-42a9-45d3-9a8b-b1a8a2d31bde admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.853129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427d7cf-42a9-45d3-9a8b-b1a8a2d31bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.853420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427d7cf-42a9-45d3-9a8b-b1a8a2d31bde admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.854090 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427d7cf-42a9-45d3-9a8b-b1a8a2d31bde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.856319 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427d7cf-42a9-45d3-9a8b-b1a8a2d31bde admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.863698 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e84381-b7b7-41c4-9b84-00365ab411f8 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.869070 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4839f39-2bd4-42b4-9a49-7f673cfbfc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.869776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4839f39-2bd4-42b4-9a49-7f673cfbfc12 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.870261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4839f39-2bd4-42b4-9a49-7f673cfbfc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.870544 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4839f39-2bd4-42b4-9a49-7f673cfbfc12 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.872179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4839f39-2bd4-42b4-9a49-7f673cfbfc12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.874127 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4839f39-2bd4-42b4-9a49-7f673cfbfc12 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.892031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 777/1572] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/users => generated 302 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:23.893034 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427d7cf-42a9-45d3-9a8b-b1a8a2d31bde admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.900670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 796/1573] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/users => generated 303 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:23.902337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4839f39-2bd4-42b4-9a49-7f673cfbfc12 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.905638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427d7cf-42a9-45d3-9a8b-b1a8a2d31bde admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.911008 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01270d6e-0f1e-4c9b-8d55-f2a488eaa903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.911706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01270d6e-0f1e-4c9b-8d55-f2a488eaa903 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.911990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01270d6e-0f1e-4c9b-8d55-f2a488eaa903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.912267 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01270d6e-0f1e-4c9b-8d55-f2a488eaa903 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.913006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01270d6e-0f1e-4c9b-8d55-f2a488eaa903 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:08:23.913312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01270d6e-0f1e-4c9b-8d55-f2a488eaa903 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.914987 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01270d6e-0f1e-4c9b-8d55-f2a488eaa903 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.915217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4839f39-2bd4-42b4-9a49-7f673cfbfc12 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.920158 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a35ca-6a25-419e-80d0-00bdae0b54bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.920846 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a35ca-6a25-419e-80d0-00bdae0b54bd admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.921135 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a35ca-6a25-419e-80d0-00bdae0b54bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.921411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a35ca-6a25-419e-80d0-00bdae0b54bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.922148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a35ca-6a25-419e-80d0-00bdae0b54bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.924102 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a35ca-6a25-419e-80d0-00bdae0b54bd admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.931608 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 778/1574] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:08:23.932463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01270d6e-0f1e-4c9b-8d55-f2a488eaa903 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:23.944574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01270d6e-0f1e-4c9b-8d55-f2a488eaa903 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:23.950493 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83591820-b111-4110-b922-b419aa11ed55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:23.951211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83591820-b111-4110-b922-b419aa11ed55 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.951517 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83591820-b111-4110-b922-b419aa11ed55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.951765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83591820-b111-4110-b922-b419aa11ed55 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.952481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83591820-b111-4110-b922-b419aa11ed55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:23.954481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83591820-b111-4110-b922-b419aa11ed55 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:23.962463 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 797/1575] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/projects => generated 393 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:23.964252 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3cb1b-9100-4d0a-acdc-2ab634893651 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:23.964741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3cb1b-9100-4d0a-acdc-2ab634893651 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:23.965174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3cb1b-9100-4d0a-acdc-2ab634893651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:23.989109 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2be3cb1b-9100-4d0a-acdc-2ab634893651 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:23.994340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 779/1576] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/users => generated 287 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:23.994603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2be3cb1b-9100-4d0a-acdc-2ab634893651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:23.994755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83591820-b111-4110-b922-b419aa11ed55 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.002578 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83591820-b111-4110-b922-b419aa11ed55 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.071760 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 798/1577] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:24.072720 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3cb1b-9100-4d0a-acdc-2ab634893651 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.076899 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5682850-c83a-4973-97a3-3dbea1c0c986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.077397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5682850-c83a-4973-97a3-3dbea1c0c986 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.077682 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5682850-c83a-4973-97a3-3dbea1c0c986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.078088 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5682850-c83a-4973-97a3-3dbea1c0c986 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.079033 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5682850-c83a-4973-97a3-3dbea1c0c986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.081905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5682850-c83a-4973-97a3-3dbea1c0c986 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.084482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3cb1b-9100-4d0a-acdc-2ab634893651 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.089419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8378de-a44e-4ed1-b795-0023785092c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.091398 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8378de-a44e-4ed1-b795-0023785092c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.091872 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8378de-a44e-4ed1-b795-0023785092c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.092355 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8378de-a44e-4ed1-b795-0023785092c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.093529 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8378de-a44e-4ed1-b795-0023785092c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.097309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8378de-a44e-4ed1-b795-0023785092c2 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.115202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 780/1578] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:23 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:24.116392 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5682850-c83a-4973-97a3-3dbea1c0c986 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.130886 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5682850-c83a-4973-97a3-3dbea1c0c986 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.138755 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 799/1579] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:24 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:24.138970 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738942f-18fa-4e0f-83ca-ef5a4f2b85ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.139856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738942f-18fa-4e0f-83ca-ef5a4f2b85ea admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.140003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8378de-a44e-4ed1-b795-0023785092c2 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.140303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738942f-18fa-4e0f-83ca-ef5a4f2b85ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.140651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738942f-18fa-4e0f-83ca-ef5a4f2b85ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.142156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738942f-18fa-4e0f-83ca-ef5a4f2b85ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.144560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738942f-18fa-4e0f-83ca-ef5a4f2b85ea admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.168961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 781/1580] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:24.168961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738942f-18fa-4e0f-83ca-ef5a4f2b85ea admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.181151 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738942f-18fa-4e0f-83ca-ef5a4f2b85ea admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.220825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8378de-a44e-4ed1-b795-0023785092c2 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.225695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a809e-a3c5-4359-8061-9c7e88e0f9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.226622 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a809e-a3c5-4359-8061-9c7e88e0f9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.226906 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a809e-a3c5-4359-8061-9c7e88e0f9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.227186 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a809e-a3c5-4359-8061-9c7e88e0f9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.227981 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a809e-a3c5-4359-8061-9c7e88e0f9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.229714 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a809e-a3c5-4359-8061-9c7e88e0f9a1 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.241674 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 800/1581] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:24.246016 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a809e-a3c5-4359-8061-9c7e88e0f9a1 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.256042 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5cc47-604b-4fad-a3cd-fe75137ba561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.256751 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5cc47-604b-4fad-a3cd-fe75137ba561 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.257192 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5cc47-604b-4fad-a3cd-fe75137ba561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.257475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5cc47-604b-4fad-a3cd-fe75137ba561 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.258243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5cc47-604b-4fad-a3cd-fe75137ba561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.260235 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5cc47-604b-4fad-a3cd-fe75137ba561 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.265518 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a809e-a3c5-4359-8061-9c7e88e0f9a1 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.273787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c66351-0601-49e8-8264-82dd4182c895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.275012 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c66351-0601-49e8-8264-82dd4182c895 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.275503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c66351-0601-49e8-8264-82dd4182c895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.275992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c66351-0601-49e8-8264-82dd4182c895 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.277417 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c66351-0601-49e8-8264-82dd4182c895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.283464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c66351-0601-49e8-8264-82dd4182c895 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.301492 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 782/1582] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:24 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:24.302700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5cc47-604b-4fad-a3cd-fe75137ba561 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.312006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:24.319862 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 801/1583] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:24 2022] POST /identity/v3/users => generated 297 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:24.320938 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c66351-0601-49e8-8264-82dd4182c895 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.333331 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:24.399073 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5cc47-604b-4fad-a3cd-fe75137ba561 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.406914 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a7042-4d38-4e78-88bd-89bb0942fbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.408055 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a7042-4d38-4e78-88bd-89bb0942fbdf admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.408560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a7042-4d38-4e78-88bd-89bb0942fbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.409070 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a7042-4d38-4e78-88bd-89bb0942fbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.410034 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a7042-4d38-4e78-88bd-89bb0942fbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.412746 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a7042-4d38-4e78-88bd-89bb0942fbdf admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.414600 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c66351-0601-49e8-8264-82dd4182c895 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.432363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 783/1584] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:24.433928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a7042-4d38-4e78-88bd-89bb0942fbdf admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.445483 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a7042-4d38-4e78-88bd-89bb0942fbdf admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.450807 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ebda7-2462-4f7a-9c45-08518fdc8d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.451511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ebda7-2462-4f7a-9c45-08518fdc8d67 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.451797 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ebda7-2462-4f7a-9c45-08518fdc8d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.452076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ebda7-2462-4f7a-9c45-08518fdc8d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.452827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ebda7-2462-4f7a-9c45-08518fdc8d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.454499 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ebda7-2462-4f7a-9c45-08518fdc8d67 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.467419 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 784/1585] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:24.468326 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ebda7-2462-4f7a-9c45-08518fdc8d67 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.479047 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ebda7-2462-4f7a-9c45-08518fdc8d67 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.484335 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eeffe1-f1c2-43c8-87d6-92f84e923221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.484804 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0c4f0-42ab-42c3-807e-3e317f18bf6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.485021 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeffe1-f1c2-43c8-87d6-92f84e923221 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.485304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeffe1-f1c2-43c8-87d6-92f84e923221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.485621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0c4f0-42ab-42c3-807e-3e317f18bf6d service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.485839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeffe1-f1c2-43c8-87d6-92f84e923221 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.486022 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0c4f0-42ab-42c3-807e-3e317f18bf6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.486293 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0c4f0-42ab-42c3-807e-3e317f18bf6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.486473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eeffe1-f1c2-43c8-87d6-92f84e923221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.488405 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eeffe1-f1c2-43c8-87d6-92f84e923221 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.502791 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0c4f0-42ab-42c3-807e-3e317f18bf6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.504320 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0c4f0-42ab-42c3-807e-3e317f18bf6d service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.517664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 802/1586] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:24.518736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0c4f0-42ab-42c3-807e-3e317f18bf6d service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.525091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 785/1587] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:24 2022] POST /identity/v3/users => generated 290 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:24.525091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eeffe1-f1c2-43c8-87d6-92f84e923221 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.534906 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0c4f0-42ab-42c3-807e-3e317f18bf6d service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.538801 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eeffe1-f1c2-43c8-87d6-92f84e923221 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.541230 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a680a4-2a02-47a2-97d9-f99e5452ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.542477 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a680a4-2a02-47a2-97d9-f99e5452ef19 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.543112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a680a4-2a02-47a2-97d9-f99e5452ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.543605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a680a4-2a02-47a2-97d9-f99e5452ef19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.544968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a680a4-2a02-47a2-97d9-f99e5452ef19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.546154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f9625-656e-4670-abf5-da2f9e299cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.547412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f9625-656e-4670-abf5-da2f9e299cee admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.547878 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f9625-656e-4670-abf5-da2f9e299cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.548165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a680a4-2a02-47a2-97d9-f99e5452ef19 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.548489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f9625-656e-4670-abf5-da2f9e299cee admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.549924 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f9625-656e-4670-abf5-da2f9e299cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.553096 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f9625-656e-4670-abf5-da2f9e299cee admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.572547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 803/1588] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:24.574374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a680a4-2a02-47a2-97d9-f99e5452ef19 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.578832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 786/1589] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:24.578832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f9625-656e-4670-abf5-da2f9e299cee admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.591422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a680a4-2a02-47a2-97d9-f99e5452ef19 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.596703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f9625-656e-4670-abf5-da2f9e299cee admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.605366 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9df4d-8ac6-4c95-a548-99f546e5e767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.606703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9df4d-8ac6-4c95-a548-99f546e5e767 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.607276 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9df4d-8ac6-4c95-a548-99f546e5e767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.607835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9df4d-8ac6-4c95-a548-99f546e5e767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.609300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9df4d-8ac6-4c95-a548-99f546e5e767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.612454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9df4d-8ac6-4c95-a548-99f546e5e767 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.613374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b22800-0e55-4ad7-ab5b-d98310c800ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.614811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b22800-0e55-4ad7-ab5b-d98310c800ca admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.615343 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b22800-0e55-4ad7-ab5b-d98310c800ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.616649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b22800-0e55-4ad7-ab5b-d98310c800ca admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.617235 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b22800-0e55-4ad7-ab5b-d98310c800ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.622277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b22800-0e55-4ad7-ab5b-d98310c800ca admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.634400 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 787/1590] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:24.640635 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9df4d-8ac6-4c95-a548-99f546e5e767 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.655478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 804/1591] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:24 2022] POST /identity/v3/users => generated 288 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:24.656444 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b22800-0e55-4ad7-ab5b-d98310c800ca admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.661762 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9df4d-8ac6-4c95-a548-99f546e5e767 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.671962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226b7b1-947c-4068-845f-726ee4fcbdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.672476 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b22800-0e55-4ad7-ab5b-d98310c800ca admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.674493 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226b7b1-947c-4068-845f-726ee4fcbdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.675072 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226b7b1-947c-4068-845f-726ee4fcbdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.675627 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226b7b1-947c-4068-845f-726ee4fcbdd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.677101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226b7b1-947c-4068-845f-726ee4fcbdd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.677621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b47e70-4144-4c3e-9cd2-cc7bfe2ec916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.678410 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b47e70-4144-4c3e-9cd2-cc7bfe2ec916 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.678769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b47e70-4144-4c3e-9cd2-cc7bfe2ec916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.679112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b47e70-4144-4c3e-9cd2-cc7bfe2ec916 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.679934 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b47e70-4144-4c3e-9cd2-cc7bfe2ec916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.680804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226b7b1-947c-4068-845f-726ee4fcbdd0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.681698 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b47e70-4144-4c3e-9cd2-cc7bfe2ec916 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.705041 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 805/1592] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:24.706017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 788/1593] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:24.706577 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b47e70-4144-4c3e-9cd2-cc7bfe2ec916 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.708426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226b7b1-947c-4068-845f-726ee4fcbdd0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.723643 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b47e70-4144-4c3e-9cd2-cc7bfe2ec916 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.727862 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226b7b1-947c-4068-845f-726ee4fcbdd0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.730645 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839be8c-a116-43cb-a435-a4562a4db54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.732247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839be8c-a116-43cb-a435-a4562a4db54f admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.732713 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839be8c-a116-43cb-a435-a4562a4db54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.733197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839be8c-a116-43cb-a435-a4562a4db54f admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.734606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839be8c-a116-43cb-a435-a4562a4db54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.737858 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839be8c-a116-43cb-a435-a4562a4db54f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.738535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a2808-c927-4a05-a024-c0fa86d29d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.740271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a2808-c927-4a05-a024-c0fa86d29d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.740705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a2808-c927-4a05-a024-c0fa86d29d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.741492 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a2808-c927-4a05-a024-c0fa86d29d26 admin admin] PATH_INFO: `/v3/projects/bd0b04a19e4f47b7b6353b41315260ea/users/0b8fd4f6a1304936a571bcbe4bf2cdca/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.761340 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 806/1594] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:24.761340 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839be8c-a116-43cb-a435-a4562a4db54f admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.773123 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a2808-c927-4a05-a024-c0fa86d29d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0b04a19e4f47b7b6353b41315260ea, user_id=0b8fd4f6a1304936a571bcbe4bf2cdca, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.774205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-a41a2808-c927-4a05-a024-c0fa86d29d26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:08:24.774205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: warnings.warn(msg) May 26 21:08:24.774205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: May 26 21:08:24.774717 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839be8c-a116-43cb-a435-a4562a4db54f admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.776345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a2808-c927-4a05-a024-c0fa86d29d26 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.780001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409e10d-d3f5-4077-bb0a-203be235bf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.781266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409e10d-d3f5-4077-bb0a-203be235bf0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.782053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409e10d-d3f5-4077-bb0a-203be235bf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.782875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409e10d-d3f5-4077-bb0a-203be235bf0b admin admin] PATH_INFO: `/v3/projects/03aea834d18f4889961ef6e3f89ef929/users/22d8f6da0e0f430eadb4e2f50679010d/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.809337 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 789/1595] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:24 2022] PUT /identity/v3/projects/bd0b04a19e4f47b7b6353b41315260ea/users/0b8fd4f6a1304936a571bcbe4bf2cdca/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:24.810615 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a2808-c927-4a05-a024-c0fa86d29d26 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.832656 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409e10d-d3f5-4077-bb0a-203be235bf0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=03aea834d18f4889961ef6e3f89ef929, user_id=22d8f6da0e0f430eadb4e2f50679010d, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.840912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409e10d-d3f5-4077-bb0a-203be235bf0b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:24.859868 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 807/1596] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:24 2022] PUT /identity/v3/projects/03aea834d18f4889961ef6e3f89ef929/users/22d8f6da0e0f430eadb4e2f50679010d/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:24.861134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409e10d-d3f5-4077-bb0a-203be235bf0b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:24.940464 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a2808-c927-4a05-a024-c0fa86d29d26 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.963626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:24.977540 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409e10d-d3f5-4077-bb0a-203be235bf0b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:24.980113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:24.983322 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3599bdc-53b8-4435-a501-d8009603188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:24.984151 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3599bdc-53b8-4435-a501-d8009603188c admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:24.984596 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3599bdc-53b8-4435-a501-d8009603188c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:24.985022 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3599bdc-53b8-4435-a501-d8009603188c admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:24.985924 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3599bdc-53b8-4435-a501-d8009603188c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:24.987681 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3599bdc-53b8-4435-a501-d8009603188c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:25.003772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 808/1597] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:25.003772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3599bdc-53b8-4435-a501-d8009603188c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:25.026734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3599bdc-53b8-4435-a501-d8009603188c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:25.037327 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca519ef6-bc5f-4a15-8e30-ddcb99766549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:25.039619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca519ef6-bc5f-4a15-8e30-ddcb99766549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:25.040680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca519ef6-bc5f-4a15-8e30-ddcb99766549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:25.041114 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca519ef6-bc5f-4a15-8e30-ddcb99766549 admin admin] PATH_INFO: `/v3/projects/233ad150f5ee448c8c12be4ffedaf912/users/16cce5c9283249109069bc13205c47cf/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:25.063275 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016d61b-12f4-4380-ba6a-8d0304bff515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:25.064573 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016d61b-12f4-4380-ba6a-8d0304bff515 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:25.065139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016d61b-12f4-4380-ba6a-8d0304bff515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:25.065699 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016d61b-12f4-4380-ba6a-8d0304bff515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:25.067128 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016d61b-12f4-4380-ba6a-8d0304bff515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:25.070142 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016d61b-12f4-4380-ba6a-8d0304bff515 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:25.070867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca519ef6-bc5f-4a15-8e30-ddcb99766549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=233ad150f5ee448c8c12be4ffedaf912, user_id=16cce5c9283249109069bc13205c47cf, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:25.076124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca519ef6-bc5f-4a15-8e30-ddcb99766549 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:25.088650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 790/1598] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:25.090503 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016d61b-12f4-4380-ba6a-8d0304bff515 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:25.110363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016d61b-12f4-4380-ba6a-8d0304bff515 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:25.113926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 809/1599] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:24 2022] PUT /identity/v3/projects/233ad150f5ee448c8c12be4ffedaf912/users/16cce5c9283249109069bc13205c47cf/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:25.116218 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca519ef6-bc5f-4a15-8e30-ddcb99766549 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:25.214687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b65cea-f306-4ab7-85ec-f07fa245ba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:25.216697 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b65cea-f306-4ab7-85ec-f07fa245ba26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:25.216994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b65cea-f306-4ab7-85ec-f07fa245ba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:25.217279 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b65cea-f306-4ab7-85ec-f07fa245ba26 admin admin] PATH_INFO: `/v3/projects/9743f6c1aa7d47a9a32ec8e67d290559/users/ff8d503c43004e0fbd098c805788809c/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:25.236122 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b65cea-f306-4ab7-85ec-f07fa245ba26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9743f6c1aa7d47a9a32ec8e67d290559, user_id=ff8d503c43004e0fbd098c805788809c, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:25.238917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b65cea-f306-4ab7-85ec-f07fa245ba26 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:25.286034 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 791/1600] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:25 2022] PUT /identity/v3/projects/9743f6c1aa7d47a9a32ec8e67d290559/users/ff8d503c43004e0fbd098c805788809c/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:25.290109 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce66e9-0190-4fd3-b0bd-142de359ac51 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:25.293146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce66e9-0190-4fd3-b0bd-142de359ac51 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:25.294161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce66e9-0190-4fd3-b0bd-142de359ac51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:25.315585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca519ef6-bc5f-4a15-8e30-ddcb99766549 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:25.348281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-34ce66e9-0190-4fd3-b0bd-142de359ac51 None None] MFA Rules not processed for user `0b8fd4f6a1304936a571bcbe4bf2cdca`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:25.350451 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-34ce66e9-0190-4fd3-b0bd-142de359ac51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:25.462215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab7a3f-d841-4098-9ad8-3feb18575686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:25.464186 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab7a3f-d841-4098-9ad8-3feb18575686 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:25.465906 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab7a3f-d841-4098-9ad8-3feb18575686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:25.466617 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab7a3f-d841-4098-9ad8-3feb18575686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:25.468034 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab7a3f-d841-4098-9ad8-3feb18575686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:25.470720 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab7a3f-d841-4098-9ad8-3feb18575686 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:25.481644 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 792/1601] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:25.484032 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134536c-0358-4894-9544-beee062f4f77 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:25.484488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134536c-0358-4894-9544-beee062f4f77 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:25.484892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134536c-0358-4894-9544-beee062f4f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:25.496195 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 810/1602] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:25.497702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab7a3f-d841-4098-9ad8-3feb18575686 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:25.514400 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4134536c-0358-4894-9544-beee062f4f77 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:25.514727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab7a3f-d841-4098-9ad8-3feb18575686 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:25.516411 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4134536c-0358-4894-9544-beee062f4f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:25.527902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837010f3-6be3-4ff9-acc8-1f91460dc3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:25.527902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837010f3-6be3-4ff9-acc8-1f91460dc3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:25.527902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837010f3-6be3-4ff9-acc8-1f91460dc3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:25.527902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837010f3-6be3-4ff9-acc8-1f91460dc3f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:25.528566 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837010f3-6be3-4ff9-acc8-1f91460dc3f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:25.533608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837010f3-6be3-4ff9-acc8-1f91460dc3f9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:25.541937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 793/1603] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:25.541937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134536c-0358-4894-9544-beee062f4f77 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:25.557319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 811/1604] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:25.560498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a2008-7183-4860-86b9-fdc2636ba611 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:25.561304 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a2008-7183-4860-86b9-fdc2636ba611 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:25.562020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a2008-7183-4860-86b9-fdc2636ba611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:25.563327 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134536c-0358-4894-9544-beee062f4f77 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:25.570726 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20139e55-cf3c-4202-b266-a2a7793ffa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:25.572362 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20139e55-cf3c-4202-b266-a2a7793ffa71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:25.572819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20139e55-cf3c-4202-b266-a2a7793ffa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:25.574548 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20139e55-cf3c-4202-b266-a2a7793ffa71 admin admin] PATH_INFO: `/v3/projects/5b83792633104e04bb4bf4a4d4c9e5c6/users/c1f33c40207e4701bb5bbd680d729c48/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:25.601092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20139e55-cf3c-4202-b266-a2a7793ffa71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b83792633104e04bb4bf4a4d4c9e5c6, user_id=c1f33c40207e4701bb5bbd680d729c48, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:25.604188 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20139e55-cf3c-4202-b266-a2a7793ffa71 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:25.610694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-c29a2008-7183-4860-86b9-fdc2636ba611 None None] MFA Rules not processed for user `16cce5c9283249109069bc13205c47cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:25.612302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c29a2008-7183-4860-86b9-fdc2636ba611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:25.619073 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:25.637329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 794/1605] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:25 2022] PUT /identity/v3/projects/5b83792633104e04bb4bf4a4d4c9e5c6/users/c1f33c40207e4701bb5bbd680d729c48/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:25.637329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6031a-6a61-4ddb-a7f8-5d2907606df2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:25.637329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6031a-6a61-4ddb-a7f8-5d2907606df2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:25.637329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6031a-6a61-4ddb-a7f8-5d2907606df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:25.682753 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e7e6031a-6a61-4ddb-a7f8-5d2907606df2 None None] MFA Rules not processed for user `ff8d503c43004e0fbd098c805788809c`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:25.685910 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e7e6031a-6a61-4ddb-a7f8-5d2907606df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:25.710638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:25.793825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 812/1606] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:25.795882 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a2008-7183-4860-86b9-fdc2636ba611 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:25.825677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 795/1607] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:25.825677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6031a-6a61-4ddb-a7f8-5d2907606df2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:25.845931 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a2008-7183-4860-86b9-fdc2636ba611 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:26.007645 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb532b3-b64a-4a08-9552-87fd413a0517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:26.008887 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb532b3-b64a-4a08-9552-87fd413a0517 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:26.009349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6031a-6a61-4ddb-a7f8-5d2907606df2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:26.009666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb532b3-b64a-4a08-9552-87fd413a0517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:26.010152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb532b3-b64a-4a08-9552-87fd413a0517 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:26.011711 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb532b3-b64a-4a08-9552-87fd413a0517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:26.017003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb532b3-b64a-4a08-9552-87fd413a0517 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:26.018819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634411e-3c12-488f-847f-63a3a98a5b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:26.019993 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634411e-3c12-488f-847f-63a3a98a5b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:26.020873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634411e-3c12-488f-847f-63a3a98a5b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:26.021362 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634411e-3c12-488f-847f-63a3a98a5b3e admin admin] PATH_INFO: `/v3/projects/ecf7ee56410d4385b08fcd40dd1a5127/users/ad0474bb478444a1a329194b7a41696a/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:26.052593 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634411e-3c12-488f-847f-63a3a98a5b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf7ee56410d4385b08fcd40dd1a5127, user_id=ad0474bb478444a1a329194b7a41696a, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:26.061130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634411e-3c12-488f-847f-63a3a98a5b3e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:26.076472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 813/1608] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:25 2022] POST /identity/v3/projects => generated 405 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:26.078857 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb532b3-b64a-4a08-9552-87fd413a0517 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:26.100331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 796/1609] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:25 2022] PUT /identity/v3/projects/ecf7ee56410d4385b08fcd40dd1a5127/users/ad0474bb478444a1a329194b7a41696a/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:26.101863 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634411e-3c12-488f-847f-63a3a98a5b3e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:26.170204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb532b3-b64a-4a08-9552-87fd413a0517 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:26.264667 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404394e-49cf-43d9-8a48-85ed07b00f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:26.266552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404394e-49cf-43d9-8a48-85ed07b00f0f service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:26.267285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404394e-49cf-43d9-8a48-85ed07b00f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:26.267462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634411e-3c12-488f-847f-63a3a98a5b3e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:26.268150 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404394e-49cf-43d9-8a48-85ed07b00f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:26.282870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ea428-3f1c-4ace-bc8c-0d2993199587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:26.284144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ea428-3f1c-4ace-bc8c-0d2993199587 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:26.284594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ea428-3f1c-4ace-bc8c-0d2993199587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:26.285245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ea428-3f1c-4ace-bc8c-0d2993199587 admin admin] PATH_INFO: `/v3/projects/0cca24842f134ae4943ce54aa1b65254/users/f215554a96e0461aa1dc78f930586cf3/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:26.289653 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404394e-49cf-43d9-8a48-85ed07b00f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:26.293949 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404394e-49cf-43d9-8a48-85ed07b00f0f service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:26.304796 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ea428-3f1c-4ace-bc8c-0d2993199587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cca24842f134ae4943ce54aa1b65254, user_id=f215554a96e0461aa1dc78f930586cf3, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:26.308888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ea428-3f1c-4ace-bc8c-0d2993199587 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:26.313317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:26.314714 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 814/1610] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:26.317128 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b5ef5-db1d-46e8-bcc6-a99ef3a8a98b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:26.317683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b5ef5-db1d-46e8-bcc6-a99ef3a8a98b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:26.318121 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b5ef5-db1d-46e8-bcc6-a99ef3a8a98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:26.337148 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 797/1611] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:26 2022] PUT /identity/v3/projects/0cca24842f134ae4943ce54aa1b65254/users/f215554a96e0461aa1dc78f930586cf3/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:26.339991 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cc4c6-89fb-4601-b155-d88d5fc8661e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:26.340815 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cc4c6-89fb-4601-b155-d88d5fc8661e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:26.341677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cc4c6-89fb-4601-b155-d88d5fc8661e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:26.344416 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 798/1612] 10.222.0.61 () {54 vars in 961 bytes} [Thu May 26 21:08:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:08:26.347460 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebf256-769b-4c4c-b20a-e8517b321b46 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:26.348592 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebf256-769b-4c4c-b20a-e8517b321b46 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:26.349450 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebf256-769b-4c4c-b20a-e8517b321b46 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:26.353318 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 799/1613] 10.222.0.61 () {54 vars in 961 bytes} [Thu May 26 21:08:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:08:26.356229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebf256-769b-4c4c-b20a-e8517b321b46 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:26.356450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-7a9b5ef5-db1d-46e8-bcc6-a99ef3a8a98b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:26.359056 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7a9b5ef5-db1d-46e8-bcc6-a99ef3a8a98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:26.421719 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:26.504879 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebf256-769b-4c4c-b20a-e8517b321b46 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:26.505171 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 815/1614] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:26.508541 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245911d-00fa-432c-8477-3d440c6052b8 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:26.509334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245911d-00fa-432c-8477-3d440c6052b8 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:26.509966 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245911d-00fa-432c-8477-3d440c6052b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:26.511929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463755e5-cd85-4940-823c-d08fa5cca246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:26.513126 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463755e5-cd85-4940-823c-d08fa5cca246 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:26.513660 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463755e5-cd85-4940-823c-d08fa5cca246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:26.514186 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463755e5-cd85-4940-823c-d08fa5cca246 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:26.516698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463755e5-cd85-4940-823c-d08fa5cca246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:26.520029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463755e5-cd85-4940-823c-d08fa5cca246 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:26.557682 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-5245911d-00fa-432c-8477-3d440c6052b8 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:26.560069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5245911d-00fa-432c-8477-3d440c6052b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:26.565930 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 800/1615] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:26 2022] POST /identity/v3/users => generated 309 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:26.570994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b9d01-7dea-4050-b276-0d22157ce91e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:26.571511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b9d01-7dea-4050-b276-0d22157ce91e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:26.572240 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b9d01-7dea-4050-b276-0d22157ce91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:26.576953 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 816/1616] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:26.576953 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fabb00-9c09-4445-a3f1-57dc5a722cc1 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:26.576953 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fabb00-9c09-4445-a3f1-57dc5a722cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:26.576953 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fabb00-9c09-4445-a3f1-57dc5a722cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:26.612962 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d9fabb00-9c09-4445-a3f1-57dc5a722cc1 None None] MFA Rules not processed for user `a99b767501244338bc48fb5428a589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:26.617249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d9fabb00-9c09-4445-a3f1-57dc5a722cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:26.619838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-211b9d01-7dea-4050-b276-0d22157ce91e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:26.624679 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-211b9d01-7dea-4050-b276-0d22157ce91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:26.643529 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 801/1617] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:26.652050 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a88e29-bd4a-4ae4-9240-1de1387b3a1d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:26.652972 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a88e29-bd4a-4ae4-9240-1de1387b3a1d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:26.653692 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a88e29-bd4a-4ae4-9240-1de1387b3a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:26.714124 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-63a88e29-bd4a-4ae4-9240-1de1387b3a1d None None] MFA Rules not processed for user `a99b767501244338bc48fb5428a589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:26.715914 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-63a88e29-bd4a-4ae4-9240-1de1387b3a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:26.858154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 802/1618] 10.222.0.61 () {58 vars in 1058 bytes} [Thu May 26 21:08:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:26.859238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a88e29-bd4a-4ae4-9240-1de1387b3a1d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:26.959081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 817/1619] 10.222.0.61 () {58 vars in 1058 bytes} [Thu May 26 21:08:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:26.960424 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fabb00-9c09-4445-a3f1-57dc5a722cc1 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:26.966888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a88e29-bd4a-4ae4-9240-1de1387b3a1d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:26.970825 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3839ac-99e3-4fe9-9a2e-fe8f730fdbe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:26.971520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3839ac-99e3-4fe9-9a2e-fe8f730fdbe9 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:26.971808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3839ac-99e3-4fe9-9a2e-fe8f730fdbe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:26.972090 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3839ac-99e3-4fe9-9a2e-fe8f730fdbe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:26.974358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fabb00-9c09-4445-a3f1-57dc5a722cc1 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:26.980956 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed9e4c-9873-4e1e-83a6-f6ff5d35685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:26.982022 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed9e4c-9873-4e1e-83a6-f6ff5d35685e admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:26.982486 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed9e4c-9873-4e1e-83a6-f6ff5d35685e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:26.982917 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed9e4c-9873-4e1e-83a6-f6ff5d35685e admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:26.983823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed9e4c-9873-4e1e-83a6-f6ff5d35685e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:26.985897 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed9e4c-9873-4e1e-83a6-f6ff5d35685e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:26.997856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3839ac-99e3-4fe9-9a2e-fe8f730fdbe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:26.999495 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3839ac-99e3-4fe9-9a2e-fe8f730fdbe9 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:27.003508 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 818/1620] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:27.005485 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed9e4c-9873-4e1e-83a6-f6ff5d35685e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:27.013169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 803/1621] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:27.014293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3839ac-99e3-4fe9-9a2e-fe8f730fdbe9 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:27.024135 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3839ac-99e3-4fe9-9a2e-fe8f730fdbe9 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:27.028258 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed9e4c-9873-4e1e-83a6-f6ff5d35685e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:27.029636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c02333-1e90-4f97-b11f-c70c8b583db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:27.030927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c02333-1e90-4f97-b11f-c70c8b583db6 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:27.031134 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c02333-1e90-4f97-b11f-c70c8b583db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:27.031394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c02333-1e90-4f97-b11f-c70c8b583db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:27.035934 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8950fe-029e-4180-b9c2-a768ad875208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:27.037198 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8950fe-029e-4180-b9c2-a768ad875208 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:27.037492 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8950fe-029e-4180-b9c2-a768ad875208 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:27.037770 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8950fe-029e-4180-b9c2-a768ad875208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:27.049943 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c02333-1e90-4f97-b11f-c70c8b583db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:27.052580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c02333-1e90-4f97-b11f-c70c8b583db6 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:27.055235 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8950fe-029e-4180-b9c2-a768ad875208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:27.058673 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8950fe-029e-4180-b9c2-a768ad875208 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:27.072153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:27.083803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 819/1622] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:27.084953 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 804/1623] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:27.086017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c02333-1e90-4f97-b11f-c70c8b583db6 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:27.086148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8950fe-029e-4180-b9c2-a768ad875208 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:27.104124 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c02333-1e90-4f97-b11f-c70c8b583db6 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:27.110941 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13225f33-fe60-4ee6-acfc-151440f85162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:27.112390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13225f33-fe60-4ee6-acfc-151440f85162 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:27.112390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13225f33-fe60-4ee6-acfc-151440f85162 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:27.112983 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13225f33-fe60-4ee6-acfc-151440f85162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:27.138533 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8950fe-029e-4180-b9c2-a768ad875208 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:27.153029 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78a9a6-ca27-4b1b-8b71-b36a3d7d4dc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:27.154728 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78a9a6-ca27-4b1b-8b71-b36a3d7d4dc9 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:27.155332 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78a9a6-ca27-4b1b-8b71-b36a3d7d4dc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:27.158307 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78a9a6-ca27-4b1b-8b71-b36a3d7d4dc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:27.219677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13225f33-fe60-4ee6-acfc-151440f85162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:27.221868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13225f33-fe60-4ee6-acfc-151440f85162 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:27.251766 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 805/1624] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:27.254776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13225f33-fe60-4ee6-acfc-151440f85162 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:27.295680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13225f33-fe60-4ee6-acfc-151440f85162 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:27.326085 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d8253-fcf4-4c97-84d8-c4974f38dc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:27.327827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d8253-fcf4-4c97-84d8-c4974f38dc1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:27.328375 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d8253-fcf4-4c97-84d8-c4974f38dc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:27.328931 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d8253-fcf4-4c97-84d8-c4974f38dc1d admin admin] PATH_INFO: `/v3/projects/64d8bb421deb4ba68fa08799f459bc71/users/2de55a2e917443cb805b253701157d23/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:27.361915 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78a9a6-ca27-4b1b-8b71-b36a3d7d4dc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:27.390874 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78a9a6-ca27-4b1b-8b71-b36a3d7d4dc9 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:27.428441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d8253-fcf4-4c97-84d8-c4974f38dc1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d8bb421deb4ba68fa08799f459bc71, user_id=2de55a2e917443cb805b253701157d23, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:27.434192 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d8253-fcf4-4c97-84d8-c4974f38dc1d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:27.446060 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 820/1625] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:27.483176 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 806/1626] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:27 2022] PUT /identity/v3/projects/64d8bb421deb4ba68fa08799f459bc71/users/2de55a2e917443cb805b253701157d23/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:27.487700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78a9a6-ca27-4b1b-8b71-b36a3d7d4dc9 service nova] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:27.515750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78a9a6-ca27-4b1b-8b71-b36a3d7d4dc9 service nova] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:27.610036 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:27.729010 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6bcd8-f4ee-4897-88f5-5063c357cd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:27.730264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6bcd8-f4ee-4897-88f5-5063c357cd64 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:27.731568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6bcd8-f4ee-4897-88f5-5063c357cd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:27.732091 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6bcd8-f4ee-4897-88f5-5063c357cd64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:27.733649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6bcd8-f4ee-4897-88f5-5063c357cd64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:27.736808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6bcd8-f4ee-4897-88f5-5063c357cd64 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:27.766957 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d8253-fcf4-4c97-84d8-c4974f38dc1d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:27.775845 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 821/1627] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:08:27.785376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d8253-fcf4-4c97-84d8-c4974f38dc1d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:27.796525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68236e-2208-4f1c-8f86-8e19a56e77f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:27.798679 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68236e-2208-4f1c-8f86-8e19a56e77f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:27.799177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68236e-2208-4f1c-8f86-8e19a56e77f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:27.799964 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68236e-2208-4f1c-8f86-8e19a56e77f8 admin admin] PATH_INFO: `/v3/projects/64d8bb421deb4ba68fa08799f459bc71/users/2de55a2e917443cb805b253701157d23/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:27.804172 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68236e-2208-4f1c-8f86-8e19a56e77f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d8bb421deb4ba68fa08799f459bc71, user_id=2de55a2e917443cb805b253701157d23, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:27.810547 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68236e-2208-4f1c-8f86-8e19a56e77f8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:27.834555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 807/1628] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:27 2022] PUT /identity/v3/projects/64d8bb421deb4ba68fa08799f459bc71/users/2de55a2e917443cb805b253701157d23/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:27.856770 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073e4c-6747-4553-9623-5a4703ae22af None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:27.857447 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073e4c-6747-4553-9623-5a4703ae22af None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:27.858474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073e4c-6747-4553-9623-5a4703ae22af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:27.953032 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d6073e4c-6747-4553-9623-5a4703ae22af None None] MFA Rules not processed for user `2de55a2e917443cb805b253701157d23`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:27.955875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d6073e4c-6747-4553-9623-5a4703ae22af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:28.046478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01392f-61e1-4dbf-a99c-d12c85e808a1 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:28.047051 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01392f-61e1-4dbf-a99c-d12c85e808a1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:28.048400 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01392f-61e1-4dbf-a99c-d12c85e808a1 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:28.052826 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 808/1629] 10.222.0.61 () {54 vars in 912 bytes} [Thu May 26 21:08:28 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:08:28.067600 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d565a7f-ac7c-41ea-993e-70c45da4b488 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:28.069512 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d565a7f-ac7c-41ea-993e-70c45da4b488 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:28.070469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d565a7f-ac7c-41ea-993e-70c45da4b488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:28.184694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 822/1630] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:27 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:28.187125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0d565a7f-ac7c-41ea-993e-70c45da4b488 None None] MFA Rules not processed for user `a99b767501244338bc48fb5428a589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:28.188129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cd418-8aeb-41fe-92ec-bc9507b4f440 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:28.188607 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cd418-8aeb-41fe-92ec-bc9507b4f440 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:28.191603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cd418-8aeb-41fe-92ec-bc9507b4f440 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:28.194076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0d565a7f-ac7c-41ea-993e-70c45da4b488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:28.200948 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 823/1631] 10.222.0.61 () {54 vars in 912 bytes} [Thu May 26 21:08:28 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:08:28.211821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464cfeb-894f-4efe-9277-063d42015a00 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:28.212402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464cfeb-894f-4efe-9277-063d42015a00 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:28.212974 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464cfeb-894f-4efe-9277-063d42015a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:28.264756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2464cfeb-894f-4efe-9277-063d42015a00 None None] MFA Rules not processed for user `a99b767501244338bc48fb5428a589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:28.268336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2464cfeb-894f-4efe-9277-063d42015a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:28.443585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 809/1632] 10.222.0.61 () {58 vars in 1009 bytes} [Thu May 26 21:08:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:28.445422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d565a7f-ac7c-41ea-993e-70c45da4b488 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:28.585189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 824/1633] 10.222.0.61 () {58 vars in 1009 bytes} [Thu May 26 21:08:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:28.591759 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464cfeb-894f-4efe-9277-063d42015a00 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:28.620109 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d565a7f-ac7c-41ea-993e-70c45da4b488 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:28.629537 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da94b3-3bc9-47fe-b261-c4ad5ecaa500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:28.630264 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da94b3-3bc9-47fe-b261-c4ad5ecaa500 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:28.630553 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da94b3-3bc9-47fe-b261-c4ad5ecaa500 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:28.630823 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da94b3-3bc9-47fe-b261-c4ad5ecaa500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:28.650680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:28.663366 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da94b3-3bc9-47fe-b261-c4ad5ecaa500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:28.665020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da94b3-3bc9-47fe-b261-c4ad5ecaa500 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:28.710196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 810/1634] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:28 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:28.829484 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:28.902409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464cfeb-894f-4efe-9277-063d42015a00 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:28.921496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36571e41-86ef-4a64-9ffa-15cf1fc90575 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:28.922255 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571e41-86ef-4a64-9ffa-15cf1fc90575 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:28.922621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571e41-86ef-4a64-9ffa-15cf1fc90575 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:28.922787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571e41-86ef-4a64-9ffa-15cf1fc90575 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:28.942078 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da94b3-3bc9-47fe-b261-c4ad5ecaa500 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:28.956450 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da94b3-3bc9-47fe-b261-c4ad5ecaa500 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:28.967435 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36571e41-86ef-4a64-9ffa-15cf1fc90575 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:28.969622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc3507-8380-434e-bd6f-bc0176191f34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:28.971969 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc3507-8380-434e-bd6f-bc0176191f34 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:28.972493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36571e41-86ef-4a64-9ffa-15cf1fc90575 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:28.972865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc3507-8380-434e-bd6f-bc0176191f34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:28.973308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc3507-8380-434e-bd6f-bc0176191f34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:28.989556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc3507-8380-434e-bd6f-bc0176191f34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:28.993102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc3507-8380-434e-bd6f-bc0176191f34 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:29.009754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 811/1635] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:08:29.012839 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 825/1636] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:30.484113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a969cb-7249-42c7-aae6-def58ecdfd6f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:30.485091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a969cb-7249-42c7-aae6-def58ecdfd6f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:30.491813 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a969cb-7249-42c7-aae6-def58ecdfd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:30.493222 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a65dd-087b-465e-a3fa-1a682081a91b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:30.493781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a65dd-087b-465e-a3fa-1a682081a91b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:30.494264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a65dd-087b-465e-a3fa-1a682081a91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:30.562577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-30a969cb-7249-42c7-aae6-def58ecdfd6f None None] MFA Rules not processed for user `22d8f6da0e0f430eadb4e2f50679010d`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:30.573365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-30a969cb-7249-42c7-aae6-def58ecdfd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:30.614712 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-331a65dd-087b-465e-a3fa-1a682081a91b None None] MFA Rules not processed for user `ad0474bb478444a1a329194b7a41696a`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:30.624397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-331a65dd-087b-465e-a3fa-1a682081a91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:30.870397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 812/1637] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:30 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:30.872902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a969cb-7249-42c7-aae6-def58ecdfd6f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:30.937525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 826/1638] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:30.948123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6aec0-dff0-4156-a3e6-8029ec3d7d4e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:30.949378 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6aec0-dff0-4156-a3e6-8029ec3d7d4e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:30.949768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6aec0-dff0-4156-a3e6-8029ec3d7d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:30.985080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-05a6aec0-dff0-4156-a3e6-8029ec3d7d4e None None] MFA Rules not processed for user `ad0474bb478444a1a329194b7a41696a`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:30.987682 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-05a6aec0-dff0-4156-a3e6-8029ec3d7d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:31.013232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 827/1639] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:31.142271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a969cb-7249-42c7-aae6-def58ecdfd6f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:31.166010 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94020aea-0420-4c70-9700-df3b6fc52f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:31.167923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94020aea-0420-4c70-9700-df3b6fc52f7c admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:31.168374 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94020aea-0420-4c70-9700-df3b6fc52f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:31.170202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94020aea-0420-4c70-9700-df3b6fc52f7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:31.171416 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94020aea-0420-4c70-9700-df3b6fc52f7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:31.189885 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94020aea-0420-4c70-9700-df3b6fc52f7c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:31.319072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6aec0-dff0-4156-a3e6-8029ec3d7d4e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:31.328300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 813/1640] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:30 2022] POST /identity/v3/projects => generated 405 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:31.347860 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6aec0-dff0-4156-a3e6-8029ec3d7d4e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:31.378104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94020aea-0420-4c70-9700-df3b6fc52f7c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:31.618902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd6715-5e37-4eb6-bb63-6b49a89bbf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:31.619773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd6715-5e37-4eb6-bb63-6b49a89bbf30 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:31.620070 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd6715-5e37-4eb6-bb63-6b49a89bbf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:31.620353 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd6715-5e37-4eb6-bb63-6b49a89bbf30 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:31.621383 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd6715-5e37-4eb6-bb63-6b49a89bbf30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:31.623919 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd6715-5e37-4eb6-bb63-6b49a89bbf30 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:31.643733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:31.682321 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94020aea-0420-4c70-9700-df3b6fc52f7c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:31.700244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 828/1641] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:31 2022] POST /identity/v3/users => generated 309 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:31.704002 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd6715-5e37-4eb6-bb63-6b49a89bbf30 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:31.708807 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01cbb4-c9c8-4fd0-97f0-cb91fbd1ad97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:31.711463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01cbb4-c9c8-4fd0-97f0-cb91fbd1ad97 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:31.712023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01cbb4-c9c8-4fd0-97f0-cb91fbd1ad97 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:31.713756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01cbb4-c9c8-4fd0-97f0-cb91fbd1ad97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:31.744569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd6715-5e37-4eb6-bb63-6b49a89bbf30 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:31.762937 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ef014-76aa-44b7-ae7e-1e799704bd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:31.764920 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ef014-76aa-44b7-ae7e-1e799704bd00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:31.765662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ef014-76aa-44b7-ae7e-1e799704bd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:31.766363 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ef014-76aa-44b7-ae7e-1e799704bd00 admin admin] PATH_INFO: `/v3/users/0b8fd4f6a1304936a571bcbe4bf2cdca` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:31.771262 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ef014-76aa-44b7-ae7e-1e799704bd00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b8fd4f6a1304936a571bcbe4bf2cdca)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:31.779756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ef014-76aa-44b7-ae7e-1e799704bd00 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:31.944184 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01cbb4-c9c8-4fd0-97f0-cb91fbd1ad97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:31.945833 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01cbb4-c9c8-4fd0-97f0-cb91fbd1ad97 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:31.986693 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 814/1642] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:31.987320 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-199ef014-76aa-44b7-ae7e-1e799704bd00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b8fd4f6a1304936a571bcbe4bf2cdca'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:31.987504 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01cbb4-c9c8-4fd0-97f0-cb91fbd1ad97 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:32.017381 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01cbb4-c9c8-4fd0-97f0-cb91fbd1ad97 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:32.025732 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:32.033728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c87e1b-6899-419d-911b-2c4b199b8cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:32.035261 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c87e1b-6899-419d-911b-2c4b199b8cea admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:32.035715 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c87e1b-6899-419d-911b-2c4b199b8cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:32.037147 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c87e1b-6899-419d-911b-2c4b199b8cea admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:32.038629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c87e1b-6899-419d-911b-2c4b199b8cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:32.050082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c87e1b-6899-419d-911b-2c4b199b8cea admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:32.056317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-199ef014-76aa-44b7-ae7e-1e799704bd00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b8fd4f6a1304936a571bcbe4bf2cdca'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:32.058630 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-199ef014-76aa-44b7-ae7e-1e799704bd00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b8fd4f6a1304936a571bcbe4bf2cdca'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:32.081408 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-199ef014-76aa-44b7-ae7e-1e799704bd00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b8fd4f6a1304936a571bcbe4bf2cdca'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:32.096410 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-199ef014-76aa-44b7-ae7e-1e799704bd00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b8fd4f6a1304936a571bcbe4bf2cdca'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:32.121704 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 829/1643] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:08:31 2022] DELETE /identity/v3/users/0b8fd4f6a1304936a571bcbe4bf2cdca => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:32.126544 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 815/1644] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:32.126786 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ef014-76aa-44b7-ae7e-1e799704bd00 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:32.129289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-199ef014-76aa-44b7-ae7e-1e799704bd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:32.130910 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a4040-7080-4d82-9fb8-e91b3a1f6112 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:32.131334 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a4040-7080-4d82-9fb8-e91b3a1f6112 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:32.131721 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a4040-7080-4d82-9fb8-e91b3a1f6112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:32.213186 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ff5a4040-7080-4d82-9fb8-e91b3a1f6112 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:32.215360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ff5a4040-7080-4d82-9fb8-e91b3a1f6112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:32.351007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ef014-76aa-44b7-ae7e-1e799704bd00 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:32.369621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa536d-22f0-46f5-b6bc-c7e33219efbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:32.376295 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa536d-22f0-46f5-b6bc-c7e33219efbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:32.377223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa536d-22f0-46f5-b6bc-c7e33219efbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:32.378599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa536d-22f0-46f5-b6bc-c7e33219efbb admin admin] PATH_INFO: `/v3/projects/460640d5a44d425aaf439fc4384704c3/users/948551c3715d4a05853a411182d8e2c7/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:32.435569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa536d-22f0-46f5-b6bc-c7e33219efbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=460640d5a44d425aaf439fc4384704c3, user_id=948551c3715d4a05853a411182d8e2c7, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:32.442425 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa536d-22f0-46f5-b6bc-c7e33219efbb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:32.463763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 816/1645] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:32.483086 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a4040-7080-4d82-9fb8-e91b3a1f6112 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:32.483845 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 830/1646] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:32 2022] PUT /identity/v3/projects/460640d5a44d425aaf439fc4384704c3/users/948551c3715d4a05853a411182d8e2c7/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:32.494936 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a4040-7080-4d82-9fb8-e91b3a1f6112 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:32.570343 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073183a-9227-4dc6-a721-d9d6f761e6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:32.571704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073183a-9227-4dc6-a721-d9d6f761e6cd admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:32.571704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073183a-9227-4dc6-a721-d9d6f761e6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:32.572133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073183a-9227-4dc6-a721-d9d6f761e6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:32.573047 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073183a-9227-4dc6-a721-d9d6f761e6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:32.576244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073183a-9227-4dc6-a721-d9d6f761e6cd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:32.582626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa536d-22f0-46f5-b6bc-c7e33219efbb admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:32.584746 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-06fa536d-22f0-46f5-b6bc-c7e33219efbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:32.623428 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 817/1647] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:32.627495 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073183a-9227-4dc6-a721-d9d6f761e6cd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:32.656888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073183a-9227-4dc6-a721-d9d6f761e6cd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:32.671920 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436368f-a5fb-4097-b444-e3d70f28ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:32.675699 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436368f-a5fb-4097-b444-e3d70f28ff65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:32.676401 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436368f-a5fb-4097-b444-e3d70f28ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:32.677485 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436368f-a5fb-4097-b444-e3d70f28ff65 admin admin] PATH_INFO: `/v3/projects/460640d5a44d425aaf439fc4384704c3/users/948551c3715d4a05853a411182d8e2c7/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:32.684077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436368f-a5fb-4097-b444-e3d70f28ff65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460640d5a44d425aaf439fc4384704c3, user_id=948551c3715d4a05853a411182d8e2c7, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:32.701383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436368f-a5fb-4097-b444-e3d70f28ff65 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:32.752166 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 818/1648] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:32 2022] PUT /identity/v3/projects/460640d5a44d425aaf439fc4384704c3/users/948551c3715d4a05853a411182d8e2c7/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:32.872064 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa536d-22f0-46f5-b6bc-c7e33219efbb admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:33.080773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305d3c7-e466-4460-9cfc-02d543693aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:33.088782 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305d3c7-e466-4460-9cfc-02d543693aaa service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:33.089488 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305d3c7-e466-4460-9cfc-02d543693aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:33.090196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305d3c7-e466-4460-9cfc-02d543693aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:33.172159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:33.337904 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305d3c7-e466-4460-9cfc-02d543693aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:33.349206 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305d3c7-e466-4460-9cfc-02d543693aaa service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:33.372091 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 831/1649] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 791 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:08:33.773465 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0559cd7-f2ff-4431-a3e2-4c8024781ef4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:33.775099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0559cd7-f2ff-4431-a3e2-4c8024781ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:33.775538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0559cd7-f2ff-4431-a3e2-4c8024781ef4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:33.777525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 819/1650] 10.222.0.61 () {54 vars in 912 bytes} [Thu May 26 21:08:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:08:33.789558 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa5ae9-7cdc-4316-967a-ff0763c3c94b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:33.790107 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa5ae9-7cdc-4316-967a-ff0763c3c94b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:33.790801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa5ae9-7cdc-4316-967a-ff0763c3c94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:33.880279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-91fa5ae9-7cdc-4316-967a-ff0763c3c94b None None] MFA Rules not processed for user `e3514a1833104114894abe6c41ea30a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:33.881548 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-91fa5ae9-7cdc-4316-967a-ff0763c3c94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:33.918988 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 832/1651] 10.222.0.61 () {58 vars in 1009 bytes} [Thu May 26 21:08:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:33.957727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0559cd7-f2ff-4431-a3e2-4c8024781ef4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:33.991101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0559cd7-f2ff-4431-a3e2-4c8024781ef4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:33.995044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a46e9-4718-4009-98fa-89e75e4b41a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:33.995815 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a46e9-4718-4009-98fa-89e75e4b41a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:33.996623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a46e9-4718-4009-98fa-89e75e4b41a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:33.997375 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a46e9-4718-4009-98fa-89e75e4b41a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:34.001943 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:34.018359 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a46e9-4718-4009-98fa-89e75e4b41a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:34.020175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a46e9-4718-4009-98fa-89e75e4b41a4 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:34.037281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 820/1652] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:35.236510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa5ae9-7cdc-4316-967a-ff0763c3c94b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:35.238058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-91fa5ae9-7cdc-4316-967a-ff0763c3c94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:35.283544 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa5ae9-7cdc-4316-967a-ff0763c3c94b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:35.310534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9088c5-74f8-4210-960b-10629727f5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:35.311470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9088c5-74f8-4210-960b-10629727f5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:35.311779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9088c5-74f8-4210-960b-10629727f5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:35.312061 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9088c5-74f8-4210-960b-10629727f5e3 admin admin] PATH_INFO: `/v3/users/ff8d503c43004e0fbd098c805788809c` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:35.322874 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9088c5-74f8-4210-960b-10629727f5e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff8d503c43004e0fbd098c805788809c)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:35.325941 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9088c5-74f8-4210-960b-10629727f5e3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:35.517751 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8b9088c5-74f8-4210-960b-10629727f5e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff8d503c43004e0fbd098c805788809c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:35.552371 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8b9088c5-74f8-4210-960b-10629727f5e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff8d503c43004e0fbd098c805788809c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:35.553881 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8b9088c5-74f8-4210-960b-10629727f5e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff8d503c43004e0fbd098c805788809c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:35.587917 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8b9088c5-74f8-4210-960b-10629727f5e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff8d503c43004e0fbd098c805788809c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:35.606910 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8b9088c5-74f8-4210-960b-10629727f5e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff8d503c43004e0fbd098c805788809c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:35.629688 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 833/1653] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:08:35 2022] DELETE /identity/v3/users/ff8d503c43004e0fbd098c805788809c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:35.634409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04a000-475e-4cfe-a768-823dcf06c6a7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:35.635788 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04a000-475e-4cfe-a768-823dcf06c6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:35.636401 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04a000-475e-4cfe-a768-823dcf06c6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:35.700073 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-dd04a000-475e-4cfe-a768-823dcf06c6a7 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:35.701368 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dd04a000-475e-4cfe-a768-823dcf06c6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:35.847763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9088c5-74f8-4210-960b-10629727f5e3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:35.850748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8b9088c5-74f8-4210-960b-10629727f5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:35.916485 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 821/1654] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:36.063038 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04a000-475e-4cfe-a768-823dcf06c6a7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:36.065205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dd04a000-475e-4cfe-a768-823dcf06c6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:36.122522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9088c5-74f8-4210-960b-10629727f5e3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:36.159762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ece0c-7b66-4a57-907d-29d94f848b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:36.162049 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ece0c-7b66-4a57-907d-29d94f848b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:36.162538 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ece0c-7b66-4a57-907d-29d94f848b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:36.163015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ece0c-7b66-4a57-907d-29d94f848b2a admin admin] PATH_INFO: `/v3/users/16cce5c9283249109069bc13205c47cf` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:36.165550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ece0c-7b66-4a57-907d-29d94f848b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=16cce5c9283249109069bc13205c47cf)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:36.173757 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ece0c-7b66-4a57-907d-29d94f848b2a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:36.226809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:36.274835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04a000-475e-4cfe-a768-823dcf06c6a7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:36.291449 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1fc85-9906-474a-a059-1f90cd4fea3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:36.292506 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1fc85-9906-474a-a059-1f90cd4fea3c service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:36.292884 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1fc85-9906-474a-a059-1f90cd4fea3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:36.293147 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1fc85-9906-474a-a059-1f90cd4fea3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:36.331861 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1fc85-9906-474a-a059-1f90cd4fea3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:36.333167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1fc85-9906-474a-a059-1f90cd4fea3c service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:36.360127 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2d6ece0c-7b66-4a57-907d-29d94f848b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16cce5c9283249109069bc13205c47cf'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:36.382050 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 822/1655] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:08:36.384638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1fc85-9906-474a-a059-1f90cd4fea3c service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:36.394887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-78f1fc85-9906-474a-a059-1f90cd4fea3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:36.403325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2d6ece0c-7b66-4a57-907d-29d94f848b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16cce5c9283249109069bc13205c47cf'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:36.411114 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2d6ece0c-7b66-4a57-907d-29d94f848b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16cce5c9283249109069bc13205c47cf'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:36.430672 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1fc85-9906-474a-a059-1f90cd4fea3c service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:36.440949 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2d6ece0c-7b66-4a57-907d-29d94f848b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16cce5c9283249109069bc13205c47cf'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:36.447725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:36.449180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:36.449650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:36.454133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb admin admin] PATH_INFO: `/v3/projects/bd0b04a19e4f47b7b6353b41315260ea` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:36.456520 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2d6ece0c-7b66-4a57-907d-29d94f848b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16cce5c9283249109069bc13205c47cf'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:36.458707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd0b04a19e4f47b7b6353b41315260ea)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:36.460724 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:36.480346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 834/1656] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:08:35 2022] DELETE /identity/v3/users/16cce5c9283249109069bc13205c47cf => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:36.487327 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fbbc8-3760-443e-b05e-1e05d8da7bf2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:36.488922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fbbc8-3760-443e-b05e-1e05d8da7bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:36.489510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fbbc8-3760-443e-b05e-1e05d8da7bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:36.546666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e38fbbc8-3760-443e-b05e-1e05d8da7bf2 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:36.556209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e38fbbc8-3760-443e-b05e-1e05d8da7bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:36.662845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd0b04a19e4f47b7b6353b41315260ea', 'request_id': 'req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:36.682651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd0b04a19e4f47b7b6353b41315260ea', 'request_id': 'req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:36.714744 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd0b04a19e4f47b7b6353b41315260ea', 'request_id': 'req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:36.760347 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb admin admin] The token cache is being invalidate because project bd0b04a19e4f47b7b6353b41315260ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:08:36.760839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:36.762269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:36.766014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 823/1657] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:08:36 2022] DELETE /identity/v3/projects/bd0b04a19e4f47b7b6353b41315260ea => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:36.770597 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:36.777630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:36.834028 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 835/1658] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:36.875041 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:36.881655 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fbbc8-3760-443e-b05e-1e05d8da7bf2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:36.883763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e38fbbc8-3760-443e-b05e-1e05d8da7bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:37.074305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c95039-e31d-4fe4-811b-2aa7a861b8fb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:37.090030 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de277a5-d702-4f30-93e8-572f6ddba6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:37.091437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de277a5-d702-4f30-93e8-572f6ddba6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:37.091838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de277a5-d702-4f30-93e8-572f6ddba6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:37.092265 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de277a5-d702-4f30-93e8-572f6ddba6f8 admin admin] PATH_INFO: `/v3/users/2de55a2e917443cb805b253701157d23` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:37.099157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de277a5-d702-4f30-93e8-572f6ddba6f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de55a2e917443cb805b253701157d23)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:37.100379 dv-cinder-828806-3-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-1de277a5-d702-4f30-93e8-572f6ddba6f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:08:37.100379 dv-cinder-828806-3-smb devstack@keystone.service[80323]: warnings.warn(msg) May 26 21:08:37.100379 dv-cinder-828806-3-smb devstack@keystone.service[80323]: May 26 21:08:37.104113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de277a5-d702-4f30-93e8-572f6ddba6f8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:37.140486 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fbbc8-3760-443e-b05e-1e05d8da7bf2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:37.393310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:37.431986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043754f-290d-41e1-a6ac-342b1bf66924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:37.440725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043754f-290d-41e1-a6ac-342b1bf66924 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:37.442369 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043754f-290d-41e1-a6ac-342b1bf66924 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:37.442999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043754f-290d-41e1-a6ac-342b1bf66924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:37.485502 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043754f-290d-41e1-a6ac-342b1bf66924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:37.489782 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043754f-290d-41e1-a6ac-342b1bf66924 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:37.494897 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1de277a5-d702-4f30-93e8-572f6ddba6f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de55a2e917443cb805b253701157d23'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:37.505168 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1de277a5-d702-4f30-93e8-572f6ddba6f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de55a2e917443cb805b253701157d23'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:37.542769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 836/1659] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:37.547935 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdfb47-59f4-49a4-adbb-75cd8b675bf1 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:37.548552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdfb47-59f4-49a4-adbb-75cd8b675bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:37.551574 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdfb47-59f4-49a4-adbb-75cd8b675bf1 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:37.557687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 837/1660] 10.222.0.61 () {54 vars in 960 bytes} [Thu May 26 21:08:37 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:08:37.564122 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1de277a5-d702-4f30-93e8-572f6ddba6f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de55a2e917443cb805b253701157d23'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:37.566567 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2302d71-da26-4472-9a35-31b64fa7ef34 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:37.570340 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2302d71-da26-4472-9a35-31b64fa7ef34 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:37.570807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2302d71-da26-4472-9a35-31b64fa7ef34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:37.632249 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1de277a5-d702-4f30-93e8-572f6ddba6f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de55a2e917443cb805b253701157d23'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:37.633890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a2302d71-da26-4472-9a35-31b64fa7ef34 None None] MFA Rules not processed for user `e8952f35c21c4a2eaf1fbc601fe76242`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:37.638121 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a2302d71-da26-4472-9a35-31b64fa7ef34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:37.695038 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1de277a5-d702-4f30-93e8-572f6ddba6f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de55a2e917443cb805b253701157d23'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:37.740667 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 824/1661] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:08:36 2022] DELETE /identity/v3/users/2de55a2e917443cb805b253701157d23 => generated 0 bytes in 968 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:08:37.810781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 838/1662] 10.222.0.61 () {58 vars in 1057 bytes} [Thu May 26 21:08:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:37.826003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de277a5-d702-4f30-93e8-572f6ddba6f8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:38.044859 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de277a5-d702-4f30-93e8-572f6ddba6f8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:38.068434 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac64da-7fcc-454d-a9c1-26f0478e1f24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8952f35c21c4a2eaf1fbc601fe76242', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:38.072071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac64da-7fcc-454d-a9c1-26f0478e1f24 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:38.072579 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac64da-7fcc-454d-a9c1-26f0478e1f24 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:38.073069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac64da-7fcc-454d-a9c1-26f0478e1f24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:38.080959 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d7ac64da-7fcc-454d-a9c1-26f0478e1f24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:38.118202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac64da-7fcc-454d-a9c1-26f0478e1f24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:38.126755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac64da-7fcc-454d-a9c1-26f0478e1f24 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:38.159558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 825/1663] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:38.926195 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d63f-4c04-4df4-a2ae-9db4d4a216ef None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:38.926802 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d63f-4c04-4df4-a2ae-9db4d4a216ef None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:38.926802 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d63f-4c04-4df4-a2ae-9db4d4a216ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:38.990544 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a4b0d63f-4c04-4df4-a2ae-9db4d4a216ef None None] MFA Rules not processed for user `948551c3715d4a05853a411182d8e2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:38.991829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a4b0d63f-4c04-4df4-a2ae-9db4d4a216ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:39.097655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac64da-7fcc-454d-a9c1-26f0478e1f24 service placement] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:39.102756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d7ac64da-7fcc-454d-a9c1-26f0478e1f24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:39.186774 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:39.198287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 839/1664] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:38 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:39.244814 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9de26-31f1-4890-80ec-5fdd2e02a002 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:39.245086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9de26-31f1-4890-80ec-5fdd2e02a002 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:39.245682 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9de26-31f1-4890-80ec-5fdd2e02a002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:39.266892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac64da-7fcc-454d-a9c1-26f0478e1f24 service placement] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:39.275816 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db94b9-b95c-4aa7-8067-bc6e319ca2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:39.277186 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db94b9-b95c-4aa7-8067-bc6e319ca2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:39.278031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db94b9-b95c-4aa7-8067-bc6e319ca2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:39.278796 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db94b9-b95c-4aa7-8067-bc6e319ca2ee admin admin] PATH_INFO: `/v3/projects/9743f6c1aa7d47a9a32ec8e67d290559` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:39.280759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db94b9-b95c-4aa7-8067-bc6e319ca2ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9743f6c1aa7d47a9a32ec8e67d290559)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:39.283191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db94b9-b95c-4aa7-8067-bc6e319ca2ee admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:39.314123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-38c9de26-31f1-4890-80ec-5fdd2e02a002 None None] MFA Rules not processed for user `5cec6311f0fb4d908877ebdb7236ef21`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:39.323292 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-38c9de26-31f1-4890-80ec-5fdd2e02a002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:39.422578 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b7db94b9-b95c-4aa7-8067-bc6e319ca2ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9743f6c1aa7d47a9a32ec8e67d290559', 'request_id': 'req-b7db94b9-b95c-4aa7-8067-bc6e319ca2ee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:39.457534 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b7db94b9-b95c-4aa7-8067-bc6e319ca2ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9743f6c1aa7d47a9a32ec8e67d290559', 'request_id': 'req-b7db94b9-b95c-4aa7-8067-bc6e319ca2ee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:39.472636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b7db94b9-b95c-4aa7-8067-bc6e319ca2ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9743f6c1aa7d47a9a32ec8e67d290559', 'request_id': 'req-b7db94b9-b95c-4aa7-8067-bc6e319ca2ee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:39.506037 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b7db94b9-b95c-4aa7-8067-bc6e319ca2ee admin admin] The token cache is being invalidate because project 9743f6c1aa7d47a9a32ec8e67d290559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:08:39.507545 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b7db94b9-b95c-4aa7-8067-bc6e319ca2ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:39.508643 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b7db94b9-b95c-4aa7-8067-bc6e319ca2ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:39.514288 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 826/1665] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:08:39 2022] DELETE /identity/v3/projects/9743f6c1aa7d47a9a32ec8e67d290559 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:39.519725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96e882-48b6-48a9-a6a8-53fe22a9fd3b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:39.520227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96e882-48b6-48a9-a6a8-53fe22a9fd3b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:39.520662 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96e882-48b6-48a9-a6a8-53fe22a9fd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:39.545778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 840/1666] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:08:39.562244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9de26-31f1-4890-80ec-5fdd2e02a002 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:39.564488 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-38c9de26-31f1-4890-80ec-5fdd2e02a002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:39.572723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:39.582710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5a96e882-48b6-48a9-a6a8-53fe22a9fd3b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:39.586634 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5a96e882-48b6-48a9-a6a8-53fe22a9fd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:39.794021 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 827/1667] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:39.799995 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba695-708e-4496-bb8a-a67c07434b3e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:39.800545 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba695-708e-4496-bb8a-a67c07434b3e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:39.801131 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba695-708e-4496-bb8a-a67c07434b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:39.822907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9de26-31f1-4890-80ec-5fdd2e02a002 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:39.843279 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-732ba695-708e-4496-bb8a-a67c07434b3e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:39.845100 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-732ba695-708e-4496-bb8a-a67c07434b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:39.878919 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 828/1668] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:08:39.884738 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ba695-708e-4496-bb8a-a67c07434b3e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:39.906095 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ba695-708e-4496-bb8a-a67c07434b3e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:39.919213 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631c741-d3cb-435f-9afb-1d5acd16dbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:39.923218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631c741-d3cb-435f-9afb-1d5acd16dbfc admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:39.923782 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631c741-d3cb-435f-9afb-1d5acd16dbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:39.924244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631c741-d3cb-435f-9afb-1d5acd16dbfc admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:39.925241 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631c741-d3cb-435f-9afb-1d5acd16dbfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:08:39.925955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631c741-d3cb-435f-9afb-1d5acd16dbfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:39.932899 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631c741-d3cb-435f-9afb-1d5acd16dbfc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:39.967908 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 829/1669] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:08:39.969851 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631c741-d3cb-435f-9afb-1d5acd16dbfc admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:39.979386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4631c741-d3cb-435f-9afb-1d5acd16dbfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:40.007763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631c741-d3cb-435f-9afb-1d5acd16dbfc admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:40.020481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:40.021568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:40.023146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:40.023636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f admin admin] PATH_INFO: `/v3/projects/233ad150f5ee448c8c12be4ffedaf912` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:40.027012 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=233ad150f5ee448c8c12be4ffedaf912)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:40.032652 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:40.112976 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c1315-3f59-421b-9f68-0d283066b851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:40.122000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c1315-3f59-421b-9f68-0d283066b851 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:40.122000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c1315-3f59-421b-9f68-0d283066b851 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:40.122000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c1315-3f59-421b-9f68-0d283066b851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:40.124318 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-600c1315-3f59-421b-9f68-0d283066b851 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:40.151392 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:40.177827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '233ad150f5ee448c8c12be4ffedaf912', 'request_id': 'req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:40.197909 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '233ad150f5ee448c8c12be4ffedaf912', 'request_id': 'req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:40.220202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '233ad150f5ee448c8c12be4ffedaf912', 'request_id': 'req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:40.264539 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f admin admin] The token cache is being invalidate because project 233ad150f5ee448c8c12be4ffedaf912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:08:40.265605 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:40.269020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:40.276549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 830/1670] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:08:39 2022] DELETE /identity/v3/projects/233ad150f5ee448c8c12be4ffedaf912 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:40.281704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:40.289248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:40.327726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c1315-3f59-421b-9f68-0d283066b851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:40.343015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c1315-3f59-421b-9f68-0d283066b851 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:40.368252 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 841/1671] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 806 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:40.369444 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c1315-3f59-421b-9f68-0d283066b851 service nova] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:40.372584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-600c1315-3f59-421b-9f68-0d283066b851 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:40.409289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c1315-3f59-421b-9f68-0d283066b851 service nova] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:40.470939 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4c9f6-b519-4352-8d41-1eb69cdc7d7f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:40.482538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd0627-e9d7-4b24-b738-7b87c5bf5ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:40.482880 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd0627-e9d7-4b24-b738-7b87c5bf5ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:40.483273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd0627-e9d7-4b24-b738-7b87c5bf5ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:40.483651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd0627-e9d7-4b24-b738-7b87c5bf5ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:40.484856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd0627-e9d7-4b24-b738-7b87c5bf5ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:40.494000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd0627-e9d7-4b24-b738-7b87c5bf5ef8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:40.548220 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:40.576035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 831/1672] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:40 2022] POST /identity/v3/projects => generated 367 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:40.578405 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f102fc-8358-4a3e-8c03-27c01ab8ff9d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:40.578706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f102fc-8358-4a3e-8c03-27c01ab8ff9d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:40.579040 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f102fc-8358-4a3e-8c03-27c01ab8ff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:40.602784 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b5f102fc-8358-4a3e-8c03-27c01ab8ff9d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:40.604209 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b5f102fc-8358-4a3e-8c03-27c01ab8ff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:40.634704 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449d5bd-ea2a-44bf-a1e0-d172a5179ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:40.636034 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449d5bd-ea2a-44bf-a1e0-d172a5179ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:40.636549 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449d5bd-ea2a-44bf-a1e0-d172a5179ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:40.637024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449d5bd-ea2a-44bf-a1e0-d172a5179ef3 admin admin] PATH_INFO: `/v3/projects/64d8bb421deb4ba68fa08799f459bc71` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:40.638678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449d5bd-ea2a-44bf-a1e0-d172a5179ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d8bb421deb4ba68fa08799f459bc71)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:40.639986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: WARNING py.warnings [None req-f449d5bd-ea2a-44bf-a1e0-d172a5179ef3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 21:08:40.639986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: warnings.warn(msg) May 26 21:08:40.639986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: May 26 21:08:40.642320 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449d5bd-ea2a-44bf-a1e0-d172a5179ef3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:40.751361 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 832/1673] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:40.752765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f102fc-8358-4a3e-8c03-27c01ab8ff9d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:40.779467 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f102fc-8358-4a3e-8c03-27c01ab8ff9d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:40.795044 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f449d5bd-ea2a-44bf-a1e0-d172a5179ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d8bb421deb4ba68fa08799f459bc71', 'request_id': 'req-f449d5bd-ea2a-44bf-a1e0-d172a5179ef3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:40.812285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f449d5bd-ea2a-44bf-a1e0-d172a5179ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d8bb421deb4ba68fa08799f459bc71', 'request_id': 'req-f449d5bd-ea2a-44bf-a1e0-d172a5179ef3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:40.862097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f449d5bd-ea2a-44bf-a1e0-d172a5179ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d8bb421deb4ba68fa08799f459bc71', 'request_id': 'req-f449d5bd-ea2a-44bf-a1e0-d172a5179ef3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:40.878335 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:40.909205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f00d5f-9d15-4be7-b697-ae8c17d95b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:40.909944 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f00d5f-9d15-4be7-b697-ae8c17d95b34 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:40.910242 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f00d5f-9d15-4be7-b697-ae8c17d95b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:40.910878 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f00d5f-9d15-4be7-b697-ae8c17d95b34 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:40.911571 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f00d5f-9d15-4be7-b697-ae8c17d95b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:40.914569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f449d5bd-ea2a-44bf-a1e0-d172a5179ef3 admin admin] The token cache is being invalidate because project 64d8bb421deb4ba68fa08799f459bc71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:08:40.915077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f449d5bd-ea2a-44bf-a1e0-d172a5179ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:40.918388 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f00d5f-9d15-4be7-b697-ae8c17d95b34 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:40.918821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f449d5bd-ea2a-44bf-a1e0-d172a5179ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:40.925905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 842/1674] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:08:40 2022] DELETE /identity/v3/projects/64d8bb421deb4ba68fa08799f459bc71 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:40.928210 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94d42b-ba8b-4b2b-9c6a-0ff2ac365f38 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:40.928721 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94d42b-ba8b-4b2b-9c6a-0ff2ac365f38 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:40.929205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94d42b-ba8b-4b2b-9c6a-0ff2ac365f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:40.974424 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 833/1675] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:40 2022] POST /identity/v3/users => generated 284 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:40.978224 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1f94d42b-ba8b-4b2b-9c6a-0ff2ac365f38 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:40.978710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffe568-cb42-4508-bfab-3b237d234f0d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:40.979397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffe568-cb42-4508-bfab-3b237d234f0d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:40.980190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffe568-cb42-4508-bfab-3b237d234f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:40.981892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1f94d42b-ba8b-4b2b-9c6a-0ff2ac365f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:40.991931 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 843/1676] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:40.993070 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94d42b-ba8b-4b2b-9c6a-0ff2ac365f38 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:40.996888 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1f94d42b-ba8b-4b2b-9c6a-0ff2ac365f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:41.013068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94d42b-ba8b-4b2b-9c6a-0ff2ac365f38 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:41.019956 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4838a6-da15-4759-be6b-e0d1a4d6d7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:41.020848 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4838a6-da15-4759-be6b-e0d1a4d6d7ce admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:41.021884 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4838a6-da15-4759-be6b-e0d1a4d6d7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:41.022301 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4838a6-da15-4759-be6b-e0d1a4d6d7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:41.023536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4838a6-da15-4759-be6b-e0d1a4d6d7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:41.025571 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4838a6-da15-4759-be6b-e0d1a4d6d7ce admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:41.041753 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bdffe568-cb42-4508-bfab-3b237d234f0d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:41.042468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bdffe568-cb42-4508-bfab-3b237d234f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:41.043351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 844/1677] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:41.044490 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4838a6-da15-4759-be6b-e0d1a4d6d7ce admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:41.058273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4838a6-da15-4759-be6b-e0d1a4d6d7ce admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:41.071623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 834/1678] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:41.071623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffe568-cb42-4508-bfab-3b237d234f0d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:41.073955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323cc5e-228f-41dc-a432-1f2cf943e10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:41.075075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323cc5e-228f-41dc-a432-1f2cf943e10d admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:41.075508 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323cc5e-228f-41dc-a432-1f2cf943e10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:41.075920 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323cc5e-228f-41dc-a432-1f2cf943e10d admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:41.077961 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323cc5e-228f-41dc-a432-1f2cf943e10d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:08:41.078562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323cc5e-228f-41dc-a432-1f2cf943e10d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:41.080941 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323cc5e-228f-41dc-a432-1f2cf943e10d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:41.092686 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffe568-cb42-4508-bfab-3b237d234f0d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:41.102045 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 845/1679] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:08:41.105960 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1a85a-6b14-4201-816f-f54a07abb09f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:41.106453 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1a85a-6b14-4201-816f-f54a07abb09f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:41.107006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6520e3-afa0-44bf-a4d8-dc64ad19fa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:41.107497 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1a85a-6b14-4201-816f-f54a07abb09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:41.107874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6520e3-afa0-44bf-a4d8-dc64ad19fa38 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:41.108249 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6520e3-afa0-44bf-a4d8-dc64ad19fa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:41.108618 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6520e3-afa0-44bf-a4d8-dc64ad19fa38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:41.109465 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6520e3-afa0-44bf-a4d8-dc64ad19fa38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:41.119687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6520e3-afa0-44bf-a4d8-dc64ad19fa38 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:41.140813 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 835/1680] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:41.141991 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6520e3-afa0-44bf-a4d8-dc64ad19fa38 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:41.167273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-31b1a85a-6b14-4201-816f-f54a07abb09f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:41.169583 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-31b1a85a-6b14-4201-816f-f54a07abb09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:41.175944 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6520e3-afa0-44bf-a4d8-dc64ad19fa38 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:41.189546 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fc535-45d4-4dc7-a0a7-e3346c28d22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:41.190426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fc535-45d4-4dc7-a0a7-e3346c28d22a admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:41.190807 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fc535-45d4-4dc7-a0a7-e3346c28d22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:41.191208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fc535-45d4-4dc7-a0a7-e3346c28d22a admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:41.192018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075fc535-45d4-4dc7-a0a7-e3346c28d22a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:41.193025 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 846/1681] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:41.194212 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075fc535-45d4-4dc7-a0a7-e3346c28d22a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:41.195309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1a85a-6b14-4201-816f-f54a07abb09f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:41.234689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1a85a-6b14-4201-816f-f54a07abb09f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:41.242951 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ea88b-17b4-4a9c-b173-c38e69f4b488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:41.244640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ea88b-17b4-4a9c-b173-c38e69f4b488 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:41.245088 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ea88b-17b4-4a9c-b173-c38e69f4b488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:41.246055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ea88b-17b4-4a9c-b173-c38e69f4b488 admin admin] PATH_INFO: `/v3/projects/048d8844ef6e465f96ce3f8ef4c07e7a/users/0dc899eb9b034455a01178ed8ee41563/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:41.264464 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 836/1682] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:41 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:41.265620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fc535-45d4-4dc7-a0a7-e3346c28d22a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:41.273641 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ea88b-17b4-4a9c-b173-c38e69f4b488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=048d8844ef6e465f96ce3f8ef4c07e7a, user_id=0dc899eb9b034455a01178ed8ee41563, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:41.281116 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ea88b-17b4-4a9c-b173-c38e69f4b488 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:41.317778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 847/1683] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:41 2022] PUT /identity/v3/projects/048d8844ef6e465f96ce3f8ef4c07e7a/users/0dc899eb9b034455a01178ed8ee41563/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:41.317778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ea88b-17b4-4a9c-b173-c38e69f4b488 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:41.431404 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fc535-45d4-4dc7-a0a7-e3346c28d22a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:41.466785 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ea88b-17b4-4a9c-b173-c38e69f4b488 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:41.494864 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdd33b-53eb-4c5f-ba88-96d0fbccf9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:41.495773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdd33b-53eb-4c5f-ba88-96d0fbccf9ac admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:41.496066 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdd33b-53eb-4c5f-ba88-96d0fbccf9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:41.496375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdd33b-53eb-4c5f-ba88-96d0fbccf9ac admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:41.497186 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdd33b-53eb-4c5f-ba88-96d0fbccf9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:41.503420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdd33b-53eb-4c5f-ba88-96d0fbccf9ac admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:41.540708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:41.573781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 848/1684] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:41 2022] POST /identity/v3/users => generated 283 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:41.576070 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d381110-50d9-431d-87a7-aca49818f2d3 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:41.576386 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d381110-50d9-431d-87a7-aca49818f2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:41.584135 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d381110-50d9-431d-87a7-aca49818f2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:41.660749 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6d381110-50d9-431d-87a7-aca49818f2d3 None None] MFA Rules not processed for user `0dc899eb9b034455a01178ed8ee41563`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:41.664127 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6d381110-50d9-431d-87a7-aca49818f2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:41.678774 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544188bf-9254-47d3-a943-5ac004a3fd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:41.683067 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544188bf-9254-47d3-a943-5ac004a3fd87 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:41.691440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544188bf-9254-47d3-a943-5ac004a3fd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:41.691903 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544188bf-9254-47d3-a943-5ac004a3fd87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:41.693546 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544188bf-9254-47d3-a943-5ac004a3fd87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:08:41.695018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544188bf-9254-47d3-a943-5ac004a3fd87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:41.697306 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544188bf-9254-47d3-a943-5ac004a3fd87 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:41.731053 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 837/1685] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:08:41.733182 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e7157-94b5-443e-a6a5-508c1fbad24b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:41.737878 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e7157-94b5-443e-a6a5-508c1fbad24b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:41.738363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e7157-94b5-443e-a6a5-508c1fbad24b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:41.742126 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 838/1686] 10.222.0.61 () {54 vars in 921 bytes} [Thu May 26 21:08:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:08:41.745737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e7157-94b5-443e-a6a5-508c1fbad24b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:41.798180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e7157-94b5-443e-a6a5-508c1fbad24b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:41.812892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2bdf5-ec2a-4d24-8b20-9d8fb6b90f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:41.813961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2bdf5-ec2a-4d24-8b20-9d8fb6b90f0b admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:41.814376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2bdf5-ec2a-4d24-8b20-9d8fb6b90f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:41.814847 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2bdf5-ec2a-4d24-8b20-9d8fb6b90f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:41.815915 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2bdf5-ec2a-4d24-8b20-9d8fb6b90f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:41.823693 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2bdf5-ec2a-4d24-8b20-9d8fb6b90f0b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:41.859560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 849/1687] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:41.861495 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d381110-50d9-431d-87a7-aca49818f2d3 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:41.868274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 839/1688] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:41.868274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e9220-011a-4a33-b72e-aaf021248a6f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:41.874838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e9220-011a-4a33-b72e-aaf021248a6f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:41.875170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e9220-011a-4a33-b72e-aaf021248a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:41.875844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d381110-50d9-431d-87a7-aca49818f2d3 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:41.882334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06be6b4-e683-4d53-9903-1ae3016a781f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:41.882953 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06be6b4-e683-4d53-9903-1ae3016a781f admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:41.883249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06be6b4-e683-4d53-9903-1ae3016a781f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:41.883652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06be6b4-e683-4d53-9903-1ae3016a781f admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:41.885122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06be6b4-e683-4d53-9903-1ae3016a781f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:41.887568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06be6b4-e683-4d53-9903-1ae3016a781f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:41.921057 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7e5e9220-011a-4a33-b72e-aaf021248a6f None None] MFA Rules not processed for user `e8952f35c21c4a2eaf1fbc601fe76242`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:41.922463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7e5e9220-011a-4a33-b72e-aaf021248a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:41.940428 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 850/1689] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:41 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:41.940428 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06be6b4-e683-4d53-9903-1ae3016a781f admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:41.980133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:42.071505 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06be6b4-e683-4d53-9903-1ae3016a781f admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:42.077782 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632362b-8b49-4ad0-a9cf-cad36d3d0b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:42.080558 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632362b-8b49-4ad0-a9cf-cad36d3d0b05 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:42.081017 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632362b-8b49-4ad0-a9cf-cad36d3d0b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:42.081478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632362b-8b49-4ad0-a9cf-cad36d3d0b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:42.082355 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632362b-8b49-4ad0-a9cf-cad36d3d0b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:42.085335 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632362b-8b49-4ad0-a9cf-cad36d3d0b05 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:42.101842 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 840/1690] 10.222.0.61 () {58 vars in 1018 bytes} [Thu May 26 21:08:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:42.103030 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e9220-011a-4a33-b72e-aaf021248a6f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:42.133441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e9220-011a-4a33-b72e-aaf021248a6f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:42.134305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 851/1691] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:41 2022] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:42.135530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632362b-8b49-4ad0-a9cf-cad36d3d0b05 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:42.273218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37195d-59fb-46d6-a78e-c8792c0133ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:42.274163 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37195d-59fb-46d6-a78e-c8792c0133ee admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:42.275199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37195d-59fb-46d6-a78e-c8792c0133ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:42.275199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37195d-59fb-46d6-a78e-c8792c0133ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:42.275763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37195d-59fb-46d6-a78e-c8792c0133ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:42.278976 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37195d-59fb-46d6-a78e-c8792c0133ee admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:42.306305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 841/1692] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:42.307444 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37195d-59fb-46d6-a78e-c8792c0133ee admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:42.310542 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:42.323677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37195d-59fb-46d6-a78e-c8792c0133ee admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:42.328258 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632362b-8b49-4ad0-a9cf-cad36d3d0b05 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:42.340241 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f248e8-165e-4563-806c-13c506dfd828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:42.340763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7d29b-708c-4582-8b21-580d96f49c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:42.341533 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f248e8-165e-4563-806c-13c506dfd828 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:42.342404 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7d29b-708c-4582-8b21-580d96f49c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:42.342753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7d29b-708c-4582-8b21-580d96f49c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:42.343104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f248e8-165e-4563-806c-13c506dfd828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:42.343457 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7d29b-708c-4582-8b21-580d96f49c58 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:42.348101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f248e8-165e-4563-806c-13c506dfd828 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:42.349073 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7d29b-708c-4582-8b21-580d96f49c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:42.349918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f248e8-165e-4563-806c-13c506dfd828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:42.352018 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7d29b-708c-4582-8b21-580d96f49c58 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:42.354069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f248e8-165e-4563-806c-13c506dfd828 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:42.413012 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 852/1693] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:42 2022] POST /identity/v3/users => generated 287 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:42.413202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 842/1694] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:42 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:42.413303 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7d29b-708c-4582-8b21-580d96f49c58 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:42.415579 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e932e-cf8a-424f-9bbe-40df9c6306ad None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:42.416606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e932e-cf8a-424f-9bbe-40df9c6306ad None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:42.417291 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e932e-cf8a-424f-9bbe-40df9c6306ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:42.417709 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e6f7d29b-708c-4582-8b21-580d96f49c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:42.466768 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c73e932e-cf8a-424f-9bbe-40df9c6306ad None None] MFA Rules not processed for user `3953b14656774edb92da1ecdb4bbbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:42.469721 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c73e932e-cf8a-424f-9bbe-40df9c6306ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:42.550672 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 843/1695] 10.222.0.61 () {58 vars in 1009 bytes} [Thu May 26 21:08:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:42.551791 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e932e-cf8a-424f-9bbe-40df9c6306ad None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:42.577920 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e932e-cf8a-424f-9bbe-40df9c6306ad None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:42.592974 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85798932-d957-4adb-9736-5dfa64108576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:42.594700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85798932-d957-4adb-9736-5dfa64108576 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:42.594899 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85798932-d957-4adb-9736-5dfa64108576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:42.595219 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85798932-d957-4adb-9736-5dfa64108576 admin admin] PATH_INFO: `/v3/projects/dc0cc49afd9248cfbde7b3bfbd0cf44e/users/0fecd77bd12347658c5a06c279183520/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:42.607006 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7d29b-708c-4582-8b21-580d96f49c58 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:42.629587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85798932-d957-4adb-9736-5dfa64108576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0cc49afd9248cfbde7b3bfbd0cf44e, user_id=0fecd77bd12347658c5a06c279183520, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:42.631672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ed78f-9ed0-48a2-8721-6f7737919d74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8952f35c21c4a2eaf1fbc601fe76242', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:42.632545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ed78f-9ed0-48a2-8721-6f7737919d74 service placement] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:42.632829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ed78f-9ed0-48a2-8721-6f7737919d74 service placement] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:42.633110 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ed78f-9ed0-48a2-8721-6f7737919d74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:42.634627 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85798932-d957-4adb-9736-5dfa64108576 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:42.659019 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 844/1696] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:42 2022] PUT /identity/v3/projects/dc0cc49afd9248cfbde7b3bfbd0cf44e/users/0fecd77bd12347658c5a06c279183520/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:42.660310 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85798932-d957-4adb-9736-5dfa64108576 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:42.662722 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ed78f-9ed0-48a2-8721-6f7737919d74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:42.664876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ed78f-9ed0-48a2-8721-6f7737919d74 service placement] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:42.693066 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 853/1697] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:42.699631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:42.703257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ed78f-9ed0-48a2-8721-6f7737919d74 service placement] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:42.738294 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ed78f-9ed0-48a2-8721-6f7737919d74 service placement] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:42.748236 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897d9ff-8665-416f-a48c-34d79e61d9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:42.749248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897d9ff-8665-416f-a48c-34d79e61d9bb admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:42.749663 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897d9ff-8665-416f-a48c-34d79e61d9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:42.750087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897d9ff-8665-416f-a48c-34d79e61d9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:42.750977 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897d9ff-8665-416f-a48c-34d79e61d9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:42.751749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85798932-d957-4adb-9736-5dfa64108576 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:42.752973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897d9ff-8665-416f-a48c-34d79e61d9bb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:42.757485 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70139f-1f2f-489d-8cd8-67430b7649e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:42.758561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70139f-1f2f-489d-8cd8-67430b7649e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:42.758964 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70139f-1f2f-489d-8cd8-67430b7649e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:42.759349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70139f-1f2f-489d-8cd8-67430b7649e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:42.760222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70139f-1f2f-489d-8cd8-67430b7649e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:42.762340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70139f-1f2f-489d-8cd8-67430b7649e3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:42.776756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 845/1698] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:42.779589 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467d838-c664-41b5-b1fe-a3363fe0b2c2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:42.780000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467d838-c664-41b5-b1fe-a3363fe0b2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:42.780580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467d838-c664-41b5-b1fe-a3363fe0b2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:42.783674 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 854/1699] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:42.784758 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897d9ff-8665-416f-a48c-34d79e61d9bb admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:42.808764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897d9ff-8665-416f-a48c-34d79e61d9bb admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:42.816738 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8467d838-c664-41b5-b1fe-a3363fe0b2c2 None None] MFA Rules not processed for user `0fecd77bd12347658c5a06c279183520`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:42.818528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8467d838-c664-41b5-b1fe-a3363fe0b2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:42.819517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2cd32-b4d6-4aa2-ad73-69ec430cba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:42.820414 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2cd32-b4d6-4aa2-ad73-69ec430cba85 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:42.820952 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2cd32-b4d6-4aa2-ad73-69ec430cba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:42.821370 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2cd32-b4d6-4aa2-ad73-69ec430cba85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:42.822282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2cd32-b4d6-4aa2-ad73-69ec430cba85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:42.824116 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2cd32-b4d6-4aa2-ad73-69ec430cba85 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:42.855254 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 855/1700] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:42.857056 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2cd32-b4d6-4aa2-ad73-69ec430cba85 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:42.880877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2cd32-b4d6-4aa2-ad73-69ec430cba85 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:42.892084 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e217c6b-b300-42d3-a0eb-a246aebd78fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:42.893018 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e217c6b-b300-42d3-a0eb-a246aebd78fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:42.893306 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e217c6b-b300-42d3-a0eb-a246aebd78fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:42.893583 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e217c6b-b300-42d3-a0eb-a246aebd78fe admin admin] PATH_INFO: `/v3/projects/42e65b18d87048cfb22607930d3d8b36/users/5ede3166925041838471b08a2e586dcc/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:42.928071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 846/1701] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:42.928071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467d838-c664-41b5-b1fe-a3363fe0b2c2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:42.931330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e217c6b-b300-42d3-a0eb-a246aebd78fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=42e65b18d87048cfb22607930d3d8b36, user_id=5ede3166925041838471b08a2e586dcc, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:42.934210 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e217c6b-b300-42d3-a0eb-a246aebd78fe admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:42.946409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467d838-c664-41b5-b1fe-a3363fe0b2c2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:42.952057 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb4bad-e517-489a-8806-7503381cae51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:42.953881 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb4bad-e517-489a-8806-7503381cae51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:42.954517 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb4bad-e517-489a-8806-7503381cae51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:42.954893 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb4bad-e517-489a-8806-7503381cae51 admin admin] PATH_INFO: `/v3/projects/f8ad433800bc4dab85a11087b7da41a8/users/589878679fb7483286ddf2856e293274/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:42.972538 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 856/1702] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:42 2022] PUT /identity/v3/projects/42e65b18d87048cfb22607930d3d8b36/users/5ede3166925041838471b08a2e586dcc/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:42.973429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e217c6b-b300-42d3-a0eb-a246aebd78fe admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:42.975234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8e217c6b-b300-42d3-a0eb-a246aebd78fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:42.982694 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb4bad-e517-489a-8806-7503381cae51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ad433800bc4dab85a11087b7da41a8, user_id=589878679fb7483286ddf2856e293274, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:42.986301 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb4bad-e517-489a-8806-7503381cae51 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:43.026620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 847/1703] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:42 2022] PUT /identity/v3/projects/f8ad433800bc4dab85a11087b7da41a8/users/589878679fb7483286ddf2856e293274/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:43.028082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb4bad-e517-489a-8806-7503381cae51 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:43.032845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-09cb4bad-e517-489a-8806-7503381cae51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:43.082249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e217c6b-b300-42d3-a0eb-a246aebd78fe admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:43.137929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:43.199284 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb4bad-e517-489a-8806-7503381cae51 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:43.206131 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64439d12-117e-4afb-873f-ce7e3274dffb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:43.207353 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64439d12-117e-4afb-873f-ce7e3274dffb service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:43.208067 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64439d12-117e-4afb-873f-ce7e3274dffb service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:43.208474 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64439d12-117e-4afb-873f-ce7e3274dffb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:43.250714 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e28f2d-53a9-4ae9-a77c-146a3316ff95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a63879ec1242d08bba1ccad6212788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:43.251602 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e28f2d-53a9-4ae9-a77c-146a3316ff95 service swift] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:43.251784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e28f2d-53a9-4ae9-a77c-146a3316ff95 service swift] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:43.252068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e28f2d-53a9-4ae9-a77c-146a3316ff95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:43.264040 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:43.293414 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64439d12-117e-4afb-873f-ce7e3274dffb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:43.296339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64439d12-117e-4afb-873f-ce7e3274dffb service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:43.316930 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 848/1704] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:43.320655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64439d12-117e-4afb-873f-ce7e3274dffb service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:43.437611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e28f2d-53a9-4ae9-a77c-146a3316ff95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:43.441669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e28f2d-53a9-4ae9-a77c-146a3316ff95 service swift] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:43.501841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 857/1705] 10.222.0.61 () {60 vars in 1384 bytes} [Thu May 26 21:08:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:08:43.506034 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd0795-d382-4782-b047-09bfa5ae7e8d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:43.506330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd0795-d382-4782-b047-09bfa5ae7e8d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:43.507758 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd0795-d382-4782-b047-09bfa5ae7e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:43.541399 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64439d12-117e-4afb-873f-ce7e3274dffb service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:43.557407 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d13163-cced-4841-b91c-7d6a623c6f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:43.558385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d13163-cced-4841-b91c-7d6a623c6f11 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:43.563173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d13163-cced-4841-b91c-7d6a623c6f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:43.565982 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d13163-cced-4841-b91c-7d6a623c6f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:43.569462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d13163-cced-4841-b91c-7d6a623c6f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:43.583290 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-66dd0795-d382-4782-b047-09bfa5ae7e8d None None] MFA Rules not processed for user `589878679fb7483286ddf2856e293274`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:43.590030 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-66dd0795-d382-4782-b047-09bfa5ae7e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:43.596671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d13163-cced-4841-b91c-7d6a623c6f11 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:43.678383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 849/1706] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:43.684950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d13163-cced-4841-b91c-7d6a623c6f11 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:43.698547 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b1d13163-cced-4841-b91c-7d6a623c6f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:43.791400 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 858/1707] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:43.791400 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd0795-d382-4782-b047-09bfa5ae7e8d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:43.807242 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd0795-d382-4782-b047-09bfa5ae7e8d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:43.815512 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a0dd5-fe2f-4896-b6ed-28e6e58891d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:43.816651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a0dd5-fe2f-4896-b6ed-28e6e58891d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:43.816995 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a0dd5-fe2f-4896-b6ed-28e6e58891d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:43.817314 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a0dd5-fe2f-4896-b6ed-28e6e58891d9 admin admin] PATH_INFO: `/v3/projects/42e65b18d87048cfb22607930d3d8b36/users/5ede3166925041838471b08a2e586dcc/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:43.819909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a0dd5-fe2f-4896-b6ed-28e6e58891d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42e65b18d87048cfb22607930d3d8b36, user_id=5ede3166925041838471b08a2e586dcc, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:43.820868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d13163-cced-4841-b91c-7d6a623c6f11 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:43.823762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a0dd5-fe2f-4896-b6ed-28e6e58891d9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:43.838421 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 859/1708] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:43 2022] PUT /identity/v3/projects/42e65b18d87048cfb22607930d3d8b36/users/5ede3166925041838471b08a2e586dcc/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:43.845842 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a0dd5-fe2f-4896-b6ed-28e6e58891d9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:43.863545 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9ce0c-b589-427d-9321-4becf1af3e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:43.864486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ce0c-b589-427d-9321-4becf1af3e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:43.864761 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ce0c-b589-427d-9321-4becf1af3e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:43.865033 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ce0c-b589-427d-9321-4becf1af3e43 admin admin] PATH_INFO: `/v3/users/22d8f6da0e0f430eadb4e2f50679010d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:43.872090 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9ce0c-b589-427d-9321-4becf1af3e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d8f6da0e0f430eadb4e2f50679010d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:43.874372 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9ce0c-b589-427d-9321-4becf1af3e43 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:44.068512 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:44.114117 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a0dd5-fe2f-4896-b6ed-28e6e58891d9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:44.131938 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7e617-55e4-4e23-840c-f63b6e85477f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:44.132699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7e617-55e4-4e23-840c-f63b6e85477f admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:44.133100 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7e617-55e4-4e23-840c-f63b6e85477f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:44.133307 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7e617-55e4-4e23-840c-f63b6e85477f admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:44.134077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7e617-55e4-4e23-840c-f63b6e85477f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:44.136581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7e617-55e4-4e23-840c-f63b6e85477f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:44.192618 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6cf9ce0c-b589-427d-9321-4becf1af3e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d8f6da0e0f430eadb4e2f50679010d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:44.194406 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6cf9ce0c-b589-427d-9321-4becf1af3e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d8f6da0e0f430eadb4e2f50679010d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:44.227945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6cf9ce0c-b589-427d-9321-4becf1af3e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d8f6da0e0f430eadb4e2f50679010d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:44.248033 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 860/1709] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:43 2022] POST /identity/v3/projects => generated 371 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:44.254421 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beb5f6-5f0d-4f09-9de9-58e4b91c6eca None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:44.254675 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beb5f6-5f0d-4f09-9de9-58e4b91c6eca None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:44.254972 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beb5f6-5f0d-4f09-9de9-58e4b91c6eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:44.273101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6cf9ce0c-b589-427d-9321-4becf1af3e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d8f6da0e0f430eadb4e2f50679010d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:44.306277 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6cf9ce0c-b589-427d-9321-4becf1af3e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d8f6da0e0f430eadb4e2f50679010d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:44.335699 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 850/1710] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:08:43 2022] DELETE /identity/v3/users/22d8f6da0e0f430eadb4e2f50679010d => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:44.336764 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9ce0c-b589-427d-9321-4becf1af3e43 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:44.343039 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6cf9ce0c-b589-427d-9321-4becf1af3e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:44.383532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-30beb5f6-5f0d-4f09-9de9-58e4b91c6eca None None] MFA Rules not processed for user `5ede3166925041838471b08a2e586dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:44.384942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-30beb5f6-5f0d-4f09-9de9-58e4b91c6eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:44.587972 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:44.645378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9ce0c-b589-427d-9321-4becf1af3e43 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:44.679243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcde3b-1153-41e6-b17d-602803ce8e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:44.680161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcde3b-1153-41e6-b17d-602803ce8e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:44.680755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcde3b-1153-41e6-b17d-602803ce8e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:44.681136 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcde3b-1153-41e6-b17d-602803ce8e11 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:44.682267 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bcde3b-1153-41e6-b17d-602803ce8e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:44.686474 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bcde3b-1153-41e6-b17d-602803ce8e11 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:44.709938 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 861/1711] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:44 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:44.726838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30beb5f6-5f0d-4f09-9de9-58e4b91c6eca None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:44.733570 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-30beb5f6-5f0d-4f09-9de9-58e4b91c6eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:44.736698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 851/1712] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:44 2022] POST /identity/v3/users => generated 292 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:44.739168 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcde3b-1153-41e6-b17d-602803ce8e11 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:44.777202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcde3b-1153-41e6-b17d-602803ce8e11 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:44.795930 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e08e2-92e3-4e28-84f0-bab30f6475f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:44.796792 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e08e2-92e3-4e28-84f0-bab30f6475f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:44.797187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e08e2-92e3-4e28-84f0-bab30f6475f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:44.798029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e08e2-92e3-4e28-84f0-bab30f6475f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:44.801535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e08e2-92e3-4e28-84f0-bab30f6475f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:44.803672 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e08e2-92e3-4e28-84f0-bab30f6475f7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:44.833668 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 852/1713] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:44.838078 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e08e2-92e3-4e28-84f0-bab30f6475f7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:44.862793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e08e2-92e3-4e28-84f0-bab30f6475f7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:44.877337 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9774b3-a904-49ec-92b4-60b33393e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:44.878503 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9774b3-a904-49ec-92b4-60b33393e148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:44.878798 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9774b3-a904-49ec-92b4-60b33393e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:44.879226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9774b3-a904-49ec-92b4-60b33393e148 admin admin] PATH_INFO: `/v3/projects/84d4fdd353514b879acfc1cea2e53ad2/users/af93fc67263d4a1ca1d4ba85c6e3f142/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:44.924671 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30beb5f6-5f0d-4f09-9de9-58e4b91c6eca None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:44.932238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9774b3-a904-49ec-92b4-60b33393e148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d4fdd353514b879acfc1cea2e53ad2, user_id=af93fc67263d4a1ca1d4ba85c6e3f142, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:44.936805 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9774b3-a904-49ec-92b4-60b33393e148 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:44.949890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e11316-d88f-46cf-a481-235cecb3b469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:44.951312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e11316-d88f-46cf-a481-235cecb3b469 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:44.951767 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e11316-d88f-46cf-a481-235cecb3b469 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:44.952180 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e11316-d88f-46cf-a481-235cecb3b469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:44.976365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 853/1714] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:44 2022] PUT /identity/v3/projects/84d4fdd353514b879acfc1cea2e53ad2/users/af93fc67263d4a1ca1d4ba85c6e3f142/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:08:44.980920 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9774b3-a904-49ec-92b4-60b33393e148 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:44.989778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e11316-d88f-46cf-a481-235cecb3b469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:44.993558 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e11316-d88f-46cf-a481-235cecb3b469 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:45.056106 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 862/1715] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:44 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:45.200599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9774b3-a904-49ec-92b4-60b33393e148 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:45.215570 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4363b-634c-4e26-84d6-7ea3be3340c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:45.216293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4363b-634c-4e26-84d6-7ea3be3340c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:45.216576 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4363b-634c-4e26-84d6-7ea3be3340c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:45.216853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4363b-634c-4e26-84d6-7ea3be3340c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:45.217604 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4363b-634c-4e26-84d6-7ea3be3340c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:45.227000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4363b-634c-4e26-84d6-7ea3be3340c4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:45.287341 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 854/1716] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:45.289001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e11316-d88f-46cf-a481-235cecb3b469 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:45.325140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e11316-d88f-46cf-a481-235cecb3b469 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:45.357472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ae234-c5f7-4121-9b9b-be7417418b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:45.364136 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ae234-c5f7-4121-9b9b-be7417418b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:45.367639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ae234-c5f7-4121-9b9b-be7417418b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:45.368967 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ae234-c5f7-4121-9b9b-be7417418b31 admin admin] PATH_INFO: `/v3/projects/84d4fdd353514b879acfc1cea2e53ad2/users/af93fc67263d4a1ca1d4ba85c6e3f142/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:45.386262 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ae234-c5f7-4121-9b9b-be7417418b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d4fdd353514b879acfc1cea2e53ad2, user_id=af93fc67263d4a1ca1d4ba85c6e3f142, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:45.402668 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ae234-c5f7-4121-9b9b-be7417418b31 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:45.472385 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 863/1717] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:45 2022] PUT /identity/v3/projects/84d4fdd353514b879acfc1cea2e53ad2/users/af93fc67263d4a1ca1d4ba85c6e3f142/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:45.495913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e2b0e-3421-475c-84c3-e4c38e606e59 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:45.495913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e2b0e-3421-475c-84c3-e4c38e606e59 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:45.495913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e2b0e-3421-475c-84c3-e4c38e606e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:45.580925 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-891e2b0e-3421-475c-84c3-e4c38e606e59 None None] MFA Rules not processed for user `af93fc67263d4a1ca1d4ba85c6e3f142`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:45.585945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-891e2b0e-3421-475c-84c3-e4c38e606e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:45.871686 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ae234-c5f7-4121-9b9b-be7417418b31 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:45.873524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e19ae234-c5f7-4121-9b9b-be7417418b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:45.978894 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 855/1718] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:45 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:08:46.062835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e2b0e-3421-475c-84c3-e4c38e606e59 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:46.100736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:46.152435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:46.191997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ae234-c5f7-4121-9b9b-be7417418b31 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:46.209731 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51cb87-42a1-4176-a86e-ff4be1046019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:46.214522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51cb87-42a1-4176-a86e-ff4be1046019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:46.217046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51cb87-42a1-4176-a86e-ff4be1046019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:46.218546 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51cb87-42a1-4176-a86e-ff4be1046019 admin admin] PATH_INFO: `/v3/projects/03aea834d18f4889961ef6e3f89ef929` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:46.225166 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51cb87-42a1-4176-a86e-ff4be1046019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03aea834d18f4889961ef6e3f89ef929)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:46.229066 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51cb87-42a1-4176-a86e-ff4be1046019 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:46.298292 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e2b0e-3421-475c-84c3-e4c38e606e59 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:46.314253 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2849f7-332d-43ad-85c0-8c947e6abb4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:46.333374 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2849f7-332d-43ad-85c0-8c947e6abb4a service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:46.334076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2849f7-332d-43ad-85c0-8c947e6abb4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:46.337987 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2849f7-332d-43ad-85c0-8c947e6abb4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:46.388242 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2849f7-332d-43ad-85c0-8c947e6abb4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:46.395308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2849f7-332d-43ad-85c0-8c947e6abb4a service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:46.470879 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 856/1719] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:08:46.480586 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cbc73-c3d3-4df8-aaaa-4703b0af5b27 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:46.480883 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cbc73-c3d3-4df8-aaaa-4703b0af5b27 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:46.488934 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cbc73-c3d3-4df8-aaaa-4703b0af5b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:46.501361 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-de51cb87-42a1-4176-a86e-ff4be1046019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03aea834d18f4889961ef6e3f89ef929', 'request_id': 'req-de51cb87-42a1-4176-a86e-ff4be1046019'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:46.539332 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-de51cb87-42a1-4176-a86e-ff4be1046019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03aea834d18f4889961ef6e3f89ef929', 'request_id': 'req-de51cb87-42a1-4176-a86e-ff4be1046019'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:46.562164 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-de51cb87-42a1-4176-a86e-ff4be1046019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03aea834d18f4889961ef6e3f89ef929', 'request_id': 'req-de51cb87-42a1-4176-a86e-ff4be1046019'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:46.603849 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f00cbc73-c3d3-4df8-aaaa-4703b0af5b27 None None] MFA Rules not processed for user `f215554a96e0461aa1dc78f930586cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:46.604679 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f00cbc73-c3d3-4df8-aaaa-4703b0af5b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:46.609038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-de51cb87-42a1-4176-a86e-ff4be1046019 admin admin] The token cache is being invalidate because project 03aea834d18f4889961ef6e3f89ef929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:08:46.609347 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-de51cb87-42a1-4176-a86e-ff4be1046019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:46.611594 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-de51cb87-42a1-4176-a86e-ff4be1046019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:46.617698 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 864/1720] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:08:45 2022] DELETE /identity/v3/projects/03aea834d18f4889961ef6e3f89ef929 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:46.619505 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51cb87-42a1-4176-a86e-ff4be1046019 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:46.622741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-de51cb87-42a1-4176-a86e-ff4be1046019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:46.890569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51cb87-42a1-4176-a86e-ff4be1046019 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:46.894638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 857/1721] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:46.913405 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cbc73-c3d3-4df8-aaaa-4703b0af5b27 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:46.913997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1f7fa-d64b-4a78-8990-23d8ba39b466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:46.915019 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f00cbc73-c3d3-4df8-aaaa-4703b0af5b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:46.915125 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1f7fa-d64b-4a78-8990-23d8ba39b466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:46.915322 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1f7fa-d64b-4a78-8990-23d8ba39b466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:46.915576 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1f7fa-d64b-4a78-8990-23d8ba39b466 admin admin] PATH_INFO: `/v3/users/948551c3715d4a05853a411182d8e2c7` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:46.922209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1f7fa-d64b-4a78-8990-23d8ba39b466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=948551c3715d4a05853a411182d8e2c7)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:46.924664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1f7fa-d64b-4a78-8990-23d8ba39b466 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:47.057900 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2bc1f7fa-d64b-4a78-8990-23d8ba39b466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948551c3715d4a05853a411182d8e2c7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:47.081894 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cbc73-c3d3-4df8-aaaa-4703b0af5b27 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:47.091235 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2bc1f7fa-d64b-4a78-8990-23d8ba39b466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948551c3715d4a05853a411182d8e2c7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:47.092082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face5fa2-e2af-41de-8824-ef9ff560cffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:47.092799 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face5fa2-e2af-41de-8824-ef9ff560cffb service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:47.093082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face5fa2-e2af-41de-8824-ef9ff560cffb service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:47.093361 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face5fa2-e2af-41de-8824-ef9ff560cffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:47.093917 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2bc1f7fa-d64b-4a78-8990-23d8ba39b466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948551c3715d4a05853a411182d8e2c7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:47.101100 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-face5fa2-e2af-41de-8824-ef9ff560cffb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:47.112891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2bc1f7fa-d64b-4a78-8990-23d8ba39b466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948551c3715d4a05853a411182d8e2c7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:47.116011 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:47.128097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2bc1f7fa-d64b-4a78-8990-23d8ba39b466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948551c3715d4a05853a411182d8e2c7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:47.139913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face5fa2-e2af-41de-8824-ef9ff560cffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:47.146575 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 865/1722] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:08:46 2022] DELETE /identity/v3/users/948551c3715d4a05853a411182d8e2c7 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:47.149216 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face5fa2-e2af-41de-8824-ef9ff560cffb service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:47.151126 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1f7fa-d64b-4a78-8990-23d8ba39b466 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:47.155040 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2bc1f7fa-d64b-4a78-8990-23d8ba39b466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:47.182198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 858/1723] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:08:47.369503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1f7fa-d64b-4a78-8990-23d8ba39b466 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:47.388984 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535c487-420d-42cf-872e-e58b7af29035 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:47.389958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c487-420d-42cf-872e-e58b7af29035 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:47.390130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c487-420d-42cf-872e-e58b7af29035 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:47.390902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c487-420d-42cf-872e-e58b7af29035 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:47.404437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9535c487-420d-42cf-872e-e58b7af29035 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:47.585375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535c487-420d-42cf-872e-e58b7af29035 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:47.586914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535c487-420d-42cf-872e-e58b7af29035 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:47.609680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 866/1724] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:48.327663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75163fad-fea0-45d4-9046-96074aa50502 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:48.328186 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75163fad-fea0-45d4-9046-96074aa50502 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:48.328721 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75163fad-fea0-45d4-9046-96074aa50502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:48.401055 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-75163fad-fea0-45d4-9046-96074aa50502 None None] MFA Rules not processed for user `e3514a1833104114894abe6c41ea30a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:48.404583 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-75163fad-fea0-45d4-9046-96074aa50502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:48.527961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:48.562558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 859/1725] 10.222.0.67 () {58 vars in 1015 bytes} [Thu May 26 21:08:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:48.917419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535c487-420d-42cf-872e-e58b7af29035 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:48.920162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9535c487-420d-42cf-872e-e58b7af29035 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:48.948015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535c487-420d-42cf-872e-e58b7af29035 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:48.977083 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f884e-a3a3-4dbd-b37c-6dba476cd2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:48.977938 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f884e-a3a3-4dbd-b37c-6dba476cd2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:48.978374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f884e-a3a3-4dbd-b37c-6dba476cd2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:48.978628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f884e-a3a3-4dbd-b37c-6dba476cd2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:48.997619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f884e-a3a3-4dbd-b37c-6dba476cd2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:48.999343 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f884e-a3a3-4dbd-b37c-6dba476cd2b4 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:49.040531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 867/1726] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:50.228570 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75163fad-fea0-45d4-9046-96074aa50502 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:50.231162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-75163fad-fea0-45d4-9046-96074aa50502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:50.250902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f884e-a3a3-4dbd-b37c-6dba476cd2b4 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:50.252399 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-709f884e-a3a3-4dbd-b37c-6dba476cd2b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:50.474859 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75163fad-fea0-45d4-9046-96074aa50502 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:50.477632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f884e-a3a3-4dbd-b37c-6dba476cd2b4 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:50.499429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a31f70-a897-4e6c-adec-f3ef1fc497af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:50.500483 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a31f70-a897-4e6c-adec-f3ef1fc497af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:50.500782 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a31f70-a897-4e6c-adec-f3ef1fc497af admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:50.501068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a31f70-a897-4e6c-adec-f3ef1fc497af admin admin] PATH_INFO: `/v3/projects/460640d5a44d425aaf439fc4384704c3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:50.501781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1080dd-ce72-46a5-979d-fbf7fd3f04af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:50.503057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a31f70-a897-4e6c-adec-f3ef1fc497af admin admin] RBAC: Authorizing `identity:delete_project(project_id=460640d5a44d425aaf439fc4384704c3)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:50.504269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1080dd-ce72-46a5-979d-fbf7fd3f04af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:50.504817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1080dd-ce72-46a5-979d-fbf7fd3f04af admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:50.505023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a31f70-a897-4e6c-adec-f3ef1fc497af admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:50.505495 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1080dd-ce72-46a5-979d-fbf7fd3f04af admin admin] PATH_INFO: `/v3/users/0dc899eb9b034455a01178ed8ee41563` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:50.510732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1080dd-ce72-46a5-979d-fbf7fd3f04af admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc899eb9b034455a01178ed8ee41563)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:50.517580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1080dd-ce72-46a5-979d-fbf7fd3f04af admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:50.646072 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9c1080dd-ce72-46a5-979d-fbf7fd3f04af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc899eb9b034455a01178ed8ee41563'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:50.648283 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:50.649539 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9c1080dd-ce72-46a5-979d-fbf7fd3f04af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc899eb9b034455a01178ed8ee41563'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:50.679581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9c1080dd-ce72-46a5-979d-fbf7fd3f04af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc899eb9b034455a01178ed8ee41563'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:50.681246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c3a31f70-a897-4e6c-adec-f3ef1fc497af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460640d5a44d425aaf439fc4384704c3', 'request_id': 'req-c3a31f70-a897-4e6c-adec-f3ef1fc497af'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:50.710707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9c1080dd-ce72-46a5-979d-fbf7fd3f04af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc899eb9b034455a01178ed8ee41563'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:50.715830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c3a31f70-a897-4e6c-adec-f3ef1fc497af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460640d5a44d425aaf439fc4384704c3', 'request_id': 'req-c3a31f70-a897-4e6c-adec-f3ef1fc497af'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:50.733147 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9c1080dd-ce72-46a5-979d-fbf7fd3f04af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc899eb9b034455a01178ed8ee41563'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:50.738177 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c3a31f70-a897-4e6c-adec-f3ef1fc497af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460640d5a44d425aaf439fc4384704c3', 'request_id': 'req-c3a31f70-a897-4e6c-adec-f3ef1fc497af'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:50.753240 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 860/1727] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:08:50 2022] DELETE /identity/v3/users/0dc899eb9b034455a01178ed8ee41563 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:50.759222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be4bb7-8b96-416d-9703-c9e03dac2261 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:50.760130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be4bb7-8b96-416d-9703-c9e03dac2261 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:50.760750 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be4bb7-8b96-416d-9703-c9e03dac2261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:50.781549 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c3a31f70-a897-4e6c-adec-f3ef1fc497af admin admin] The token cache is being invalidate because project 460640d5a44d425aaf439fc4384704c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:08:50.782153 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c3a31f70-a897-4e6c-adec-f3ef1fc497af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:50.783040 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c3a31f70-a897-4e6c-adec-f3ef1fc497af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:50.784905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 868/1728] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:08:50 2022] DELETE /identity/v3/projects/460640d5a44d425aaf439fc4384704c3 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:50.792396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b92764-472f-45ef-bd6b-67d10f07ad39 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:50.792980 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b92764-472f-45ef-bd6b-67d10f07ad39 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:50.793484 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b92764-472f-45ef-bd6b-67d10f07ad39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:50.827627 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-45b92764-472f-45ef-bd6b-67d10f07ad39 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:50.829952 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-45b92764-472f-45ef-bd6b-67d10f07ad39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:50.835134 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c0be4bb7-8b96-416d-9703-c9e03dac2261 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:50.837900 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c0be4bb7-8b96-416d-9703-c9e03dac2261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:50.996138 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 861/1729] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:50.997662 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb95d82-d9fd-4022-91e1-5b634f572f78 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:50.998369 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb95d82-d9fd-4022-91e1-5b634f572f78 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:50.998475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb95d82-d9fd-4022-91e1-5b634f572f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:51.026346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 869/1730] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:51.029926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bab008-bad0-4be6-9b00-d524834286c9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:51.030223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bab008-bad0-4be6-9b00-d524834286c9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:51.030507 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bab008-bad0-4be6-9b00-d524834286c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:51.057505 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:51.083579 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b7bab008-bad0-4be6-9b00-d524834286c9 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:51.084832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b7bab008-bad0-4be6-9b00-d524834286c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:51.086649 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9bb95d82-d9fd-4022-91e1-5b634f572f78 None None] MFA Rules not processed for user `c1f33c40207e4701bb5bbd680d729c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:51.088457 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9bb95d82-d9fd-4022-91e1-5b634f572f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:51.126219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 870/1731] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:51.126219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bab008-bad0-4be6-9b00-d524834286c9 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:51.135868 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b7bab008-bad0-4be6-9b00-d524834286c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:51.279125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 862/1732] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:51.281996 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb95d82-d9fd-4022-91e1-5b634f572f78 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:51.304752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bab008-bad0-4be6-9b00-d524834286c9 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:51.327194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb95d82-d9fd-4022-91e1-5b634f572f78 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:51.331476 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9062cee-8abf-4c7a-9bc2-e01ea106f7b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:51.332268 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9062cee-8abf-4c7a-9bc2-e01ea106f7b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:51.332466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9062cee-8abf-4c7a-9bc2-e01ea106f7b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:51.332788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9062cee-8abf-4c7a-9bc2-e01ea106f7b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:51.351749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961c2bc-9a2b-4ff8-af16-d946a36d060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:51.358041 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961c2bc-9a2b-4ff8-af16-d946a36d060c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:51.358619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961c2bc-9a2b-4ff8-af16-d946a36d060c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:51.360496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961c2bc-9a2b-4ff8-af16-d946a36d060c admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:51.364481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961c2bc-9a2b-4ff8-af16-d946a36d060c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:08:51.366095 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961c2bc-9a2b-4ff8-af16-d946a36d060c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:51.369210 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9062cee-8abf-4c7a-9bc2-e01ea106f7b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:51.370868 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9062cee-8abf-4c7a-9bc2-e01ea106f7b9 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:51.378222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961c2bc-9a2b-4ff8-af16-d946a36d060c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:51.403423 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 871/1733] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:51.413552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95a5bd-6fb5-4455-ad7e-6522fde060b4 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:51.413926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95a5bd-6fb5-4455-ad7e-6522fde060b4 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:51.414166 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95a5bd-6fb5-4455-ad7e-6522fde060b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:51.424647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 863/1734] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:08:51.426150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005625f2-9225-4e8f-8147-a3fa86f6e066 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:51.426444 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005625f2-9225-4e8f-8147-a3fa86f6e066 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:51.426721 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005625f2-9225-4e8f-8147-a3fa86f6e066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:51.471284 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-005625f2-9225-4e8f-8147-a3fa86f6e066 None None] MFA Rules not processed for user `c1f33c40207e4701bb5bbd680d729c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:51.472714 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-005625f2-9225-4e8f-8147-a3fa86f6e066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:51.481563 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 864/1735] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:51.482673 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005625f2-9225-4e8f-8147-a3fa86f6e066 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:51.497387 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-fe95a5bd-6fb5-4455-ad7e-6522fde060b4 None None] MFA Rules not processed for user `5cec6311f0fb4d908877ebdb7236ef21`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:51.499776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fe95a5bd-6fb5-4455-ad7e-6522fde060b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:51.505216 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005625f2-9225-4e8f-8147-a3fa86f6e066 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:51.515547 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514cda9-9653-4a1f-945a-b23305e6c1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:51.516243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514cda9-9653-4a1f-945a-b23305e6c1eb admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:51.516524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514cda9-9653-4a1f-945a-b23305e6c1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:51.516798 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514cda9-9653-4a1f-945a-b23305e6c1eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:51.517505 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514cda9-9653-4a1f-945a-b23305e6c1eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:51.519488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514cda9-9653-4a1f-945a-b23305e6c1eb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:51.610527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 865/1736] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:51 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:51.618037 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514cda9-9653-4a1f-945a-b23305e6c1eb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:51.625467 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e514cda9-9653-4a1f-945a-b23305e6c1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:51.707734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 872/1737] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:51.707734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95a5bd-6fb5-4455-ad7e-6522fde060b4 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:51.730121 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:51.754809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95a5bd-6fb5-4455-ad7e-6522fde060b4 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:51.991337 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514cda9-9653-4a1f-945a-b23305e6c1eb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:52.016156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47102ec-4ecc-417a-b033-312747655381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:52.016492 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47102ec-4ecc-417a-b033-312747655381 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:52.016805 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47102ec-4ecc-417a-b033-312747655381 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:52.017107 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47102ec-4ecc-417a-b033-312747655381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:52.028519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edf911-e534-44a4-ad0d-5d3157caab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:52.029241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edf911-e534-44a4-ad0d-5d3157caab6c admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:52.029618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edf911-e534-44a4-ad0d-5d3157caab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:52.029916 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edf911-e534-44a4-ad0d-5d3157caab6c admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:52.030548 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edf911-e534-44a4-ad0d-5d3157caab6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:52.040848 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edf911-e534-44a4-ad0d-5d3157caab6c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:52.107678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 873/1738] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:51 2022] POST /identity/v3/users => generated 287 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:52.118892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edf911-e534-44a4-ad0d-5d3157caab6c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:52.148339 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edf911-e534-44a4-ad0d-5d3157caab6c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:52.171989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bf5b9-402c-410f-968c-28583d463c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:52.174045 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bf5b9-402c-410f-968c-28583d463c2d admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:52.174396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bf5b9-402c-410f-968c-28583d463c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:52.176887 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bf5b9-402c-410f-968c-28583d463c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:52.177695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bf5b9-402c-410f-968c-28583d463c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:52.187771 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bf5b9-402c-410f-968c-28583d463c2d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:52.201666 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:52.206992 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47102ec-4ecc-417a-b033-312747655381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:52.222503 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47102ec-4ecc-417a-b033-312747655381 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:52.238057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 874/1739] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:52.239701 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bf5b9-402c-410f-968c-28583d463c2d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:52.266780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 866/1740] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:52.276321 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bf5b9-402c-410f-968c-28583d463c2d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:52.302888 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a57fc1-805a-4271-a335-1f3d6caeec2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:52.306104 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a57fc1-805a-4271-a335-1f3d6caeec2e admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:52.306828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a57fc1-805a-4271-a335-1f3d6caeec2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:52.306828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a57fc1-805a-4271-a335-1f3d6caeec2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:52.311214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a57fc1-805a-4271-a335-1f3d6caeec2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:52.330777 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a57fc1-805a-4271-a335-1f3d6caeec2e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:52.416801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 875/1741] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:52.420950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47102ec-4ecc-417a-b033-312747655381 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:52.451300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47102ec-4ecc-417a-b033-312747655381 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:52.476213 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fc588-d1c8-4502-8114-9ebad93bd240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:52.478459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fc588-d1c8-4502-8114-9ebad93bd240 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:52.479407 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fc588-d1c8-4502-8114-9ebad93bd240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:52.482113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fc588-d1c8-4502-8114-9ebad93bd240 admin admin] PATH_INFO: `/v3/projects/abf483882b39458099459e77fbde8a32/users/0703a57a00014d07afc2ea052a69eb45/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:52.557260 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fc588-d1c8-4502-8114-9ebad93bd240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf483882b39458099459e77fbde8a32, user_id=0703a57a00014d07afc2ea052a69eb45, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:52.562631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fc588-d1c8-4502-8114-9ebad93bd240 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:52.611486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 867/1742] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:52 2022] PUT /identity/v3/projects/abf483882b39458099459e77fbde8a32/users/0703a57a00014d07afc2ea052a69eb45/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:52.613554 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadbfb5-bee3-40e0-9038-9e9f43ae1e1e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:52.614244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadbfb5-bee3-40e0-9038-9e9f43ae1e1e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:52.614687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadbfb5-bee3-40e0-9038-9e9f43ae1e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:52.749443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2cadbfb5-bee3-40e0-9038-9e9f43ae1e1e None None] MFA Rules not processed for user `0703a57a00014d07afc2ea052a69eb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:52.753994 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2cadbfb5-bee3-40e0-9038-9e9f43ae1e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:52.996619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 876/1743] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:52.998860 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fc588-d1c8-4502-8114-9ebad93bd240 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:53.252317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fc588-d1c8-4502-8114-9ebad93bd240 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:53.280081 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62567554-628d-42cb-b463-3f69d5ee27f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:53.280799 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62567554-628d-42cb-b463-3f69d5ee27f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:53.281082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62567554-628d-42cb-b463-3f69d5ee27f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:53.281358 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62567554-628d-42cb-b463-3f69d5ee27f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:53.282116 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62567554-628d-42cb-b463-3f69d5ee27f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:53.284553 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62567554-628d-42cb-b463-3f69d5ee27f8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:53.349040 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 868/1744] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:52 2022] POST /identity/v3/projects => generated 373 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:53.353451 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadbfb5-bee3-40e0-9038-9e9f43ae1e1e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:53.374337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadbfb5-bee3-40e0-9038-9e9f43ae1e1e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:53.491201 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62567554-628d-42cb-b463-3f69d5ee27f8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:53.493584 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-62567554-628d-42cb-b463-3f69d5ee27f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:53.695108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16dbe4-4b20-49d9-b693-5b7d99844b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:53.695780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16dbe4-4b20-49d9-b693-5b7d99844b93 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:53.696068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16dbe4-4b20-49d9-b693-5b7d99844b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:53.696389 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16dbe4-4b20-49d9-b693-5b7d99844b93 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:53.697353 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16dbe4-4b20-49d9-b693-5b7d99844b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:53.712643 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16dbe4-4b20-49d9-b693-5b7d99844b93 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:53.755582 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:53.795110 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 877/1745] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:53 2022] POST /identity/v3/users => generated 293 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:53.799338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16dbe4-4b20-49d9-b693-5b7d99844b93 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:53.831598 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16dbe4-4b20-49d9-b693-5b7d99844b93 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:53.865038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d68f7-769b-403d-ba64-349362ff1f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:53.865956 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d68f7-769b-403d-ba64-349362ff1f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:53.866386 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d68f7-769b-403d-ba64-349362ff1f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:53.866718 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62567554-628d-42cb-b463-3f69d5ee27f8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:53.866988 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d68f7-769b-403d-ba64-349362ff1f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:53.868572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d68f7-769b-403d-ba64-349362ff1f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:53.876222 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d68f7-769b-403d-ba64-349362ff1f91 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:53.881539 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb199dab-a482-42cb-9022-b64bee8f04db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:53.885331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb199dab-a482-42cb-9022-b64bee8f04db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:53.898120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb199dab-a482-42cb-9022-b64bee8f04db admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:53.898760 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb199dab-a482-42cb-9022-b64bee8f04db admin admin] PATH_INFO: `/v3/projects/048d8844ef6e465f96ce3f8ef4c07e7a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:53.904678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb199dab-a482-42cb-9022-b64bee8f04db admin admin] RBAC: Authorizing `identity:delete_project(project_id=048d8844ef6e465f96ce3f8ef4c07e7a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:53.913270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb199dab-a482-42cb-9022-b64bee8f04db admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:53.928864 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 878/1746] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:53.933550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d68f7-769b-403d-ba64-349362ff1f91 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:53.980294 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d68f7-769b-403d-ba64-349362ff1f91 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:53.991173 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e3e9a-d69a-4890-a9ec-3491b5497a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:53.992097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e3e9a-d69a-4890-a9ec-3491b5497a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:53.992385 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e3e9a-d69a-4890-a9ec-3491b5497a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:53.992667 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e3e9a-d69a-4890-a9ec-3491b5497a05 admin admin] PATH_INFO: `/v3/projects/aeed42454f7544f5aa2a4bdc1d3f7082/users/9012632b6ae745398894b836cce27381/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:54.040704 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e3e9a-d69a-4890-a9ec-3491b5497a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeed42454f7544f5aa2a4bdc1d3f7082, user_id=9012632b6ae745398894b836cce27381, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:54.043965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e3e9a-d69a-4890-a9ec-3491b5497a05 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:54.102951 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 879/1747] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:53 2022] PUT /identity/v3/projects/aeed42454f7544f5aa2a4bdc1d3f7082/users/9012632b6ae745398894b836cce27381/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:54.107456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e3e9a-d69a-4890-a9ec-3491b5497a05 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:54.115070 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fb199dab-a482-42cb-9022-b64bee8f04db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '048d8844ef6e465f96ce3f8ef4c07e7a', 'request_id': 'req-fb199dab-a482-42cb-9022-b64bee8f04db'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:54.142103 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fb199dab-a482-42cb-9022-b64bee8f04db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '048d8844ef6e465f96ce3f8ef4c07e7a', 'request_id': 'req-fb199dab-a482-42cb-9022-b64bee8f04db'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:54.152076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:54.169999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fb199dab-a482-42cb-9022-b64bee8f04db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '048d8844ef6e465f96ce3f8ef4c07e7a', 'request_id': 'req-fb199dab-a482-42cb-9022-b64bee8f04db'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:54.217968 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fb199dab-a482-42cb-9022-b64bee8f04db admin admin] The token cache is being invalidate because project 048d8844ef6e465f96ce3f8ef4c07e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:08:54.218269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fb199dab-a482-42cb-9022-b64bee8f04db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:54.220235 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fb199dab-a482-42cb-9022-b64bee8f04db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:54.224943 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 869/1748] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:08:53 2022] DELETE /identity/v3/projects/048d8844ef6e465f96ce3f8ef4c07e7a => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:54.228737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb199dab-a482-42cb-9022-b64bee8f04db admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:54.231607 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fb199dab-a482-42cb-9022-b64bee8f04db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:54.405393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e3e9a-d69a-4890-a9ec-3491b5497a05 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:54.547885 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3658e37-d5c2-43df-9c09-f78a99a997fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:54.549457 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3658e37-d5c2-43df-9c09-f78a99a997fa admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:54.549457 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3658e37-d5c2-43df-9c09-f78a99a997fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:54.552227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3658e37-d5c2-43df-9c09-f78a99a997fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:54.553011 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3658e37-d5c2-43df-9c09-f78a99a997fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:54.554727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3658e37-d5c2-43df-9c09-f78a99a997fa admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:54.590244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 880/1749] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:54.599275 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3658e37-d5c2-43df-9c09-f78a99a997fa admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:54.606704 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a3658e37-d5c2-43df-9c09-f78a99a997fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:54.646466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb199dab-a482-42cb-9022-b64bee8f04db admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:54.678608 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a72973-5dc3-4ad6-8b1c-ec77b2ab79b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:54.678827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3658e37-d5c2-43df-9c09-f78a99a997fa admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:54.683973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a72973-5dc3-4ad6-8b1c-ec77b2ab79b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:54.684196 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a72973-5dc3-4ad6-8b1c-ec77b2ab79b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:54.684550 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a72973-5dc3-4ad6-8b1c-ec77b2ab79b8 admin admin] PATH_INFO: `/v3/users/5ede3166925041838471b08a2e586dcc` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:54.697710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a72973-5dc3-4ad6-8b1c-ec77b2ab79b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ede3166925041838471b08a2e586dcc)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:54.700068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a72973-5dc3-4ad6-8b1c-ec77b2ab79b8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:54.709448 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efe168-b99a-46a8-a9a3-99b31c82339f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:54.711333 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efe168-b99a-46a8-a9a3-99b31c82339f admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:54.711504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efe168-b99a-46a8-a9a3-99b31c82339f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:54.714006 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efe168-b99a-46a8-a9a3-99b31c82339f admin admin] PATH_INFO: `/v3/projects/aeed42454f7544f5aa2a4bdc1d3f7082/users/9012632b6ae745398894b836cce27381/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:54.721221 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efe168-b99a-46a8-a9a3-99b31c82339f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeed42454f7544f5aa2a4bdc1d3f7082, user_id=9012632b6ae745398894b836cce27381, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:54.728220 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efe168-b99a-46a8-a9a3-99b31c82339f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:54.804230 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 881/1750] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:54 2022] PUT /identity/v3/projects/aeed42454f7544f5aa2a4bdc1d3f7082/users/9012632b6ae745398894b836cce27381/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:54.816274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd004685-1f17-453b-afa1-1a62aff5491b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:54.816571 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd004685-1f17-453b-afa1-1a62aff5491b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:54.816908 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd004685-1f17-453b-afa1-1a62aff5491b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:54.922840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-bd004685-1f17-453b-afa1-1a62aff5491b None None] MFA Rules not processed for user `9012632b6ae745398894b836cce27381`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:54.923884 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f9a72973-5dc3-4ad6-8b1c-ec77b2ab79b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ede3166925041838471b08a2e586dcc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:54.928845 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bd004685-1f17-453b-afa1-1a62aff5491b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:54.936499 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f9a72973-5dc3-4ad6-8b1c-ec77b2ab79b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ede3166925041838471b08a2e586dcc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:54.968279 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f9a72973-5dc3-4ad6-8b1c-ec77b2ab79b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ede3166925041838471b08a2e586dcc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:55.021958 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f9a72973-5dc3-4ad6-8b1c-ec77b2ab79b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ede3166925041838471b08a2e586dcc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:55.049157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f9a72973-5dc3-4ad6-8b1c-ec77b2ab79b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ede3166925041838471b08a2e586dcc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:55.061379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:55.069694 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 870/1751] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:08:54 2022] DELETE /identity/v3/users/5ede3166925041838471b08a2e586dcc => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:55.155800 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 882/1752] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:08:55.165780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a72973-5dc3-4ad6-8b1c-ec77b2ab79b8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:55.167587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f9a72973-5dc3-4ad6-8b1c-ec77b2ab79b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:55.340565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a72973-5dc3-4ad6-8b1c-ec77b2ab79b8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:55.351755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b64ee-7f72-46c9-b955-b83ead2cd3b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:55.355682 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b64ee-7f72-46c9-b955-b83ead2cd3b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:55.356141 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b64ee-7f72-46c9-b955-b83ead2cd3b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:55.356584 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b64ee-7f72-46c9-b955-b83ead2cd3b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:55.434988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:55.581687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b64ee-7f72-46c9-b955-b83ead2cd3b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:55.583226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b64ee-7f72-46c9-b955-b83ead2cd3b2 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:55.624161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e06711-5a18-441d-90b7-58d27b2c8587 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:55.625634 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e06711-5a18-441d-90b7-58d27b2c8587 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:55.626423 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e06711-5a18-441d-90b7-58d27b2c8587 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:55.629302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 883/1753] 10.222.0.61 () {54 vars in 912 bytes} [Thu May 26 21:08:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:08:55.634806 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 871/1754] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:55.644859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620e58b-eb49-4882-b8bd-c9c833988ad2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:55.645241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620e58b-eb49-4882-b8bd-c9c833988ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:55.645622 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620e58b-eb49-4882-b8bd-c9c833988ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:55.711174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a620e58b-eb49-4882-b8bd-c9c833988ad2 None None] MFA Rules not processed for user `e3514a1833104114894abe6c41ea30a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:55.715823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a620e58b-eb49-4882-b8bd-c9c833988ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:55.955757 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 884/1755] 10.222.0.61 () {58 vars in 1009 bytes} [Thu May 26 21:08:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:08:56.092020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2079fb8-a6c0-4577-a3bb-d16ac3036c7e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:56.092635 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2079fb8-a6c0-4577-a3bb-d16ac3036c7e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:56.093390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2079fb8-a6c0-4577-a3bb-d16ac3036c7e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:56.095395 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 872/1756] 10.222.0.61 () {54 vars in 921 bytes} [Thu May 26 21:08:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:08:56.161748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e331a73-5aea-4c97-85ee-59c985a8e6b7 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:56.162295 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e331a73-5aea-4c97-85ee-59c985a8e6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:56.162770 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e331a73-5aea-4c97-85ee-59c985a8e6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:56.251866 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-5e331a73-5aea-4c97-85ee-59c985a8e6b7 None None] MFA Rules not processed for user `a99b767501244338bc48fb5428a589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:56.262615 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5e331a73-5aea-4c97-85ee-59c985a8e6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:56.374455 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2079fb8-a6c0-4577-a3bb-d16ac3036c7e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:56.379482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a2079fb8-a6c0-4577-a3bb-d16ac3036c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:56.463062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2079fb8-a6c0-4577-a3bb-d16ac3036c7e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:56.478764 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82210fe-df25-461e-b7a7-6a7498114e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:56.484060 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82210fe-df25-461e-b7a7-6a7498114e9b service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:56.484436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82210fe-df25-461e-b7a7-6a7498114e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:56.484902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82210fe-df25-461e-b7a7-6a7498114e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:56.530281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82210fe-df25-461e-b7a7-6a7498114e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:56.535574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82210fe-df25-461e-b7a7-6a7498114e9b service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:56.600270 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 885/1757] 10.222.0.61 () {58 vars in 1018 bytes} [Thu May 26 21:08:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:56.606016 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 873/1758] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:56.688784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481bcb5-692c-4b9f-afdb-55608433e772 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:56.689680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481bcb5-692c-4b9f-afdb-55608433e772 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:56.690162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481bcb5-692c-4b9f-afdb-55608433e772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:56.721928 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0481bcb5-692c-4b9f-afdb-55608433e772 None None] MFA Rules not processed for user `c1f33c40207e4701bb5bbd680d729c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:56.723466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0481bcb5-692c-4b9f-afdb-55608433e772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:56.920245 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 886/1759] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:57.036484 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82210fe-df25-461e-b7a7-6a7498114e9b service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:57.038146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b82210fe-df25-461e-b7a7-6a7498114e9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:57.222736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82210fe-df25-461e-b7a7-6a7498114e9b service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:57.234076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a27b8c-e275-4cff-932c-4623a00dfc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:57.235245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a27b8c-e275-4cff-932c-4623a00dfc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:57.235634 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a27b8c-e275-4cff-932c-4623a00dfc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:57.236011 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a27b8c-e275-4cff-932c-4623a00dfc27 admin admin] PATH_INFO: `/v3/users/0703a57a00014d07afc2ea052a69eb45` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:57.238385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a27b8c-e275-4cff-932c-4623a00dfc27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0703a57a00014d07afc2ea052a69eb45)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:57.245425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a27b8c-e275-4cff-932c-4623a00dfc27 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:57.436481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-73a27b8c-e275-4cff-932c-4623a00dfc27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0703a57a00014d07afc2ea052a69eb45'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:57.438750 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-73a27b8c-e275-4cff-932c-4623a00dfc27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0703a57a00014d07afc2ea052a69eb45'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:57.468880 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-73a27b8c-e275-4cff-932c-4623a00dfc27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0703a57a00014d07afc2ea052a69eb45'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:57.508268 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-73a27b8c-e275-4cff-932c-4623a00dfc27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0703a57a00014d07afc2ea052a69eb45'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:57.528010 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-73a27b8c-e275-4cff-932c-4623a00dfc27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0703a57a00014d07afc2ea052a69eb45'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:57.551930 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 874/1760] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:08:57 2022] DELETE /identity/v3/users/0703a57a00014d07afc2ea052a69eb45 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:57.553726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2094af-dd44-4baa-8c56-e3bb2254b395 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:57.554084 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2094af-dd44-4baa-8c56-e3bb2254b395 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:57.554380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2094af-dd44-4baa-8c56-e3bb2254b395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:57.618709 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ba2094af-dd44-4baa-8c56-e3bb2254b395 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:57.620806 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ba2094af-dd44-4baa-8c56-e3bb2254b395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:57.668982 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:57.830822 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 887/1761] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:57.893887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a27b8c-e275-4cff-932c-4623a00dfc27 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:57.895346 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-73a27b8c-e275-4cff-932c-4623a00dfc27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:57.986584 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:58.028631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2094af-dd44-4baa-8c56-e3bb2254b395 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:58.030433 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ba2094af-dd44-4baa-8c56-e3bb2254b395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:58.147174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a27b8c-e275-4cff-932c-4623a00dfc27 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:58.167009 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24f902-dbc4-4a42-856c-f68c3a0fc2dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:58.172554 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24f902-dbc4-4a42-856c-f68c3a0fc2dd service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:58.172915 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24f902-dbc4-4a42-856c-f68c3a0fc2dd service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:58.173234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24f902-dbc4-4a42-856c-f68c3a0fc2dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:58.180710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0f24f902-dbc4-4a42-856c-f68c3a0fc2dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:58.188905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2094af-dd44-4baa-8c56-e3bb2254b395 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:58.199887 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3be04-1291-4e5b-be55-e725a7888fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:58.202241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3be04-1291-4e5b-be55-e725a7888fbf service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:58.202724 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3be04-1291-4e5b-be55-e725a7888fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:58.203296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3be04-1291-4e5b-be55-e725a7888fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:58.224309 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24f902-dbc4-4a42-856c-f68c3a0fc2dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:58.228039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3be04-1291-4e5b-be55-e725a7888fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:58.230428 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3be04-1291-4e5b-be55-e725a7888fbf service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:58.230605 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24f902-dbc4-4a42-856c-f68c3a0fc2dd service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:58.256304 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 888/1762] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:08:58.259717 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 875/1763] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:08:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:08:58.781192 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3be04-1291-4e5b-be55-e725a7888fbf service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:58.783438 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-24d3be04-1291-4e5b-be55-e725a7888fbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:58.814761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3be04-1291-4e5b-be55-e725a7888fbf service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:58.831795 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcee5c0-0cee-4ced-9b61-f1a5d4308867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:58.835552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcee5c0-0cee-4ced-9b61-f1a5d4308867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:58.837699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcee5c0-0cee-4ced-9b61-f1a5d4308867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:58.838506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcee5c0-0cee-4ced-9b61-f1a5d4308867 admin admin] PATH_INFO: `/v3/projects/42e65b18d87048cfb22607930d3d8b36` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:58.841259 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcee5c0-0cee-4ced-9b61-f1a5d4308867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42e65b18d87048cfb22607930d3d8b36)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:58.844304 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcee5c0-0cee-4ced-9b61-f1a5d4308867 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:59.009376 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3dcee5c0-0cee-4ced-9b61-f1a5d4308867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42e65b18d87048cfb22607930d3d8b36', 'request_id': 'req-3dcee5c0-0cee-4ced-9b61-f1a5d4308867'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:59.033040 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3dcee5c0-0cee-4ced-9b61-f1a5d4308867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42e65b18d87048cfb22607930d3d8b36', 'request_id': 'req-3dcee5c0-0cee-4ced-9b61-f1a5d4308867'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:59.054331 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3dcee5c0-0cee-4ced-9b61-f1a5d4308867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42e65b18d87048cfb22607930d3d8b36', 'request_id': 'req-3dcee5c0-0cee-4ced-9b61-f1a5d4308867'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:59.103473 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3dcee5c0-0cee-4ced-9b61-f1a5d4308867 admin admin] The token cache is being invalidate because project 42e65b18d87048cfb22607930d3d8b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:08:59.104218 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3dcee5c0-0cee-4ced-9b61-f1a5d4308867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:59.105104 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3dcee5c0-0cee-4ced-9b61-f1a5d4308867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:08:59.108367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 889/1764] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:08:58 2022] DELETE /identity/v3/projects/42e65b18d87048cfb22607930d3d8b36 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:08:59.113174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebd244-1c71-4718-b5e8-9040ec0d99d4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:59.113461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebd244-1c71-4718-b5e8-9040ec0d99d4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:59.118191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebd244-1c71-4718-b5e8-9040ec0d99d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:59.192407 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-48ebd244-1c71-4718-b5e8-9040ec0d99d4 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:59.197997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-48ebd244-1c71-4718-b5e8-9040ec0d99d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:59.256784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d2af8-f3db-4f4e-8438-224705065bdc None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:59.257178 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d2af8-f3db-4f4e-8438-224705065bdc None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:59.257470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d2af8-f3db-4f4e-8438-224705065bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:59.287272 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 876/1765] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:59.294812 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-697d2af8-f3db-4f4e-8438-224705065bdc None None] MFA Rules not processed for user `f215554a96e0461aa1dc78f930586cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:59.295650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77835dc-9814-4499-aa42-cf045831d2dd None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:59.296130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77835dc-9814-4499-aa42-cf045831d2dd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:59.297580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77835dc-9814-4499-aa42-cf045831d2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:59.300375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-697d2af8-f3db-4f4e-8438-224705065bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:59.330819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f77835dc-9814-4499-aa42-cf045831d2dd None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:08:59.332278 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f77835dc-9814-4499-aa42-cf045831d2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:59.355502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 877/1766] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:08:59.356691 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77835dc-9814-4499-aa42-cf045831d2dd None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:59.367191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77835dc-9814-4499-aa42-cf045831d2dd None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:59.372827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c798ce-c04b-4fdb-8273-2cbcf94f240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:59.373851 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c798ce-c04b-4fdb-8273-2cbcf94f240d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:59.374253 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c798ce-c04b-4fdb-8273-2cbcf94f240d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:59.374725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c798ce-c04b-4fdb-8273-2cbcf94f240d admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:59.375565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c798ce-c04b-4fdb-8273-2cbcf94f240d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:08:59.375981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c798ce-c04b-4fdb-8273-2cbcf94f240d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:59.377979 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c798ce-c04b-4fdb-8273-2cbcf94f240d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:59.397770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 878/1767] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:08:59.398900 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c798ce-c04b-4fdb-8273-2cbcf94f240d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:59.409339 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:08:59.440687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c798ce-c04b-4fdb-8273-2cbcf94f240d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:59.460274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 890/1768] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:08:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:08:59.461038 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8af9bc-d1de-4e9a-8f10-d0c7225eff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:59.462477 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8af9bc-d1de-4e9a-8f10-d0c7225eff3c admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:59.463002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8af9bc-d1de-4e9a-8f10-d0c7225eff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:59.463775 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8af9bc-d1de-4e9a-8f10-d0c7225eff3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:59.464908 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8af9bc-d1de-4e9a-8f10-d0c7225eff3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:59.468129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8af9bc-d1de-4e9a-8f10-d0c7225eff3c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:59.551320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 879/1769] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:08:59 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:08:59.555610 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d2af8-f3db-4f4e-8438-224705065bdc None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:59.574914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d2af8-f3db-4f4e-8438-224705065bdc None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:59.735684 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db77298-669e-4136-b40b-8042829cdb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:59.736406 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db77298-669e-4136-b40b-8042829cdb9a admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:59.736695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db77298-669e-4136-b40b-8042829cdb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:59.736979 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db77298-669e-4136-b40b-8042829cdb9a admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:59.737706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db77298-669e-4136-b40b-8042829cdb9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:59.739792 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db77298-669e-4136-b40b-8042829cdb9a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:59.789513 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 891/1770] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:08:59 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:08:59.793931 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8af9bc-d1de-4e9a-8f10-d0c7225eff3c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:59.834509 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8af9bc-d1de-4e9a-8f10-d0c7225eff3c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:59.854581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8869178-a9cb-4029-be22-6c0f102db19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:59.859706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8869178-a9cb-4029-be22-6c0f102db19e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:59.862029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8869178-a9cb-4029-be22-6c0f102db19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:59.862320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8869178-a9cb-4029-be22-6c0f102db19e admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:59.863114 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8869178-a9cb-4029-be22-6c0f102db19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:59.869136 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8869178-a9cb-4029-be22-6c0f102db19e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:59.872828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db77298-669e-4136-b40b-8042829cdb9a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:59.881396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6db77298-669e-4136-b40b-8042829cdb9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:08:59.906571 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 880/1771] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:08:59.907962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8869178-a9cb-4029-be22-6c0f102db19e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:08:59.931330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db77298-669e-4136-b40b-8042829cdb9a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:59.932363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8869178-a9cb-4029-be22-6c0f102db19e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:08:59.942361 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:59.944205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:59.944961 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:59.944961 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54 admin admin] PATH_INFO: `/v3/projects/abf483882b39458099459e77fbde8a32` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:59.948410 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf483882b39458099459e77fbde8a32)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:59.954065 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44f04d-a872-43d6-82f2-2c0d2f7bdaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:08:59.954773 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44f04d-a872-43d6-82f2-2c0d2f7bdaff admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:08:59.955413 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44f04d-a872-43d6-82f2-2c0d2f7bdaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:08:59.955690 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44f04d-a872-43d6-82f2-2c0d2f7bdaff admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:08:59.956015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:59.956481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44f04d-a872-43d6-82f2-2c0d2f7bdaff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:08:59.958172 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44f04d-a872-43d6-82f2-2c0d2f7bdaff admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:08:59.996037 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 881/1772] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:08:59.999973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44f04d-a872-43d6-82f2-2c0d2f7bdaff admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:00.034129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44f04d-a872-43d6-82f2-2c0d2f7bdaff admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:00.051506 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca243eda-6c49-40eb-9765-09299225061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:00.052437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243eda-6c49-40eb-9765-09299225061b admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:00.052720 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243eda-6c49-40eb-9765-09299225061b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:00.053328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca243eda-6c49-40eb-9765-09299225061b admin admin] PATH_INFO: `/v3/projects/5a267a83c5a049cc89bbe9fd7597a6d9/users/b3c61cf2a87f4c1d8474d039d41f5515/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:00.083515 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca243eda-6c49-40eb-9765-09299225061b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a267a83c5a049cc89bbe9fd7597a6d9, user_id=b3c61cf2a87f4c1d8474d039d41f5515, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:00.086701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca243eda-6c49-40eb-9765-09299225061b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:00.124149 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 882/1773] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:08:59 2022] PUT /identity/v3/projects/5a267a83c5a049cc89bbe9fd7597a6d9/users/b3c61cf2a87f4c1d8474d039d41f5515/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:00.134334 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee1b8f-c9d8-467d-a468-3aa5efa97d59 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:00.134629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee1b8f-c9d8-467d-a468-3aa5efa97d59 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:00.134947 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee1b8f-c9d8-467d-a468-3aa5efa97d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:00.174248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf483882b39458099459e77fbde8a32', 'request_id': 'req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:00.200899 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf483882b39458099459e77fbde8a32', 'request_id': 'req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:00.210855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf483882b39458099459e77fbde8a32', 'request_id': 'req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:00.267829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54 admin admin] The token cache is being invalidate because project abf483882b39458099459e77fbde8a32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:00.268934 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:00.270971 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:00.280449 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 892/1774] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:08:59 2022] DELETE /identity/v3/projects/abf483882b39458099459e77fbde8a32 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:00.281528 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:00.286398 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:00.458059 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd7473-2ef7-4901-aac1-0c7fd5bd5d54 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:00.464941 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:00.591071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7fee1b8f-c9d8-467d-a468-3aa5efa97d59 None None] MFA Rules not processed for user `b3c61cf2a87f4c1d8474d039d41f5515`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:00.592757 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7fee1b8f-c9d8-467d-a468-3aa5efa97d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:00.610266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:00.633940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd11c94-6405-4269-b460-de4d1e2dcbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:00.635057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd11c94-6405-4269-b460-de4d1e2dcbd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:00.635470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd11c94-6405-4269-b460-de4d1e2dcbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:00.636466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd11c94-6405-4269-b460-de4d1e2dcbd9 admin admin] PATH_INFO: `/v3/users/9012632b6ae745398894b836cce27381` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:00.645897 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd11c94-6405-4269-b460-de4d1e2dcbd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9012632b6ae745398894b836cce27381)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:00.653065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd11c94-6405-4269-b460-de4d1e2dcbd9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:00.814447 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1fd11c94-6405-4269-b460-de4d1e2dcbd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9012632b6ae745398894b836cce27381'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:00.835307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 883/1775] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 702 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:00.856758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee1b8f-c9d8-467d-a468-3aa5efa97d59 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:00.877777 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7fee1b8f-c9d8-467d-a468-3aa5efa97d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:00.883652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1fd11c94-6405-4269-b460-de4d1e2dcbd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9012632b6ae745398894b836cce27381'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:00.887893 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1fd11c94-6405-4269-b460-de4d1e2dcbd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9012632b6ae745398894b836cce27381'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:00.917451 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1fd11c94-6405-4269-b460-de4d1e2dcbd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9012632b6ae745398894b836cce27381'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:00.932902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee1b8f-c9d8-467d-a468-3aa5efa97d59 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:00.935101 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1fd11c94-6405-4269-b460-de4d1e2dcbd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9012632b6ae745398894b836cce27381'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:00.960266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 893/1776] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:00 2022] DELETE /identity/v3/users/9012632b6ae745398894b836cce27381 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:00.964933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28f63d-cdcc-4828-b2e6-3439b897ea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:00.971811 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28f63d-cdcc-4828-b2e6-3439b897ea7d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:00.972394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28f63d-cdcc-4828-b2e6-3439b897ea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:00.972821 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28f63d-cdcc-4828-b2e6-3439b897ea7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:00.973728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28f63d-cdcc-4828-b2e6-3439b897ea7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:00.976105 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28f63d-cdcc-4828-b2e6-3439b897ea7d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:01.036765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 884/1777] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:00 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:01.040953 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd11c94-6405-4269-b460-de4d1e2dcbd9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:01.042697 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1fd11c94-6405-4269-b460-de4d1e2dcbd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:01.175531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd11c94-6405-4269-b460-de4d1e2dcbd9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:01.252430 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:01.303302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fd665-c821-40dd-95e3-ac31c90a9ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:01.305986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fd665-c821-40dd-95e3-ac31c90a9ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:01.306400 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fd665-c821-40dd-95e3-ac31c90a9ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:01.306793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fd665-c821-40dd-95e3-ac31c90a9ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:01.310312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fd665-c821-40dd-95e3-ac31c90a9ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:01.312913 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fd665-c821-40dd-95e3-ac31c90a9ef3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:01.369167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 894/1778] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:01 2022] POST /identity/v3/users => generated 294 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:01.373127 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28f63d-cdcc-4828-b2e6-3439b897ea7d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:01.391982 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28f63d-cdcc-4828-b2e6-3439b897ea7d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:01.407836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc8d3e-1a15-45a0-a551-cd272b2e1be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:01.408548 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc8d3e-1a15-45a0-a551-cd272b2e1be3 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:01.408834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc8d3e-1a15-45a0-a551-cd272b2e1be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:01.409110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc8d3e-1a15-45a0-a551-cd272b2e1be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:01.410050 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc8d3e-1a15-45a0-a551-cd272b2e1be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:01.413770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc8d3e-1a15-45a0-a551-cd272b2e1be3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:01.469813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fd665-c821-40dd-95e3-ac31c90a9ef3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:01.474827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 885/1779] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:01.494387 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fd665-c821-40dd-95e3-ac31c90a9ef3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:01.500957 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f7997-9d54-4751-b078-0e5c8b3096e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:01.502715 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7997-9d54-4751-b078-0e5c8b3096e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:01.503067 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7997-9d54-4751-b078-0e5c8b3096e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:01.503420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7997-9d54-4751-b078-0e5c8b3096e7 admin admin] PATH_INFO: `/v3/projects/5ca5a4e138d84f3d8eca22ad9affc9dd/users/84d24270c5b348e1b234e8dded243c90/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:01.535885 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f7997-9d54-4751-b078-0e5c8b3096e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca5a4e138d84f3d8eca22ad9affc9dd, user_id=84d24270c5b348e1b234e8dded243c90, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:01.553157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f7997-9d54-4751-b078-0e5c8b3096e7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:01.638518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc8d3e-1a15-45a0-a551-cd272b2e1be3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:01.653188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 895/1780] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:01 2022] PUT /identity/v3/projects/5ca5a4e138d84f3d8eca22ad9affc9dd/users/84d24270c5b348e1b234e8dded243c90/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:01.662721 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc8d3e-1a15-45a0-a551-cd272b2e1be3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:01.864665 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9dc1a-90ce-4ddf-b292-0e34aa5a5e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:01.866904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9dc1a-90ce-4ddf-b292-0e34aa5a5e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:01.867707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9dc1a-90ce-4ddf-b292-0e34aa5a5e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:01.869563 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9dc1a-90ce-4ddf-b292-0e34aa5a5e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:01.871776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9dc1a-90ce-4ddf-b292-0e34aa5a5e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:01.875592 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9dc1a-90ce-4ddf-b292-0e34aa5a5e65 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:01.911103 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 886/1781] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:01.916134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f7997-9d54-4751-b078-0e5c8b3096e7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:01.957655 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f7997-9d54-4751-b078-0e5c8b3096e7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:01.979402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105c1ef-f540-4fea-9e0c-dd41b097849c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:01.981979 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105c1ef-f540-4fea-9e0c-dd41b097849c admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:01.988337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105c1ef-f540-4fea-9e0c-dd41b097849c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:01.989626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105c1ef-f540-4fea-9e0c-dd41b097849c admin admin] PATH_INFO: `/v3/projects/5ca5a4e138d84f3d8eca22ad9affc9dd/users/84d24270c5b348e1b234e8dded243c90/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:01.998400 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105c1ef-f540-4fea-9e0c-dd41b097849c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca5a4e138d84f3d8eca22ad9affc9dd, user_id=84d24270c5b348e1b234e8dded243c90, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:02.006698 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105c1ef-f540-4fea-9e0c-dd41b097849c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:02.055907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 896/1782] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:01 2022] PUT /identity/v3/projects/5ca5a4e138d84f3d8eca22ad9affc9dd/users/84d24270c5b348e1b234e8dded243c90/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:02.070968 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eb337-eb3c-4ee8-8839-44a254491562 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:02.074475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eb337-eb3c-4ee8-8839-44a254491562 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:02.075050 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eb337-eb3c-4ee8-8839-44a254491562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:02.130287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-564eb337-eb3c-4ee8-8839-44a254491562 None None] MFA Rules not processed for user `84d24270c5b348e1b234e8dded243c90`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:02.131974 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-564eb337-eb3c-4ee8-8839-44a254491562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:02.230810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:02.263932 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 887/1783] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:02.266685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105c1ef-f540-4fea-9e0c-dd41b097849c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:02.275082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8105c1ef-f540-4fea-9e0c-dd41b097849c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:02.398664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105c1ef-f540-4fea-9e0c-dd41b097849c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:02.409384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659ec2b-17f2-4300-9936-5d0ea1bfde9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:02.410124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659ec2b-17f2-4300-9936-5d0ea1bfde9c service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:02.410680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659ec2b-17f2-4300-9936-5d0ea1bfde9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:02.410959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659ec2b-17f2-4300-9936-5d0ea1bfde9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:02.416193 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9659ec2b-17f2-4300-9936-5d0ea1bfde9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:02.585197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659ec2b-17f2-4300-9936-5d0ea1bfde9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:02.586792 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659ec2b-17f2-4300-9936-5d0ea1bfde9c service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:02.603254 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 897/1784] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:02.689252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eb337-eb3c-4ee8-8839-44a254491562 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:02.691657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-564eb337-eb3c-4ee8-8839-44a254491562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:02.888913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eb337-eb3c-4ee8-8839-44a254491562 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:02.901479 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfdf88-5d90-44da-a0a4-0dd9b08456c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:02.903029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfdf88-5d90-44da-a0a4-0dd9b08456c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:02.903494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfdf88-5d90-44da-a0a4-0dd9b08456c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:02.903938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfdf88-5d90-44da-a0a4-0dd9b08456c9 admin admin] PATH_INFO: `/v3/projects/aeed42454f7544f5aa2a4bdc1d3f7082` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:02.905922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfdf88-5d90-44da-a0a4-0dd9b08456c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeed42454f7544f5aa2a4bdc1d3f7082)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:02.908087 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfdf88-5d90-44da-a0a4-0dd9b08456c9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:03.060567 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-12dfdf88-5d90-44da-a0a4-0dd9b08456c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeed42454f7544f5aa2a4bdc1d3f7082', 'request_id': 'req-12dfdf88-5d90-44da-a0a4-0dd9b08456c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:03.081898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-12dfdf88-5d90-44da-a0a4-0dd9b08456c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeed42454f7544f5aa2a4bdc1d3f7082', 'request_id': 'req-12dfdf88-5d90-44da-a0a4-0dd9b08456c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:03.098612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-12dfdf88-5d90-44da-a0a4-0dd9b08456c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeed42454f7544f5aa2a4bdc1d3f7082', 'request_id': 'req-12dfdf88-5d90-44da-a0a4-0dd9b08456c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:03.140284 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-12dfdf88-5d90-44da-a0a4-0dd9b08456c9 admin admin] The token cache is being invalidate because project aeed42454f7544f5aa2a4bdc1d3f7082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:03.140827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-12dfdf88-5d90-44da-a0a4-0dd9b08456c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:03.141916 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-12dfdf88-5d90-44da-a0a4-0dd9b08456c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:03.151358 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 888/1785] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:02 2022] DELETE /identity/v3/projects/aeed42454f7544f5aa2a4bdc1d3f7082 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:03.157108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd615a9e-f0bb-4ca1-9d2d-e44e984d7595 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:03.157654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd615a9e-f0bb-4ca1-9d2d-e44e984d7595 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:03.157654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd615a9e-f0bb-4ca1-9d2d-e44e984d7595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:03.195198 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-bd615a9e-f0bb-4ca1-9d2d-e44e984d7595 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:03.197607 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bd615a9e-f0bb-4ca1-9d2d-e44e984d7595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:03.294806 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:03.510677 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 898/1786] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:03.519930 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f63ba6-437f-454d-a3ce-02a77fa73906 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:03.521975 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f63ba6-437f-454d-a3ce-02a77fa73906 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:03.522432 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f63ba6-437f-454d-a3ce-02a77fa73906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:03.565508 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-06f63ba6-437f-454d-a3ce-02a77fa73906 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:03.569062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-06f63ba6-437f-454d-a3ce-02a77fa73906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:03.585242 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 889/1787] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:03.589677 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd615a9e-f0bb-4ca1-9d2d-e44e984d7595 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:03.613263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd615a9e-f0bb-4ca1-9d2d-e44e984d7595 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:03.626471 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee4634-4007-46e1-9ff9-0850425622b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:03.627179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee4634-4007-46e1-9ff9-0850425622b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:03.627464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee4634-4007-46e1-9ff9-0850425622b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:03.627738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee4634-4007-46e1-9ff9-0850425622b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:03.628533 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee4634-4007-46e1-9ff9-0850425622b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:03.628895 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee4634-4007-46e1-9ff9-0850425622b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:03.631215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee4634-4007-46e1-9ff9-0850425622b6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:03.686456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 899/1788] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:03.690604 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f63ba6-437f-454d-a3ce-02a77fa73906 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:03.704344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f63ba6-437f-454d-a3ce-02a77fa73906 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:03.723973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c26e33-f1b7-4f27-9108-328ff8443e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:03.725050 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c26e33-f1b7-4f27-9108-328ff8443e74 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:03.725526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c26e33-f1b7-4f27-9108-328ff8443e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:03.726045 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c26e33-f1b7-4f27-9108-328ff8443e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:03.727061 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c26e33-f1b7-4f27-9108-328ff8443e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:03.729524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c26e33-f1b7-4f27-9108-328ff8443e74 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:03.777632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 890/1789] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:03 2022] POST /identity/v3/projects => generated 355 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:09:03.781931 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee4634-4007-46e1-9ff9-0850425622b6 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:03.796113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee4634-4007-46e1-9ff9-0850425622b6 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:03.916299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe579e-94f1-4107-afd7-5f76b7311202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:03.918337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe579e-94f1-4107-afd7-5f76b7311202 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:03.918820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe579e-94f1-4107-afd7-5f76b7311202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:03.919207 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe579e-94f1-4107-afd7-5f76b7311202 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:03.920819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe579e-94f1-4107-afd7-5f76b7311202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:03.932518 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe579e-94f1-4107-afd7-5f76b7311202 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:04.007302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 900/1790] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:03 2022] POST /identity/v3/users => generated 278 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:04.011970 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c26e33-f1b7-4f27-9108-328ff8443e74 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:04.030360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c26e33-f1b7-4f27-9108-328ff8443e74 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:04.048486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dc4ce-7ffb-4c34-bcac-8e7b70344d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:04.049349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dc4ce-7ffb-4c34-bcac-8e7b70344d4a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:04.049639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dc4ce-7ffb-4c34-bcac-8e7b70344d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:04.049953 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dc4ce-7ffb-4c34-bcac-8e7b70344d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:04.050832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dc4ce-7ffb-4c34-bcac-8e7b70344d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:04.052916 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dc4ce-7ffb-4c34-bcac-8e7b70344d4a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:04.074895 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 891/1791] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:04.078900 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe579e-94f1-4107-afd7-5f76b7311202 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:04.093395 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe579e-94f1-4107-afd7-5f76b7311202 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:04.109247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35345777-0289-48fd-9b86-c32555d37577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:04.110339 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35345777-0289-48fd-9b86-c32555d37577 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:04.110869 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35345777-0289-48fd-9b86-c32555d37577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:04.111672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35345777-0289-48fd-9b86-c32555d37577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:04.116107 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35345777-0289-48fd-9b86-c32555d37577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:04.118980 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35345777-0289-48fd-9b86-c32555d37577 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:04.148274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 901/1792] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:09:04.152852 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dc4ce-7ffb-4c34-bcac-8e7b70344d4a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:04.173501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dc4ce-7ffb-4c34-bcac-8e7b70344d4a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:04.189415 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5c028-d85c-4f34-8dcc-0988251a284c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:04.190781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c028-d85c-4f34-8dcc-0988251a284c admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:04.191965 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c028-d85c-4f34-8dcc-0988251a284c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:04.192619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c028-d85c-4f34-8dcc-0988251a284c admin admin] PATH_INFO: `/v3/projects/d40d49aef7a24f1a8cada034dd4b9269/users/48bba2babf784fc49e67ec41f3c1b5d8/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:04.218451 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5c028-d85c-4f34-8dcc-0988251a284c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40d49aef7a24f1a8cada034dd4b9269, user_id=48bba2babf784fc49e67ec41f3c1b5d8, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:04.223343 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5c028-d85c-4f34-8dcc-0988251a284c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:04.258629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 892/1793] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:04 2022] PUT /identity/v3/projects/d40d49aef7a24f1a8cada034dd4b9269/users/48bba2babf784fc49e67ec41f3c1b5d8/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:04.269838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed62b18-cafd-48c9-bb06-e2b16ce77a0d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:04.270272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed62b18-cafd-48c9-bb06-e2b16ce77a0d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:04.270436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed62b18-cafd-48c9-bb06-e2b16ce77a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:04.332872 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-fed62b18-cafd-48c9-bb06-e2b16ce77a0d None None] MFA Rules not processed for user `48bba2babf784fc49e67ec41f3c1b5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:04.336837 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fed62b18-cafd-48c9-bb06-e2b16ce77a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:04.485228 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 902/1794] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:04 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:04.487226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5c028-d85c-4f34-8dcc-0988251a284c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:04.584466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:04.718314 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5c028-d85c-4f34-8dcc-0988251a284c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:04.733587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b8811-65d3-48ed-b4cd-cef1cd472dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:04.736105 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b8811-65d3-48ed-b4cd-cef1cd472dbd admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:04.736660 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b8811-65d3-48ed-b4cd-cef1cd472dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:04.740468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b8811-65d3-48ed-b4cd-cef1cd472dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:04.742180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b8811-65d3-48ed-b4cd-cef1cd472dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:04.747097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b8811-65d3-48ed-b4cd-cef1cd472dbd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:04.848786 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 893/1795] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:04 2022] POST /identity/v3/projects => generated 357 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:04.852716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed62b18-cafd-48c9-bb06-e2b16ce77a0d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:04.895078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed62b18-cafd-48c9-bb06-e2b16ce77a0d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:05.031360 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:05.134582 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b8811-65d3-48ed-b4cd-cef1cd472dbd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:05.137724 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-154b8811-65d3-48ed-b4cd-cef1cd472dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:05.142628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471e30b-7d4c-4797-8002-c0f0733cf5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:05.143346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471e30b-7d4c-4797-8002-c0f0733cf5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:05.146018 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471e30b-7d4c-4797-8002-c0f0733cf5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:05.146450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471e30b-7d4c-4797-8002-c0f0733cf5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:05.147445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471e30b-7d4c-4797-8002-c0f0733cf5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:05.149530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471e30b-7d4c-4797-8002-c0f0733cf5e8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:05.178466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b8811-65d3-48ed-b4cd-cef1cd472dbd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:05.189540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19843fa1-4088-4283-9ef1-7fe18a859a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:05.194645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19843fa1-4088-4283-9ef1-7fe18a859a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:05.194928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19843fa1-4088-4283-9ef1-7fe18a859a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:05.198154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19843fa1-4088-4283-9ef1-7fe18a859a77 admin admin] PATH_INFO: `/v3/users/0fecd77bd12347658c5a06c279183520` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:05.206571 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19843fa1-4088-4283-9ef1-7fe18a859a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fecd77bd12347658c5a06c279183520)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:05.209886 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19843fa1-4088-4283-9ef1-7fe18a859a77 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:05.230238 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 903/1796] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:04 2022] POST /identity/v3/users => generated 285 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:05.234538 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471e30b-7d4c-4797-8002-c0f0733cf5e8 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:05.249551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471e30b-7d4c-4797-8002-c0f0733cf5e8 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:05.255483 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0063bec-153f-465f-a3f7-ddc188b3292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:05.256297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0063bec-153f-465f-a3f7-ddc188b3292d admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:05.256584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0063bec-153f-465f-a3f7-ddc188b3292d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:05.256909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0063bec-153f-465f-a3f7-ddc188b3292d admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:05.258300 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0063bec-153f-465f-a3f7-ddc188b3292d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:05.279237 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0063bec-153f-465f-a3f7-ddc188b3292d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:05.300535 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 904/1797] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:09:05.306628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0063bec-153f-465f-a3f7-ddc188b3292d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:05.326588 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0063bec-153f-465f-a3f7-ddc188b3292d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:05.335479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab465a43-a3f3-4495-ad8b-5709c1d0b1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:05.335726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab465a43-a3f3-4495-ad8b-5709c1d0b1df admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:05.335891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab465a43-a3f3-4495-ad8b-5709c1d0b1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:05.336210 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab465a43-a3f3-4495-ad8b-5709c1d0b1df admin admin] PATH_INFO: `/v3/projects/a552f0b15bf448af82d4e4d1544e46b3/users/73e0629ca66e462fbc505cd08bfa9ecf/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:05.366513 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab465a43-a3f3-4495-ad8b-5709c1d0b1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a552f0b15bf448af82d4e4d1544e46b3, user_id=73e0629ca66e462fbc505cd08bfa9ecf, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:05.368719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-19843fa1-4088-4283-9ef1-7fe18a859a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fecd77bd12347658c5a06c279183520'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:05.369583 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-19843fa1-4088-4283-9ef1-7fe18a859a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fecd77bd12347658c5a06c279183520'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:05.370878 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab465a43-a3f3-4495-ad8b-5709c1d0b1df admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:05.388579 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-19843fa1-4088-4283-9ef1-7fe18a859a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fecd77bd12347658c5a06c279183520'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:05.401639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 905/1798] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:05 2022] PUT /identity/v3/projects/a552f0b15bf448af82d4e4d1544e46b3/users/73e0629ca66e462fbc505cd08bfa9ecf/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:05.416973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab465a43-a3f3-4495-ad8b-5709c1d0b1df admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:05.435692 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-19843fa1-4088-4283-9ef1-7fe18a859a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fecd77bd12347658c5a06c279183520'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:05.454414 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-19843fa1-4088-4283-9ef1-7fe18a859a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fecd77bd12347658c5a06c279183520'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:05.470003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 894/1799] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:05 2022] DELETE /identity/v3/users/0fecd77bd12347658c5a06c279183520 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:05.476586 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3bb78-b128-4f72-bc12-a5e919145ec5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:05.476917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3bb78-b128-4f72-bc12-a5e919145ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:05.477138 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3bb78-b128-4f72-bc12-a5e919145ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:05.542544 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-79a3bb78-b128-4f72-bc12-a5e919145ec5 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:05.548887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-79a3bb78-b128-4f72-bc12-a5e919145ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:05.569217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab465a43-a3f3-4495-ad8b-5709c1d0b1df admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:05.660852 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 895/1800] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:05.675440 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89e358-d963-413e-8f5f-5bcbffe0742f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:05.676168 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89e358-d963-413e-8f5f-5bcbffe0742f admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:05.677007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89e358-d963-413e-8f5f-5bcbffe0742f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:05.677007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89e358-d963-413e-8f5f-5bcbffe0742f admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:05.677443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89e358-d963-413e-8f5f-5bcbffe0742f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:05.679405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89e358-d963-413e-8f5f-5bcbffe0742f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:05.693288 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 906/1801] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:05.699170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3bb78-b128-4f72-bc12-a5e919145ec5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:05.699660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89e358-d963-413e-8f5f-5bcbffe0742f admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:05.701369 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-79a3bb78-b128-4f72-bc12-a5e919145ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:05.701949 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8b89e358-d963-413e-8f5f-5bcbffe0742f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:05.718675 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3bb78-b128-4f72-bc12-a5e919145ec5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:05.727509 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9b828-1c09-4287-aa0c-53900f8a2876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:05.729099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9b828-1c09-4287-aa0c-53900f8a2876 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:05.730018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9b828-1c09-4287-aa0c-53900f8a2876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:05.730789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9b828-1c09-4287-aa0c-53900f8a2876 admin admin] PATH_INFO: `/v3/projects/a552f0b15bf448af82d4e4d1544e46b3/users/73e0629ca66e462fbc505cd08bfa9ecf/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:05.735848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9b828-1c09-4287-aa0c-53900f8a2876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a552f0b15bf448af82d4e4d1544e46b3, user_id=73e0629ca66e462fbc505cd08bfa9ecf, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:05.739893 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9b828-1c09-4287-aa0c-53900f8a2876 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:05.781633 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 896/1802] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:05 2022] PUT /identity/v3/projects/a552f0b15bf448af82d4e4d1544e46b3/users/73e0629ca66e462fbc505cd08bfa9ecf/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:05.793552 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cb64f-7084-421b-ac9b-1e8217b33539 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:05.793957 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cb64f-7084-421b-ac9b-1e8217b33539 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:05.794397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cb64f-7084-421b-ac9b-1e8217b33539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:05.818801 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:05.843912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bc0cb64f-7084-421b-ac9b-1e8217b33539 None None] MFA Rules not processed for user `73e0629ca66e462fbc505cd08bfa9ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:05.847262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bc0cb64f-7084-421b-ac9b-1e8217b33539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:05.892142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:05.954604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89e358-d963-413e-8f5f-5bcbffe0742f admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:05.968290 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 897/1803] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:05.975828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cb64f-7084-421b-ac9b-1e8217b33539 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:05.978011 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bc0cb64f-7084-421b-ac9b-1e8217b33539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:06.081918 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc80624-dade-49ae-8385-106953b52e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:06.082593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc80624-dade-49ae-8385-106953b52e0a service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:06.082876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc80624-dade-49ae-8385-106953b52e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:06.083149 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc80624-dade-49ae-8385-106953b52e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:06.194933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cb64f-7084-421b-ac9b-1e8217b33539 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:06.205991 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60030a2-8600-48c0-9fe2-1c98dab6cb62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:06.208044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60030a2-8600-48c0-9fe2-1c98dab6cb62 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:06.208556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60030a2-8600-48c0-9fe2-1c98dab6cb62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:06.209592 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60030a2-8600-48c0-9fe2-1c98dab6cb62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:06.225684 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc80624-dade-49ae-8385-106953b52e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:06.232299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc80624-dade-49ae-8385-106953b52e0a service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:06.238222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60030a2-8600-48c0-9fe2-1c98dab6cb62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:06.242218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60030a2-8600-48c0-9fe2-1c98dab6cb62 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:06.263700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 898/1804] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:05 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:06.264656 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 907/1805] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:06.318703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60030a2-8600-48c0-9fe2-1c98dab6cb62 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:06.332461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60030a2-8600-48c0-9fe2-1c98dab6cb62 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:06.341533 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690a6df-41cf-4cec-b3a7-b16edc59a893 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:06.342890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690a6df-41cf-4cec-b3a7-b16edc59a893 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:06.343354 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690a6df-41cf-4cec-b3a7-b16edc59a893 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:06.343792 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690a6df-41cf-4cec-b3a7-b16edc59a893 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:06.346469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7690a6df-41cf-4cec-b3a7-b16edc59a893 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:06.458319 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690a6df-41cf-4cec-b3a7-b16edc59a893 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:06.461449 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690a6df-41cf-4cec-b3a7-b16edc59a893 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:06.478879 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 899/1806] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:06.525611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc80624-dade-49ae-8385-106953b52e0a service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:06.528038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3fc80624-dade-49ae-8385-106953b52e0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:06.551472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc80624-dade-49ae-8385-106953b52e0a service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:06.564234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f00d8-ca76-4b5f-b741-033498c42a6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:06.566503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f00d8-ca76-4b5f-b741-033498c42a6f service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:06.566830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f00d8-ca76-4b5f-b741-033498c42a6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:06.567674 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f00d8-ca76-4b5f-b741-033498c42a6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:06.571461 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f80f00d8-ca76-4b5f-b741-033498c42a6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:06.693828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f00d8-ca76-4b5f-b741-033498c42a6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:06.696141 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f00d8-ca76-4b5f-b741-033498c42a6f service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:06.712626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 908/1807] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:06 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:07.173491 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690a6df-41cf-4cec-b3a7-b16edc59a893 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:07.176051 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7690a6df-41cf-4cec-b3a7-b16edc59a893 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:07.215925 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690a6df-41cf-4cec-b3a7-b16edc59a893 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:07.230852 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb41ad-11f3-48e7-9897-cbe9b5186d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:07.231567 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb41ad-11f3-48e7-9897-cbe9b5186d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:07.231849 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb41ad-11f3-48e7-9897-cbe9b5186d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:07.232258 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb41ad-11f3-48e7-9897-cbe9b5186d37 admin admin] PATH_INFO: `/v3/projects/dc0cc49afd9248cfbde7b3bfbd0cf44e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:07.237726 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb41ad-11f3-48e7-9897-cbe9b5186d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc0cc49afd9248cfbde7b3bfbd0cf44e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:07.243534 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb41ad-11f3-48e7-9897-cbe9b5186d37 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:07.356028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:07.398255 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2efb41ad-11f3-48e7-9897-cbe9b5186d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc0cc49afd9248cfbde7b3bfbd0cf44e', 'request_id': 'req-2efb41ad-11f3-48e7-9897-cbe9b5186d37'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:07.415199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2efb41ad-11f3-48e7-9897-cbe9b5186d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc0cc49afd9248cfbde7b3bfbd0cf44e', 'request_id': 'req-2efb41ad-11f3-48e7-9897-cbe9b5186d37'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:07.427997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2efb41ad-11f3-48e7-9897-cbe9b5186d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc0cc49afd9248cfbde7b3bfbd0cf44e', 'request_id': 'req-2efb41ad-11f3-48e7-9897-cbe9b5186d37'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:07.453531 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2efb41ad-11f3-48e7-9897-cbe9b5186d37 admin admin] The token cache is being invalidate because project dc0cc49afd9248cfbde7b3bfbd0cf44e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:07.455424 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2efb41ad-11f3-48e7-9897-cbe9b5186d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:07.457337 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2efb41ad-11f3-48e7-9897-cbe9b5186d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:07.460905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 900/1808] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:07 2022] DELETE /identity/v3/projects/dc0cc49afd9248cfbde7b3bfbd0cf44e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:07.466337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f396e-e39b-4c9a-8112-24e8463a7239 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:07.467091 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f396e-e39b-4c9a-8112-24e8463a7239 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:07.467603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f396e-e39b-4c9a-8112-24e8463a7239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:07.507002 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-554f396e-e39b-4c9a-8112-24e8463a7239 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:07.525907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-554f396e-e39b-4c9a-8112-24e8463a7239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:07.599242 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:07.641922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 909/1809] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:07.650068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15fff4-b3af-4fe9-83b6-47276b546878 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:07.650287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15fff4-b3af-4fe9-83b6-47276b546878 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:07.650877 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15fff4-b3af-4fe9-83b6-47276b546878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:07.687052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-dc15fff4-b3af-4fe9-83b6-47276b546878 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:07.689580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dc15fff4-b3af-4fe9-83b6-47276b546878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:07.702243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 901/1810] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:07.707235 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f396e-e39b-4c9a-8112-24e8463a7239 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:07.722377 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f396e-e39b-4c9a-8112-24e8463a7239 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:07.728179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3694512-d32f-4c50-b37a-ca577319de83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:07.729464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694512-d32f-4c50-b37a-ca577319de83 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:07.730096 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694512-d32f-4c50-b37a-ca577319de83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:07.730469 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694512-d32f-4c50-b37a-ca577319de83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:07.731328 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3694512-d32f-4c50-b37a-ca577319de83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:07.731703 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3694512-d32f-4c50-b37a-ca577319de83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:07.733624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3694512-d32f-4c50-b37a-ca577319de83 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:07.749838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 910/1811] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:07.752688 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15fff4-b3af-4fe9-83b6-47276b546878 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:07.763528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15fff4-b3af-4fe9-83b6-47276b546878 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:07.769433 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719cb9c-bbe2-495f-a149-7ded4b645a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:07.770256 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719cb9c-bbe2-495f-a149-7ded4b645a36 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:07.770606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719cb9c-bbe2-495f-a149-7ded4b645a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:07.770952 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719cb9c-bbe2-495f-a149-7ded4b645a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:07.774247 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719cb9c-bbe2-495f-a149-7ded4b645a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:07.776641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719cb9c-bbe2-495f-a149-7ded4b645a36 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:07.811953 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 902/1812] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:07 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:07.813156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3694512-d32f-4c50-b37a-ca577319de83 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:07.826771 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3694512-d32f-4c50-b37a-ca577319de83 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:07.910679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e9eda-8750-4e76-8ab0-9387d8a767a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:07.911292 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9eda-8750-4e76-8ab0-9387d8a767a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:07.911604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9eda-8750-4e76-8ab0-9387d8a767a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:07.911844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9eda-8750-4e76-8ab0-9387d8a767a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:07.912599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e9eda-8750-4e76-8ab0-9387d8a767a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:07.916427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e9eda-8750-4e76-8ab0-9387d8a767a0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:07.949698 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 911/1813] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:07 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:09:07.956485 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719cb9c-bbe2-495f-a149-7ded4b645a36 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:07.981688 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719cb9c-bbe2-495f-a149-7ded4b645a36 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:07.997385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924e0b0-978d-4eeb-83c3-beb1d0676090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:07.999147 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e0b0-978d-4eeb-83c3-beb1d0676090 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:08.001368 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e0b0-978d-4eeb-83c3-beb1d0676090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:08.002445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e0b0-978d-4eeb-83c3-beb1d0676090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:08.003368 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924e0b0-978d-4eeb-83c3-beb1d0676090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:08.005742 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924e0b0-978d-4eeb-83c3-beb1d0676090 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:08.025894 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 903/1814] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:08.034445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e9eda-8750-4e76-8ab0-9387d8a767a0 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:08.051743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e9eda-8750-4e76-8ab0-9387d8a767a0 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:08.057258 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34675d81-a525-4428-9ac0-19ee9e5d6ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:08.058134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34675d81-a525-4428-9ac0-19ee9e5d6ddb admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:08.058842 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34675d81-a525-4428-9ac0-19ee9e5d6ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:08.059182 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34675d81-a525-4428-9ac0-19ee9e5d6ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:08.061015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34675d81-a525-4428-9ac0-19ee9e5d6ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:08.063192 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34675d81-a525-4428-9ac0-19ee9e5d6ddb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:08.086048 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 912/1815] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:08.088840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924e0b0-978d-4eeb-83c3-beb1d0676090 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:08.106426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924e0b0-978d-4eeb-83c3-beb1d0676090 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:08.112078 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae97b13-b8d0-4404-bc86-4d333ef4f83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:08.113110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae97b13-b8d0-4404-bc86-4d333ef4f83e admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:08.113397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae97b13-b8d0-4404-bc86-4d333ef4f83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:08.113672 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae97b13-b8d0-4404-bc86-4d333ef4f83e admin admin] PATH_INFO: `/v3/projects/80875e22cb2146c48797c0b7b13d41f9/users/f970e17a99474dd4ba415edff837c94e/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:08.141384 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae97b13-b8d0-4404-bc86-4d333ef4f83e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80875e22cb2146c48797c0b7b13d41f9, user_id=f970e17a99474dd4ba415edff837c94e, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:08.145886 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae97b13-b8d0-4404-bc86-4d333ef4f83e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:08.180120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 904/1816] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:08 2022] PUT /identity/v3/projects/80875e22cb2146c48797c0b7b13d41f9/users/f970e17a99474dd4ba415edff837c94e/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:08.182558 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe932b8-8f90-4e89-9b84-5ddf16badf76 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:08.182876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe932b8-8f90-4e89-9b84-5ddf16badf76 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:08.183657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe932b8-8f90-4e89-9b84-5ddf16badf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:08.255603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-5fe932b8-8f90-4e89-9b84-5ddf16badf76 None None] MFA Rules not processed for user `f970e17a99474dd4ba415edff837c94e`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:08.258080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5fe932b8-8f90-4e89-9b84-5ddf16badf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:08.345366 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27bf21-b034-47f1-9baa-a95fea8638d0 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:08.345640 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27bf21-b034-47f1-9baa-a95fea8638d0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:08.346267 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27bf21-b034-47f1-9baa-a95fea8638d0 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:08.348118 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 905/1817] 10.222.0.61 () {54 vars in 921 bytes} [Thu May 26 21:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:09:08.394629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ffb85-01ca-4b31-91af-6630d24deacc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:08.394979 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ffb85-01ca-4b31-91af-6630d24deacc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:08.396237 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ffb85-01ca-4b31-91af-6630d24deacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:08.437635 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-362ffb85-01ca-4b31-91af-6630d24deacc None None] MFA Rules not processed for user `a99b767501244338bc48fb5428a589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:08.441912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-362ffb85-01ca-4b31-91af-6630d24deacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:08.473446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 913/1818] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:08.609153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 906/1819] 10.222.0.61 () {58 vars in 1018 bytes} [Thu May 26 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:08.683330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d261af7-bbd8-4dcc-9bc0-e09896dc0a1f None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:08.683932 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d261af7-bbd8-4dcc-9bc0-e09896dc0a1f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:08.683932 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d261af7-bbd8-4dcc-9bc0-e09896dc0a1f None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:08.685309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 914/1820] 10.222.0.61 () {54 vars in 921 bytes} [Thu May 26 21:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:09:08.713663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce6485-0617-4126-b4b1-9acff03d64bb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:08.714054 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce6485-0617-4126-b4b1-9acff03d64bb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:08.714341 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce6485-0617-4126-b4b1-9acff03d64bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:08.755211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1dce6485-0617-4126-b4b1-9acff03d64bb None None] MFA Rules not processed for user `a99b767501244338bc48fb5428a589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:08.763019 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1dce6485-0617-4126-b4b1-9acff03d64bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:08.786909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d261af7-bbd8-4dcc-9bc0-e09896dc0a1f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:08.790476 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7d261af7-bbd8-4dcc-9bc0-e09896dc0a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:08.801512 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 907/1821] 10.222.0.61 () {58 vars in 1018 bytes} [Thu May 26 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:08.827012 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d261af7-bbd8-4dcc-9bc0-e09896dc0a1f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:08.839043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee7e4b-7f76-4efd-a9a6-f714eefd11d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:08.839744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee7e4b-7f76-4efd-a9a6-f714eefd11d5 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:08.840033 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee7e4b-7f76-4efd-a9a6-f714eefd11d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:08.840314 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee7e4b-7f76-4efd-a9a6-f714eefd11d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:08.859621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee7e4b-7f76-4efd-a9a6-f714eefd11d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:08.861339 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee7e4b-7f76-4efd-a9a6-f714eefd11d5 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:08.888003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 915/1822] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:09:08.946644 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce6485-0617-4126-b4b1-9acff03d64bb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:08.965000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce6485-0617-4126-b4b1-9acff03d64bb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:08.990588 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52f40c-72ea-4b21-a1a3-62f779b2daac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:08.991269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52f40c-72ea-4b21-a1a3-62f779b2daac service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:08.991815 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52f40c-72ea-4b21-a1a3-62f779b2daac service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:08.992813 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52f40c-72ea-4b21-a1a3-62f779b2daac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:09.005725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52f40c-72ea-4b21-a1a3-62f779b2daac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:09.008357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52f40c-72ea-4b21-a1a3-62f779b2daac service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:09.024044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 908/1823] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:09.082655 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee7e4b-7f76-4efd-a9a6-f714eefd11d5 service nova] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:09.098191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee7e4b-7f76-4efd-a9a6-f714eefd11d5 service nova] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:09.106922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e86c0b-1d54-4436-a03e-f89f32820fe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:09.108410 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e86c0b-1d54-4436-a03e-f89f32820fe4 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:09.110892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e86c0b-1d54-4436-a03e-f89f32820fe4 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:09.111233 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e86c0b-1d54-4436-a03e-f89f32820fe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:09.124833 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e86c0b-1d54-4436-a03e-f89f32820fe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:09.127935 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e86c0b-1d54-4436-a03e-f89f32820fe4 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:09.159712 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 916/1824] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:09.941953 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52f40c-72ea-4b21-a1a3-62f779b2daac service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:10.001932 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:10.148055 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52f40c-72ea-4b21-a1a3-62f779b2daac service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:10.160207 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e18068-7981-4ef7-982c-4f26773cb22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:10.161233 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e18068-7981-4ef7-982c-4f26773cb22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:10.161590 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e18068-7981-4ef7-982c-4f26773cb22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:10.162319 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e18068-7981-4ef7-982c-4f26773cb22a admin admin] PATH_INFO: `/v3/users/f970e17a99474dd4ba415edff837c94e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:10.165938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e18068-7981-4ef7-982c-4f26773cb22a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f970e17a99474dd4ba415edff837c94e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:10.168218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e18068-7981-4ef7-982c-4f26773cb22a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:10.295427 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b1e18068-7981-4ef7-982c-4f26773cb22a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f970e17a99474dd4ba415edff837c94e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:10.296141 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b1e18068-7981-4ef7-982c-4f26773cb22a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f970e17a99474dd4ba415edff837c94e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:10.314363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b1e18068-7981-4ef7-982c-4f26773cb22a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f970e17a99474dd4ba415edff837c94e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:10.338357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b1e18068-7981-4ef7-982c-4f26773cb22a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f970e17a99474dd4ba415edff837c94e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:10.349634 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b1e18068-7981-4ef7-982c-4f26773cb22a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f970e17a99474dd4ba415edff837c94e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:10.362323 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 909/1825] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:09 2022] DELETE /identity/v3/users/f970e17a99474dd4ba415edff837c94e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:10.366871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9daa-75e8-421d-89e1-d48736cc1712 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:10.367663 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9daa-75e8-421d-89e1-d48736cc1712 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:10.368549 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9daa-75e8-421d-89e1-d48736cc1712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:10.402713 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-57bd9daa-75e8-421d-89e1-d48736cc1712 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:10.406184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-57bd9daa-75e8-421d-89e1-d48736cc1712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:10.423865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:10.515295 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 917/1826] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:10.525403 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e18068-7981-4ef7-982c-4f26773cb22a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:10.527475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b1e18068-7981-4ef7-982c-4f26773cb22a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:10.589887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e18068-7981-4ef7-982c-4f26773cb22a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:10.594061 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d59eea-8789-438e-9610-4b068736ce1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:10.594747 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d59eea-8789-438e-9610-4b068736ce1b service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:10.595029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d59eea-8789-438e-9610-4b068736ce1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:10.595359 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d59eea-8789-438e-9610-4b068736ce1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:10.607547 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d59eea-8789-438e-9610-4b068736ce1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:10.608999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d59eea-8789-438e-9610-4b068736ce1b service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:10.619249 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 910/1827] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:10.922626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9daa-75e8-421d-89e1-d48736cc1712 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:10.926528 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-57bd9daa-75e8-421d-89e1-d48736cc1712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:10.942652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9daa-75e8-421d-89e1-d48736cc1712 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:10.950474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366f2b0-2750-4436-9af8-79d61f1a09ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:10.951818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366f2b0-2750-4436-9af8-79d61f1a09ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:10.952284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366f2b0-2750-4436-9af8-79d61f1a09ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:10.952710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366f2b0-2750-4436-9af8-79d61f1a09ba admin admin] PATH_INFO: `/v3/projects/80875e22cb2146c48797c0b7b13d41f9` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:10.954371 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366f2b0-2750-4436-9af8-79d61f1a09ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=80875e22cb2146c48797c0b7b13d41f9)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:10.956990 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366f2b0-2750-4436-9af8-79d61f1a09ba admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:11.034194 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9366f2b0-2750-4436-9af8-79d61f1a09ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80875e22cb2146c48797c0b7b13d41f9', 'request_id': 'req-9366f2b0-2750-4436-9af8-79d61f1a09ba'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:11.042012 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9366f2b0-2750-4436-9af8-79d61f1a09ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80875e22cb2146c48797c0b7b13d41f9', 'request_id': 'req-9366f2b0-2750-4436-9af8-79d61f1a09ba'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:11.049270 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9366f2b0-2750-4436-9af8-79d61f1a09ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80875e22cb2146c48797c0b7b13d41f9', 'request_id': 'req-9366f2b0-2750-4436-9af8-79d61f1a09ba'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:11.064721 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9366f2b0-2750-4436-9af8-79d61f1a09ba admin admin] The token cache is being invalidate because project 80875e22cb2146c48797c0b7b13d41f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:11.065013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9366f2b0-2750-4436-9af8-79d61f1a09ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:11.065664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9366f2b0-2750-4436-9af8-79d61f1a09ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:11.067547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 918/1828] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:10 2022] DELETE /identity/v3/projects/80875e22cb2146c48797c0b7b13d41f9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:11.072810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d086d8-2907-490b-8fec-a77faa665ec6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:11.073449 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d086d8-2907-490b-8fec-a77faa665ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:11.073449 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d086d8-2907-490b-8fec-a77faa665ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:11.103269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-95d086d8-2907-490b-8fec-a77faa665ec6 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:11.103269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-95d086d8-2907-490b-8fec-a77faa665ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:11.147302 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:11.173340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 911/1829] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:11.181299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f5a8b-2129-4646-8d08-5a8717bbada4 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:11.181906 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f5a8b-2129-4646-8d08-5a8717bbada4 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:11.182337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f5a8b-2129-4646-8d08-5a8717bbada4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:11.202712 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ff6f5a8b-2129-4646-8d08-5a8717bbada4 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:11.204173 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ff6f5a8b-2129-4646-8d08-5a8717bbada4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:11.215467 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 919/1830] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:11.219584 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d086d8-2907-490b-8fec-a77faa665ec6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:11.230052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d086d8-2907-490b-8fec-a77faa665ec6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:11.235568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330114cb-dd59-4656-8b91-4016e595882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:11.236153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330114cb-dd59-4656-8b91-4016e595882e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:11.236579 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330114cb-dd59-4656-8b91-4016e595882e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:11.237080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330114cb-dd59-4656-8b91-4016e595882e admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:11.237887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330114cb-dd59-4656-8b91-4016e595882e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:11.238156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330114cb-dd59-4656-8b91-4016e595882e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:11.241372 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330114cb-dd59-4656-8b91-4016e595882e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:11.268071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 912/1831] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:11.272700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f5a8b-2129-4646-8d08-5a8717bbada4 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:11.284803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f5a8b-2129-4646-8d08-5a8717bbada4 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:11.290373 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358bea3-4aad-40f0-9ab5-b0b611af5fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:11.291342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358bea3-4aad-40f0-9ab5-b0b611af5fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:11.291765 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358bea3-4aad-40f0-9ab5-b0b611af5fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:11.292109 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358bea3-4aad-40f0-9ab5-b0b611af5fe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:11.292891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358bea3-4aad-40f0-9ab5-b0b611af5fe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:11.294962 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358bea3-4aad-40f0-9ab5-b0b611af5fe9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:11.330200 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 920/1832] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:11 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:11.331422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330114cb-dd59-4656-8b91-4016e595882e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:11.342744 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330114cb-dd59-4656-8b91-4016e595882e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:11.403883 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038fa64-8000-4a9b-8ac6-74b49c68dcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:11.404578 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038fa64-8000-4a9b-8ac6-74b49c68dcaf admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:11.404857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038fa64-8000-4a9b-8ac6-74b49c68dcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:11.405205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038fa64-8000-4a9b-8ac6-74b49c68dcaf admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:11.405819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038fa64-8000-4a9b-8ac6-74b49c68dcaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:11.407764 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038fa64-8000-4a9b-8ac6-74b49c68dcaf admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:11.437494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 913/1833] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:11 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:11.438773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358bea3-4aad-40f0-9ab5-b0b611af5fe9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:11.452392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358bea3-4aad-40f0-9ab5-b0b611af5fe9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:11.463966 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892c878-516e-49dc-8fa6-9639922d999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:11.465510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892c878-516e-49dc-8fa6-9639922d999e admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:11.466530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892c878-516e-49dc-8fa6-9639922d999e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:11.466954 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892c878-516e-49dc-8fa6-9639922d999e admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:11.468798 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892c878-516e-49dc-8fa6-9639922d999e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:11.471349 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892c878-516e-49dc-8fa6-9639922d999e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:11.489542 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 921/1834] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:09:11.495176 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038fa64-8000-4a9b-8ac6-74b49c68dcaf admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:11.518813 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038fa64-8000-4a9b-8ac6-74b49c68dcaf admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:11.524809 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18152eb-456f-4fd5-a0c6-6cdc619a55e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:11.526289 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18152eb-456f-4fd5-a0c6-6cdc619a55e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:11.526583 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18152eb-456f-4fd5-a0c6-6cdc619a55e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:11.526857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18152eb-456f-4fd5-a0c6-6cdc619a55e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:11.527707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18152eb-456f-4fd5-a0c6-6cdc619a55e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:11.529449 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18152eb-456f-4fd5-a0c6-6cdc619a55e5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:11.548499 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 914/1835] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:09:11.553931 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892c878-516e-49dc-8fa6-9639922d999e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:11.573372 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892c878-516e-49dc-8fa6-9639922d999e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:11.578994 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9866a6a-4d32-4f1b-9ccf-6c6e211a21ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:11.580438 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9866a6a-4d32-4f1b-9ccf-6c6e211a21ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:11.581136 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9866a6a-4d32-4f1b-9ccf-6c6e211a21ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:11.581136 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9866a6a-4d32-4f1b-9ccf-6c6e211a21ef admin admin] PATH_INFO: `/v3/projects/ccead3aec2cf4dc6a488236ca81266a7/users/0ab9e06d85284ef4806d4ceca9cb2857/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:11.600022 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9866a6a-4d32-4f1b-9ccf-6c6e211a21ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccead3aec2cf4dc6a488236ca81266a7, user_id=0ab9e06d85284ef4806d4ceca9cb2857, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:11.603181 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9866a6a-4d32-4f1b-9ccf-6c6e211a21ef admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:11.622911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 922/1836] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:11 2022] PUT /identity/v3/projects/ccead3aec2cf4dc6a488236ca81266a7/users/0ab9e06d85284ef4806d4ceca9cb2857/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:11.635676 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e72fa-bbef-4540-8ba4-8d4bb84d2464 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:11.636490 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e72fa-bbef-4540-8ba4-8d4bb84d2464 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:11.636930 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e72fa-bbef-4540-8ba4-8d4bb84d2464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:11.707964 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-193e72fa-bbef-4540-8ba4-8d4bb84d2464 None None] MFA Rules not processed for user `0ab9e06d85284ef4806d4ceca9cb2857`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:11.707964 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-193e72fa-bbef-4540-8ba4-8d4bb84d2464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:11.852817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 915/1837] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:11.859578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9866a6a-4d32-4f1b-9ccf-6c6e211a21ef admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:11.917148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:11.962114 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9866a6a-4d32-4f1b-9ccf-6c6e211a21ef admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:11.967735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe54a8e-2002-4247-811a-c3a332cbc069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:11.968635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe54a8e-2002-4247-811a-c3a332cbc069 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:11.969106 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe54a8e-2002-4247-811a-c3a332cbc069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:11.969579 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe54a8e-2002-4247-811a-c3a332cbc069 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:11.970534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe54a8e-2002-4247-811a-c3a332cbc069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:11.972674 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe54a8e-2002-4247-811a-c3a332cbc069 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:12.013166 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 923/1838] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:11 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:12.017551 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e72fa-bbef-4540-8ba4-8d4bb84d2464 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:12.034955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e72fa-bbef-4540-8ba4-8d4bb84d2464 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:12.099971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:12.133928 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bebe9-1953-4dbd-8a9a-81af60aa3394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:12.134641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bebe9-1953-4dbd-8a9a-81af60aa3394 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:12.134956 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bebe9-1953-4dbd-8a9a-81af60aa3394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:12.135235 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bebe9-1953-4dbd-8a9a-81af60aa3394 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:12.137089 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bebe9-1953-4dbd-8a9a-81af60aa3394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:12.139713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bebe9-1953-4dbd-8a9a-81af60aa3394 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:12.172648 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 916/1839] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:12 2022] POST /identity/v3/users => generated 299 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:12.177055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe54a8e-2002-4247-811a-c3a332cbc069 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:12.194251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe54a8e-2002-4247-811a-c3a332cbc069 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:12.202222 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21aa63a-4943-44d4-81fe-2c8ced4e1b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:12.203014 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21aa63a-4943-44d4-81fe-2c8ced4e1b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:12.203304 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21aa63a-4943-44d4-81fe-2c8ced4e1b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:12.203588 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21aa63a-4943-44d4-81fe-2c8ced4e1b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:12.204543 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21aa63a-4943-44d4-81fe-2c8ced4e1b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:12.206804 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21aa63a-4943-44d4-81fe-2c8ced4e1b79 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:12.227161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 924/1840] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:12.229166 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bebe9-1953-4dbd-8a9a-81af60aa3394 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:12.261516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bebe9-1953-4dbd-8a9a-81af60aa3394 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:12.290380 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734d4c0-33b8-4f75-8593-021b80045192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:12.292169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d4c0-33b8-4f75-8593-021b80045192 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:12.292462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d4c0-33b8-4f75-8593-021b80045192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:12.292744 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d4c0-33b8-4f75-8593-021b80045192 admin admin] PATH_INFO: `/v3/projects/afe55445880d41a2894fc3327e43897d/users/e4791f1ceaa34a6392d5e1ef912bc193/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:12.335205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734d4c0-33b8-4f75-8593-021b80045192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe55445880d41a2894fc3327e43897d, user_id=e4791f1ceaa34a6392d5e1ef912bc193, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:12.338329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734d4c0-33b8-4f75-8593-021b80045192 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:12.402051 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 917/1841] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:12 2022] PUT /identity/v3/projects/afe55445880d41a2894fc3327e43897d/users/e4791f1ceaa34a6392d5e1ef912bc193/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:12.403175 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21aa63a-4943-44d4-81fe-2c8ced4e1b79 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:12.419491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21aa63a-4943-44d4-81fe-2c8ced4e1b79 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:12.543570 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd420957-f58a-4b15-924c-758a73e3f862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:12.544373 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd420957-f58a-4b15-924c-758a73e3f862 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:12.544728 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd420957-f58a-4b15-924c-758a73e3f862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:12.545046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd420957-f58a-4b15-924c-758a73e3f862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:12.545897 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd420957-f58a-4b15-924c-758a73e3f862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:12.548508 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd420957-f58a-4b15-924c-758a73e3f862 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:12.561733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 925/1842] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:12.566033 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734d4c0-33b8-4f75-8593-021b80045192 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:12.579391 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734d4c0-33b8-4f75-8593-021b80045192 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:12.584845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7180086-295e-4f43-becd-4bc807567848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:12.585865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7180086-295e-4f43-becd-4bc807567848 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:12.586240 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7180086-295e-4f43-becd-4bc807567848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:12.586594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7180086-295e-4f43-becd-4bc807567848 admin admin] PATH_INFO: `/v3/projects/afe55445880d41a2894fc3327e43897d/users/e4791f1ceaa34a6392d5e1ef912bc193/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:12.590199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7180086-295e-4f43-becd-4bc807567848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe55445880d41a2894fc3327e43897d, user_id=e4791f1ceaa34a6392d5e1ef912bc193, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:12.592960 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7180086-295e-4f43-becd-4bc807567848 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:12.606814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 918/1843] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:12 2022] PUT /identity/v3/projects/afe55445880d41a2894fc3327e43897d/users/e4791f1ceaa34a6392d5e1ef912bc193/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:12.618824 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf035904-1677-4b3d-b5c2-d638d368cc55 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:12.619179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf035904-1677-4b3d-b5c2-d638d368cc55 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:12.619653 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf035904-1677-4b3d-b5c2-d638d368cc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:12.656808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-cf035904-1677-4b3d-b5c2-d638d368cc55 None None] MFA Rules not processed for user `e4791f1ceaa34a6392d5e1ef912bc193`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:12.658424 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cf035904-1677-4b3d-b5c2-d638d368cc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:12.742012 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 926/1844] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:12.751115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7180086-295e-4f43-becd-4bc807567848 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:12.752837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e7180086-295e-4f43-becd-4bc807567848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:12.828672 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7180086-295e-4f43-becd-4bc807567848 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:12.832814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0474c-924c-47d1-9e46-abfd0285ab93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:12.833480 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0474c-924c-47d1-9e46-abfd0285ab93 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:12.833768 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0474c-924c-47d1-9e46-abfd0285ab93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:12.834079 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0474c-924c-47d1-9e46-abfd0285ab93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:12.845843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0474c-924c-47d1-9e46-abfd0285ab93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:12.847301 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0474c-924c-47d1-9e46-abfd0285ab93 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:12.857643 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 919/1845] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:12.930171 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf035904-1677-4b3d-b5c2-d638d368cc55 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:12.970193 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:13.025148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf035904-1677-4b3d-b5c2-d638d368cc55 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:13.031203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78690797-7016-4bc1-b472-39f24e816351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:13.031974 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78690797-7016-4bc1-b472-39f24e816351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:13.032320 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78690797-7016-4bc1-b472-39f24e816351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:13.032660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78690797-7016-4bc1-b472-39f24e816351 admin admin] PATH_INFO: `/v3/users/0ab9e06d85284ef4806d4ceca9cb2857` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:13.034102 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78690797-7016-4bc1-b472-39f24e816351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab9e06d85284ef4806d4ceca9cb2857)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:13.036507 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78690797-7016-4bc1-b472-39f24e816351 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:13.100815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-78690797-7016-4bc1-b472-39f24e816351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab9e06d85284ef4806d4ceca9cb2857'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:13.116262 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-78690797-7016-4bc1-b472-39f24e816351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab9e06d85284ef4806d4ceca9cb2857'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:13.117023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-78690797-7016-4bc1-b472-39f24e816351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab9e06d85284ef4806d4ceca9cb2857'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:13.124421 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-78690797-7016-4bc1-b472-39f24e816351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab9e06d85284ef4806d4ceca9cb2857'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:13.132455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-78690797-7016-4bc1-b472-39f24e816351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab9e06d85284ef4806d4ceca9cb2857'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:13.139860 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 927/1846] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:12 2022] DELETE /identity/v3/users/0ab9e06d85284ef4806d4ceca9cb2857 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:13.144725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97814816-9b8b-4104-8410-56c3a2f1eb3d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:13.145205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97814816-9b8b-4104-8410-56c3a2f1eb3d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:13.145298 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97814816-9b8b-4104-8410-56c3a2f1eb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:13.163172 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-97814816-9b8b-4104-8410-56c3a2f1eb3d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:13.164528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-97814816-9b8b-4104-8410-56c3a2f1eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:13.238696 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 920/1847] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:13.249050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78690797-7016-4bc1-b472-39f24e816351 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:13.250610 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-78690797-7016-4bc1-b472-39f24e816351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:13.307823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78690797-7016-4bc1-b472-39f24e816351 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:13.311978 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e12504-f77a-47ac-9f9a-be0f6b000704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:13.312643 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e12504-f77a-47ac-9f9a-be0f6b000704 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:13.312962 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e12504-f77a-47ac-9f9a-be0f6b000704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:13.313266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e12504-f77a-47ac-9f9a-be0f6b000704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:13.323723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e12504-f77a-47ac-9f9a-be0f6b000704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:13.325279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e12504-f77a-47ac-9f9a-be0f6b000704 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:13.337651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 928/1848] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:13.737704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97814816-9b8b-4104-8410-56c3a2f1eb3d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:13.740172 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-97814816-9b8b-4104-8410-56c3a2f1eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:13.761607 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97814816-9b8b-4104-8410-56c3a2f1eb3d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:13.768724 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c0dff-66f6-44af-ae67-ab3b2585b043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:13.771013 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c0dff-66f6-44af-ae67-ab3b2585b043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:13.771013 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c0dff-66f6-44af-ae67-ab3b2585b043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:13.771013 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c0dff-66f6-44af-ae67-ab3b2585b043 admin admin] PATH_INFO: `/v3/projects/ccead3aec2cf4dc6a488236ca81266a7` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:13.774020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c0dff-66f6-44af-ae67-ab3b2585b043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccead3aec2cf4dc6a488236ca81266a7)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:13.776130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c0dff-66f6-44af-ae67-ab3b2585b043 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:13.819656 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:13.844394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-574c0dff-66f6-44af-ae67-ab3b2585b043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccead3aec2cf4dc6a488236ca81266a7', 'request_id': 'req-574c0dff-66f6-44af-ae67-ab3b2585b043'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:13.857986 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-574c0dff-66f6-44af-ae67-ab3b2585b043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccead3aec2cf4dc6a488236ca81266a7', 'request_id': 'req-574c0dff-66f6-44af-ae67-ab3b2585b043'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:13.870310 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-574c0dff-66f6-44af-ae67-ab3b2585b043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccead3aec2cf4dc6a488236ca81266a7', 'request_id': 'req-574c0dff-66f6-44af-ae67-ab3b2585b043'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:13.887667 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-574c0dff-66f6-44af-ae67-ab3b2585b043 admin admin] The token cache is being invalidate because project ccead3aec2cf4dc6a488236ca81266a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:13.888155 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-574c0dff-66f6-44af-ae67-ab3b2585b043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:13.889413 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-574c0dff-66f6-44af-ae67-ab3b2585b043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:13.895071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 921/1849] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:13 2022] DELETE /identity/v3/projects/ccead3aec2cf4dc6a488236ca81266a7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:13.896511 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e12504-f77a-47ac-9f9a-be0f6b000704 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:13.907280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e12504-f77a-47ac-9f9a-be0f6b000704 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:14.032510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:14.052310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600c3fd-4606-4d05-b9f4-497213f96c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:14.053593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600c3fd-4606-4d05-b9f4-497213f96c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:14.053988 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600c3fd-4606-4d05-b9f4-497213f96c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:14.054325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600c3fd-4606-4d05-b9f4-497213f96c22 admin admin] PATH_INFO: `/v3/users/e4791f1ceaa34a6392d5e1ef912bc193` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:14.056539 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600c3fd-4606-4d05-b9f4-497213f96c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4791f1ceaa34a6392d5e1ef912bc193)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:14.064974 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600c3fd-4606-4d05-b9f4-497213f96c22 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:14.158093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-0600c3fd-4606-4d05-b9f4-497213f96c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4791f1ceaa34a6392d5e1ef912bc193'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:14.186405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-0600c3fd-4606-4d05-b9f4-497213f96c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4791f1ceaa34a6392d5e1ef912bc193'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:14.187308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-0600c3fd-4606-4d05-b9f4-497213f96c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4791f1ceaa34a6392d5e1ef912bc193'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:14.207447 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-0600c3fd-4606-4d05-b9f4-497213f96c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4791f1ceaa34a6392d5e1ef912bc193'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:14.220183 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-0600c3fd-4606-4d05-b9f4-497213f96c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4791f1ceaa34a6392d5e1ef912bc193'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:14.232683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 929/1850] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:13 2022] DELETE /identity/v3/users/e4791f1ceaa34a6392d5e1ef912bc193 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:15.148398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c0dff-66f6-44af-ae67-ab3b2585b043 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:15.150152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-574c0dff-66f6-44af-ae67-ab3b2585b043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:15.197706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c0dff-66f6-44af-ae67-ab3b2585b043 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:15.296735 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ef4b1-57b5-468a-b6bc-e4f60cd1831f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:15.298114 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ef4b1-57b5-468a-b6bc-e4f60cd1831f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:15.298617 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ef4b1-57b5-468a-b6bc-e4f60cd1831f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:15.299762 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ef4b1-57b5-468a-b6bc-e4f60cd1831f admin admin] PATH_INFO: `/v3/projects/afe55445880d41a2894fc3327e43897d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:15.301606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ef4b1-57b5-468a-b6bc-e4f60cd1831f admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe55445880d41a2894fc3327e43897d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:15.304513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ef4b1-57b5-468a-b6bc-e4f60cd1831f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:15.366833 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-184ef4b1-57b5-468a-b6bc-e4f60cd1831f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe55445880d41a2894fc3327e43897d', 'request_id': 'req-184ef4b1-57b5-468a-b6bc-e4f60cd1831f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:15.377352 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-184ef4b1-57b5-468a-b6bc-e4f60cd1831f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe55445880d41a2894fc3327e43897d', 'request_id': 'req-184ef4b1-57b5-468a-b6bc-e4f60cd1831f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:15.386835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-184ef4b1-57b5-468a-b6bc-e4f60cd1831f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe55445880d41a2894fc3327e43897d', 'request_id': 'req-184ef4b1-57b5-468a-b6bc-e4f60cd1831f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:15.399437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-184ef4b1-57b5-468a-b6bc-e4f60cd1831f admin admin] The token cache is being invalidate because project afe55445880d41a2894fc3327e43897d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:15.399776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-184ef4b1-57b5-468a-b6bc-e4f60cd1831f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:15.400470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-184ef4b1-57b5-468a-b6bc-e4f60cd1831f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:15.402770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 922/1851] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:15 2022] DELETE /identity/v3/projects/afe55445880d41a2894fc3327e43897d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:15.407739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48e34f-85d0-406f-a38b-6e5a66ac91af None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:15.408207 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48e34f-85d0-406f-a38b-6e5a66ac91af None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:15.408393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48e34f-85d0-406f-a38b-6e5a66ac91af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:15.431165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-7c48e34f-85d0-406f-a38b-6e5a66ac91af None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:15.433908 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7c48e34f-85d0-406f-a38b-6e5a66ac91af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:15.569968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 930/1852] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:15.571235 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837e456-24c4-4dfd-9b3a-ad88b8e53009 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:15.571423 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837e456-24c4-4dfd-9b3a-ad88b8e53009 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:15.571771 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837e456-24c4-4dfd-9b3a-ad88b8e53009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:15.593860 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7837e456-24c4-4dfd-9b3a-ad88b8e53009 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:15.596637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7837e456-24c4-4dfd-9b3a-ad88b8e53009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:15.607639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 923/1853] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:15.617856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48e34f-85d0-406f-a38b-6e5a66ac91af None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:15.625756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48e34f-85d0-406f-a38b-6e5a66ac91af None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:15.634312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d8312-198e-4d0b-ae11-d262cb8ceed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:15.636669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d8312-198e-4d0b-ae11-d262cb8ceed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:15.637114 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d8312-198e-4d0b-ae11-d262cb8ceed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:15.637539 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d8312-198e-4d0b-ae11-d262cb8ceed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:15.639427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d8312-198e-4d0b-ae11-d262cb8ceed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:15.639775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d8312-198e-4d0b-ae11-d262cb8ceed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:15.642133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d8312-198e-4d0b-ae11-d262cb8ceed2 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:15.667367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 931/1854] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:15.673376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837e456-24c4-4dfd-9b3a-ad88b8e53009 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:15.691774 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837e456-24c4-4dfd-9b3a-ad88b8e53009 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:15.698030 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110b622-4501-430a-9a4e-5c83533f5b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:15.698871 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110b622-4501-430a-9a4e-5c83533f5b05 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:15.699150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110b622-4501-430a-9a4e-5c83533f5b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:15.699424 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110b622-4501-430a-9a4e-5c83533f5b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:15.700439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110b622-4501-430a-9a4e-5c83533f5b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:15.703109 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110b622-4501-430a-9a4e-5c83533f5b05 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:15.741299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 924/1855] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:15 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:15.745326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d8312-198e-4d0b-ae11-d262cb8ceed2 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:15.766105 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d8312-198e-4d0b-ae11-d262cb8ceed2 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:15.894800 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:15.924309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028e8c0-2741-4403-a63e-d7cabffb9622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:15.925046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028e8c0-2741-4403-a63e-d7cabffb9622 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:15.925342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028e8c0-2741-4403-a63e-d7cabffb9622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:15.925617 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028e8c0-2741-4403-a63e-d7cabffb9622 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:15.932890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028e8c0-2741-4403-a63e-d7cabffb9622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:15.938563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028e8c0-2741-4403-a63e-d7cabffb9622 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:15.978152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 932/1856] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:15 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:09:15.984075 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110b622-4501-430a-9a4e-5c83533f5b05 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:15.999912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110b622-4501-430a-9a4e-5c83533f5b05 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:16.005665 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b428d-1df0-4f22-bfc1-e95409dfe80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:16.006887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b428d-1df0-4f22-bfc1-e95409dfe80a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:16.007174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b428d-1df0-4f22-bfc1-e95409dfe80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:16.007759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b428d-1df0-4f22-bfc1-e95409dfe80a admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:16.008857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b428d-1df0-4f22-bfc1-e95409dfe80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:16.011163 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b428d-1df0-4f22-bfc1-e95409dfe80a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:16.023683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 925/1857] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:16.028262 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028e8c0-2741-4403-a63e-d7cabffb9622 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:16.040569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028e8c0-2741-4403-a63e-d7cabffb9622 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:16.047354 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f883b-d807-446b-bf5f-d2e961e249be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:16.047912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f883b-d807-446b-bf5f-d2e961e249be admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:16.048213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f883b-d807-446b-bf5f-d2e961e249be admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:16.048491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f883b-d807-446b-bf5f-d2e961e249be admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:16.049278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f883b-d807-446b-bf5f-d2e961e249be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:16.051113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f883b-d807-446b-bf5f-d2e961e249be admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:16.079059 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 933/1858] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:16.081402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b428d-1df0-4f22-bfc1-e95409dfe80a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:16.106999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b428d-1df0-4f22-bfc1-e95409dfe80a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:16.126086 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d228d22-f11a-43ce-8e4a-b9efffd46cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:16.127763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d228d22-f11a-43ce-8e4a-b9efffd46cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:16.129022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d228d22-f11a-43ce-8e4a-b9efffd46cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:16.131005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d228d22-f11a-43ce-8e4a-b9efffd46cbc admin admin] PATH_INFO: `/v3/projects/c0bc83dff3a04b8685223bd177ebc9ba/users/454757a6998b41beb62ed08f8966a9f0/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:16.134544 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:16.154786 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d228d22-f11a-43ce-8e4a-b9efffd46cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0bc83dff3a04b8685223bd177ebc9ba, user_id=454757a6998b41beb62ed08f8966a9f0, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:16.159527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d228d22-f11a-43ce-8e4a-b9efffd46cbc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:16.199823 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 926/1859] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:16 2022] PUT /identity/v3/projects/c0bc83dff3a04b8685223bd177ebc9ba/users/454757a6998b41beb62ed08f8966a9f0/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:16.212654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95bc8f-04e4-42a1-8c82-4bdb80f20a98 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:16.213202 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95bc8f-04e4-42a1-8c82-4bdb80f20a98 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:16.213846 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95bc8f-04e4-42a1-8c82-4bdb80f20a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:16.253977 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-bd95bc8f-04e4-42a1-8c82-4bdb80f20a98 None None] MFA Rules not processed for user `454757a6998b41beb62ed08f8966a9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:16.255606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bd95bc8f-04e4-42a1-8c82-4bdb80f20a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:16.375231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d228d22-f11a-43ce-8e4a-b9efffd46cbc admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:16.375706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 934/1860] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:16.514693 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d228d22-f11a-43ce-8e4a-b9efffd46cbc admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:16.524424 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4da328-9816-47fa-9c9d-85b31d645979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:16.525613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4da328-9816-47fa-9c9d-85b31d645979 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:16.526149 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4da328-9816-47fa-9c9d-85b31d645979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:16.526534 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4da328-9816-47fa-9c9d-85b31d645979 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:16.527390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4da328-9816-47fa-9c9d-85b31d645979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:16.529931 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4da328-9816-47fa-9c9d-85b31d645979 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:16.563230 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 927/1861] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:16 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:16.567383 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95bc8f-04e4-42a1-8c82-4bdb80f20a98 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:16.580111 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95bc8f-04e4-42a1-8c82-4bdb80f20a98 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:16.657117 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77ef48-fecf-40ec-90a9-69350e320891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:16.657861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77ef48-fecf-40ec-90a9-69350e320891 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:16.658155 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77ef48-fecf-40ec-90a9-69350e320891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:16.658443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77ef48-fecf-40ec-90a9-69350e320891 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:16.659151 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77ef48-fecf-40ec-90a9-69350e320891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:16.661146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77ef48-fecf-40ec-90a9-69350e320891 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:16.695715 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 935/1862] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:16 2022] POST /identity/v3/users => generated 300 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:16.700036 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4da328-9816-47fa-9c9d-85b31d645979 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:16.713771 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4da328-9816-47fa-9c9d-85b31d645979 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:16.719284 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d51cbd-8ce7-4a27-9bdb-a5fdbe2b5958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:16.719978 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d51cbd-8ce7-4a27-9bdb-a5fdbe2b5958 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:16.720264 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d51cbd-8ce7-4a27-9bdb-a5fdbe2b5958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:16.720544 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d51cbd-8ce7-4a27-9bdb-a5fdbe2b5958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:16.721318 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d51cbd-8ce7-4a27-9bdb-a5fdbe2b5958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:16.722982 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d51cbd-8ce7-4a27-9bdb-a5fdbe2b5958 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:16.737863 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 928/1863] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:16.742102 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77ef48-fecf-40ec-90a9-69350e320891 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:16.753648 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77ef48-fecf-40ec-90a9-69350e320891 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:16.761828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9b100-48f4-4754-bb3d-50f1660e57e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:16.762831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9b100-48f4-4754-bb3d-50f1660e57e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:16.763333 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9b100-48f4-4754-bb3d-50f1660e57e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:16.763682 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9b100-48f4-4754-bb3d-50f1660e57e9 admin admin] PATH_INFO: `/v3/projects/1798a8a8cca54c5caaa20f6323f3fd97/users/461de45ea8ce41bc95a3df0746d49730/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:16.796038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9b100-48f4-4754-bb3d-50f1660e57e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1798a8a8cca54c5caaa20f6323f3fd97, user_id=461de45ea8ce41bc95a3df0746d49730, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:16.799238 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9b100-48f4-4754-bb3d-50f1660e57e9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:16.840906 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 936/1864] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:16 2022] PUT /identity/v3/projects/1798a8a8cca54c5caaa20f6323f3fd97/users/461de45ea8ce41bc95a3df0746d49730/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:16.846826 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d51cbd-8ce7-4a27-9bdb-a5fdbe2b5958 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:16.861729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d51cbd-8ce7-4a27-9bdb-a5fdbe2b5958 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:17.015014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc745c0-d5c6-4430-9bf3-873c5df999a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:17.015661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc745c0-d5c6-4430-9bf3-873c5df999a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:17.015960 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc745c0-d5c6-4430-9bf3-873c5df999a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:17.016281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc745c0-d5c6-4430-9bf3-873c5df999a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:17.017108 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc745c0-d5c6-4430-9bf3-873c5df999a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:17.028924 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc745c0-d5c6-4430-9bf3-873c5df999a4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:17.055905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 929/1865] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:17.056788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9b100-48f4-4754-bb3d-50f1660e57e9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:17.071842 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9b100-48f4-4754-bb3d-50f1660e57e9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:17.086153 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b0054-2ed0-4397-9495-5950822184c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:17.087792 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b0054-2ed0-4397-9495-5950822184c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:17.088165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b0054-2ed0-4397-9495-5950822184c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:17.088457 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b0054-2ed0-4397-9495-5950822184c9 admin admin] PATH_INFO: `/v3/projects/1798a8a8cca54c5caaa20f6323f3fd97/users/461de45ea8ce41bc95a3df0746d49730/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:17.092453 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b0054-2ed0-4397-9495-5950822184c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1798a8a8cca54c5caaa20f6323f3fd97, user_id=461de45ea8ce41bc95a3df0746d49730, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:17.095427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b0054-2ed0-4397-9495-5950822184c9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:17.114024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 937/1866] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:17 2022] PUT /identity/v3/projects/1798a8a8cca54c5caaa20f6323f3fd97/users/461de45ea8ce41bc95a3df0746d49730/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:17.126285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaf820-ab48-4d6c-ae22-a9624fc583ac None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:17.126574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaf820-ab48-4d6c-ae22-a9624fc583ac None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:17.126851 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaf820-ab48-4d6c-ae22-a9624fc583ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:17.160485 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-40aaf820-ab48-4d6c-ae22-a9624fc583ac None None] MFA Rules not processed for user `461de45ea8ce41bc95a3df0746d49730`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:17.161705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-40aaf820-ab48-4d6c-ae22-a9624fc583ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:17.216664 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:17.252045 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 930/1867] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:17.286930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b0054-2ed0-4397-9495-5950822184c9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:17.288888 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fe3b0054-2ed0-4397-9495-5950822184c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:17.309884 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:17.372506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b0054-2ed0-4397-9495-5950822184c9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:17.379662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3074e7f-9d8d-4d58-aa31-dad4a9657b45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:17.381369 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3074e7f-9d8d-4d58-aa31-dad4a9657b45 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:17.381899 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3074e7f-9d8d-4d58-aa31-dad4a9657b45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:17.382503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3074e7f-9d8d-4d58-aa31-dad4a9657b45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:17.400544 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3074e7f-9d8d-4d58-aa31-dad4a9657b45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:17.402411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3074e7f-9d8d-4d58-aa31-dad4a9657b45 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:17.421981 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 938/1868] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:18.248705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aaf820-ab48-4d6c-ae22-a9624fc583ac None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:18.325691 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aaf820-ab48-4d6c-ae22-a9624fc583ac None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:18.332054 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716309d-98aa-4c50-9b65-e12b5fc9f7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:18.333063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716309d-98aa-4c50-9b65-e12b5fc9f7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:18.333414 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716309d-98aa-4c50-9b65-e12b5fc9f7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:18.333869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716309d-98aa-4c50-9b65-e12b5fc9f7fa admin admin] PATH_INFO: `/v3/users/454757a6998b41beb62ed08f8966a9f0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:18.335269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716309d-98aa-4c50-9b65-e12b5fc9f7fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=454757a6998b41beb62ed08f8966a9f0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:18.338674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716309d-98aa-4c50-9b65-e12b5fc9f7fa admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:18.405177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b716309d-98aa-4c50-9b65-e12b5fc9f7fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454757a6998b41beb62ed08f8966a9f0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:18.406393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b716309d-98aa-4c50-9b65-e12b5fc9f7fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454757a6998b41beb62ed08f8966a9f0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:18.424849 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b716309d-98aa-4c50-9b65-e12b5fc9f7fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454757a6998b41beb62ed08f8966a9f0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:18.442647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b716309d-98aa-4c50-9b65-e12b5fc9f7fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454757a6998b41beb62ed08f8966a9f0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:18.458307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b716309d-98aa-4c50-9b65-e12b5fc9f7fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454757a6998b41beb62ed08f8966a9f0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:18.467808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 931/1869] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:18 2022] DELETE /identity/v3/users/454757a6998b41beb62ed08f8966a9f0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:18.474655 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e63a80-60ab-49e6-9dfb-dcc85216b46e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:18.475699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e63a80-60ab-49e6-9dfb-dcc85216b46e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:18.476127 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e63a80-60ab-49e6-9dfb-dcc85216b46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:18.506178 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a9e63a80-60ab-49e6-9dfb-dcc85216b46e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:18.508864 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a9e63a80-60ab-49e6-9dfb-dcc85216b46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:18.644380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 939/1870] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:18.651575 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716309d-98aa-4c50-9b65-e12b5fc9f7fa admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:18.653439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b716309d-98aa-4c50-9b65-e12b5fc9f7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:18.734125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716309d-98aa-4c50-9b65-e12b5fc9f7fa admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:18.743724 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6f5fb-001d-487e-b1ee-9072bf6e55f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:18.744700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6f5fb-001d-487e-b1ee-9072bf6e55f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:18.745126 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6f5fb-001d-487e-b1ee-9072bf6e55f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:18.745571 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6f5fb-001d-487e-b1ee-9072bf6e55f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:18.758226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6f5fb-001d-487e-b1ee-9072bf6e55f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:18.760001 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6f5fb-001d-487e-b1ee-9072bf6e55f4 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:18.792597 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 932/1871] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:19.407844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e63a80-60ab-49e6-9dfb-dcc85216b46e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:19.411271 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a9e63a80-60ab-49e6-9dfb-dcc85216b46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:19.434447 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e63a80-60ab-49e6-9dfb-dcc85216b46e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:19.443398 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:19.444880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:19.445334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:19.445903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e admin admin] PATH_INFO: `/v3/projects/c0bc83dff3a04b8685223bd177ebc9ba` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:19.448764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0bc83dff3a04b8685223bd177ebc9ba)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:19.452581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:19.521062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0bc83dff3a04b8685223bd177ebc9ba', 'request_id': 'req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:19.527598 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0bc83dff3a04b8685223bd177ebc9ba', 'request_id': 'req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:19.535399 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0bc83dff3a04b8685223bd177ebc9ba', 'request_id': 'req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:19.559850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e admin admin] The token cache is being invalidate because project c0bc83dff3a04b8685223bd177ebc9ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:19.560082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:19.560685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:19.562772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 940/1872] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:19 2022] DELETE /identity/v3/projects/c0bc83dff3a04b8685223bd177ebc9ba => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:19.567689 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6f5fb-001d-487e-b1ee-9072bf6e55f4 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:19.575094 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:19.584111 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6f5fb-001d-487e-b1ee-9072bf6e55f4 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:19.660895 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3a6a5-924f-4b3e-b156-fec9d41e4b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:19.661827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3a6a5-924f-4b3e-b156-fec9d41e4b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:19.662112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3a6a5-924f-4b3e-b156-fec9d41e4b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:19.662386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3a6a5-924f-4b3e-b156-fec9d41e4b43 admin admin] PATH_INFO: `/v3/users/461de45ea8ce41bc95a3df0746d49730` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:19.663579 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3a6a5-924f-4b3e-b156-fec9d41e4b43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=461de45ea8ce41bc95a3df0746d49730)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:19.665701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3a6a5-924f-4b3e-b156-fec9d41e4b43 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:19.741417 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-91b3a6a5-924f-4b3e-b156-fec9d41e4b43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461de45ea8ce41bc95a3df0746d49730'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:19.754097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-91b3a6a5-924f-4b3e-b156-fec9d41e4b43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461de45ea8ce41bc95a3df0746d49730'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:19.774583 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-91b3a6a5-924f-4b3e-b156-fec9d41e4b43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461de45ea8ce41bc95a3df0746d49730'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:19.791999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-91b3a6a5-924f-4b3e-b156-fec9d41e4b43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461de45ea8ce41bc95a3df0746d49730'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:19.799725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-91b3a6a5-924f-4b3e-b156-fec9d41e4b43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461de45ea8ce41bc95a3df0746d49730'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:19.808222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 933/1873] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:19 2022] DELETE /identity/v3/users/461de45ea8ce41bc95a3df0746d49730 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:20.239244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:20.241163 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:20.262690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab593d39-2f68-44c6-a431-21bb6ce5dc4e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:20.342751 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:20.366250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15212ea7-6568-4b94-853f-773766d0507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:20.367934 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15212ea7-6568-4b94-853f-773766d0507c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:20.368237 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15212ea7-6568-4b94-853f-773766d0507c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:20.368675 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15212ea7-6568-4b94-853f-773766d0507c admin admin] PATH_INFO: `/v3/projects/1798a8a8cca54c5caaa20f6323f3fd97` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:20.371098 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15212ea7-6568-4b94-853f-773766d0507c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1798a8a8cca54c5caaa20f6323f3fd97)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:20.373970 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15212ea7-6568-4b94-853f-773766d0507c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:20.436847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-15212ea7-6568-4b94-853f-773766d0507c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1798a8a8cca54c5caaa20f6323f3fd97', 'request_id': 'req-15212ea7-6568-4b94-853f-773766d0507c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:20.452191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-15212ea7-6568-4b94-853f-773766d0507c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1798a8a8cca54c5caaa20f6323f3fd97', 'request_id': 'req-15212ea7-6568-4b94-853f-773766d0507c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:20.464666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-15212ea7-6568-4b94-853f-773766d0507c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1798a8a8cca54c5caaa20f6323f3fd97', 'request_id': 'req-15212ea7-6568-4b94-853f-773766d0507c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:20.499312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-15212ea7-6568-4b94-853f-773766d0507c admin admin] The token cache is being invalidate because project 1798a8a8cca54c5caaa20f6323f3fd97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:20.500005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-15212ea7-6568-4b94-853f-773766d0507c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:20.501130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-15212ea7-6568-4b94-853f-773766d0507c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:20.505618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 941/1874] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:20 2022] DELETE /identity/v3/projects/1798a8a8cca54c5caaa20f6323f3fd97 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:20.510952 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874eda3-7bb3-488a-a312-3c37f65478af None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:20.511710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874eda3-7bb3-488a-a312-3c37f65478af None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:20.512559 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874eda3-7bb3-488a-a312-3c37f65478af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:20.578162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2874eda3-7bb3-488a-a312-3c37f65478af None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:20.580774 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2874eda3-7bb3-488a-a312-3c37f65478af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:20.684426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 934/1875] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:20.694222 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b6bad-d998-45d0-a0a0-5b5611787198 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:20.694738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b6bad-d998-45d0-a0a0-5b5611787198 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:20.694817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b6bad-d998-45d0-a0a0-5b5611787198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:20.715309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2a1b6bad-d998-45d0-a0a0-5b5611787198 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:20.716527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2a1b6bad-d998-45d0-a0a0-5b5611787198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:20.724804 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 942/1876] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:20.730048 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874eda3-7bb3-488a-a312-3c37f65478af None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:20.740154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874eda3-7bb3-488a-a312-3c37f65478af None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:20.746389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4856a-1556-4331-8eca-95bfdd620fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:20.747087 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4856a-1556-4331-8eca-95bfdd620fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:20.747370 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4856a-1556-4331-8eca-95bfdd620fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:20.747641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4856a-1556-4331-8eca-95bfdd620fd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:20.748383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4856a-1556-4331-8eca-95bfdd620fd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:20.748689 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4856a-1556-4331-8eca-95bfdd620fd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:20.750376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4856a-1556-4331-8eca-95bfdd620fd4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:20.776315 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 935/1877] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:20.780894 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b6bad-d998-45d0-a0a0-5b5611787198 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:20.792358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b6bad-d998-45d0-a0a0-5b5611787198 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:20.815705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d2ff7-7ac2-41f2-b756-a24aabeef3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:20.815705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d2ff7-7ac2-41f2-b756-a24aabeef3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:20.815705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d2ff7-7ac2-41f2-b756-a24aabeef3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:20.816022 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d2ff7-7ac2-41f2-b756-a24aabeef3f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:20.816606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d2ff7-7ac2-41f2-b756-a24aabeef3f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:20.818909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d2ff7-7ac2-41f2-b756-a24aabeef3f7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:20.868401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 943/1878] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:20 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:20.870760 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4856a-1556-4331-8eca-95bfdd620fd4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:20.885066 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4856a-1556-4331-8eca-95bfdd620fd4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:20.892419 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:20.978649 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804248d-0f9b-428a-b4f5-106af3632155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:20.979658 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804248d-0f9b-428a-b4f5-106af3632155 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:20.981121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804248d-0f9b-428a-b4f5-106af3632155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:20.981617 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804248d-0f9b-428a-b4f5-106af3632155 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:20.982757 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804248d-0f9b-428a-b4f5-106af3632155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:20.985261 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804248d-0f9b-428a-b4f5-106af3632155 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:21.024261 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 936/1879] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:20 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:21.028881 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d2ff7-7ac2-41f2-b756-a24aabeef3f7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:21.043786 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d2ff7-7ac2-41f2-b756-a24aabeef3f7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:21.050446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769335a-3e5f-4758-ab44-48f0c8a8b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:21.051803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769335a-3e5f-4758-ab44-48f0c8a8b372 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:21.052294 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769335a-3e5f-4758-ab44-48f0c8a8b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:21.053046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769335a-3e5f-4758-ab44-48f0c8a8b372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:21.054533 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769335a-3e5f-4758-ab44-48f0c8a8b372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:21.056820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769335a-3e5f-4758-ab44-48f0c8a8b372 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:21.074874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804248d-0f9b-428a-b4f5-106af3632155 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:21.093591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804248d-0f9b-428a-b4f5-106af3632155 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:21.094396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 944/1880] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:09:21.102299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79825a-adcc-45f1-a98d-34856d0a8ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:21.103012 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79825a-adcc-45f1-a98d-34856d0a8ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:21.103460 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79825a-adcc-45f1-a98d-34856d0a8ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:21.103902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79825a-adcc-45f1-a98d-34856d0a8ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:21.104844 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79825a-adcc-45f1-a98d-34856d0a8ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:21.107663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79825a-adcc-45f1-a98d-34856d0a8ab9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:21.120726 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 937/1881] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:21.126039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769335a-3e5f-4758-ab44-48f0c8a8b372 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:21.139420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769335a-3e5f-4758-ab44-48f0c8a8b372 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:21.156349 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c7b76-895a-4793-a48f-b84d65183e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:21.156349 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c7b76-895a-4793-a48f-b84d65183e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:21.156349 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c7b76-895a-4793-a48f-b84d65183e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:21.156349 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c7b76-895a-4793-a48f-b84d65183e2b admin admin] PATH_INFO: `/v3/projects/6c0a3c915a54444e9ce10d8607482d91/users/aac45589f18e420ebf37294f8a78b374/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:21.173309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c7b76-895a-4793-a48f-b84d65183e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c0a3c915a54444e9ce10d8607482d91, user_id=aac45589f18e420ebf37294f8a78b374, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:21.176266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c7b76-895a-4793-a48f-b84d65183e2b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:21.203534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 945/1882] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:21 2022] PUT /identity/v3/projects/6c0a3c915a54444e9ce10d8607482d91/users/aac45589f18e420ebf37294f8a78b374/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:21.215123 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23264f-daed-4eee-b8a8-d94376dd434f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:21.215445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23264f-daed-4eee-b8a8-d94376dd434f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:21.215698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23264f-daed-4eee-b8a8-d94376dd434f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:21.249480 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3d23264f-daed-4eee-b8a8-d94376dd434f None None] MFA Rules not processed for user `aac45589f18e420ebf37294f8a78b374`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:21.250938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3d23264f-daed-4eee-b8a8-d94376dd434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:21.353101 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c7b76-895a-4793-a48f-b84d65183e2b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:21.355123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5a4c7b76-895a-4793-a48f-b84d65183e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:21.365418 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 938/1883] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:21.377905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23264f-daed-4eee-b8a8-d94376dd434f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:21.379831 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3d23264f-daed-4eee-b8a8-d94376dd434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:21.430838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c7b76-895a-4793-a48f-b84d65183e2b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:21.437327 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c86c3c-f236-474b-a06d-e0711a593aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:21.438333 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c86c3c-f236-474b-a06d-e0711a593aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:21.438622 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c86c3c-f236-474b-a06d-e0711a593aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:21.439021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c86c3c-f236-474b-a06d-e0711a593aff admin admin] PATH_INFO: `/v3/users/b3c61cf2a87f4c1d8474d039d41f5515` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:21.440386 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c86c3c-f236-474b-a06d-e0711a593aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c61cf2a87f4c1d8474d039d41f5515)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:21.442507 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c86c3c-f236-474b-a06d-e0711a593aff admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:21.444094 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23264f-daed-4eee-b8a8-d94376dd434f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:21.449547 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff69d0-ee80-43ab-875c-95b8ef820ba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:21.450277 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff69d0-ee80-43ab-875c-95b8ef820ba5 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:21.450564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff69d0-ee80-43ab-875c-95b8ef820ba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:21.450840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff69d0-ee80-43ab-875c-95b8ef820ba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:21.451128 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:21.463119 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff69d0-ee80-43ab-875c-95b8ef820ba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:21.464718 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff69d0-ee80-43ab-875c-95b8ef820ba5 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:21.476126 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 939/1884] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:21.498842 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff69d0-ee80-43ab-875c-95b8ef820ba5 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:21.506364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d2c86c3c-f236-474b-a06d-e0711a593aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c61cf2a87f4c1d8474d039d41f5515'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:21.517369 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff69d0-ee80-43ab-875c-95b8ef820ba5 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:21.520403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d2c86c3c-f236-474b-a06d-e0711a593aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c61cf2a87f4c1d8474d039d41f5515'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:21.521286 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d2c86c3c-f236-474b-a06d-e0711a593aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c61cf2a87f4c1d8474d039d41f5515'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:21.525901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9862d40-2043-469c-ad0e-371ae96e6945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:21.527329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9862d40-2043-469c-ad0e-371ae96e6945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:21.527785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9862d40-2043-469c-ad0e-371ae96e6945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:21.528436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9862d40-2043-469c-ad0e-371ae96e6945 admin admin] PATH_INFO: `/v3/users/aac45589f18e420ebf37294f8a78b374` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:21.530722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9862d40-2043-469c-ad0e-371ae96e6945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac45589f18e420ebf37294f8a78b374)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:21.534381 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9862d40-2043-469c-ad0e-371ae96e6945 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:21.536141 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d2c86c3c-f236-474b-a06d-e0711a593aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c61cf2a87f4c1d8474d039d41f5515'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:21.554835 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d2c86c3c-f236-474b-a06d-e0711a593aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c61cf2a87f4c1d8474d039d41f5515'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:21.560055 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:21.562532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 946/1885] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:21 2022] DELETE /identity/v3/users/b3c61cf2a87f4c1d8474d039d41f5515 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:21.566710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51094cf-9045-4406-a691-e78ebe982150 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:21.567002 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51094cf-9045-4406-a691-e78ebe982150 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:21.567339 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51094cf-9045-4406-a691-e78ebe982150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:21.600466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b51094cf-9045-4406-a691-e78ebe982150 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:21.602638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b51094cf-9045-4406-a691-e78ebe982150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:21.610821 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c9862d40-2043-469c-ad0e-371ae96e6945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac45589f18e420ebf37294f8a78b374'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:21.612082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c9862d40-2043-469c-ad0e-371ae96e6945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac45589f18e420ebf37294f8a78b374'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:21.622513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c9862d40-2043-469c-ad0e-371ae96e6945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac45589f18e420ebf37294f8a78b374'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:21.639252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c9862d40-2043-469c-ad0e-371ae96e6945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac45589f18e420ebf37294f8a78b374'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:21.656343 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c9862d40-2043-469c-ad0e-371ae96e6945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac45589f18e420ebf37294f8a78b374'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:21.666829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 940/1886] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:21 2022] DELETE /identity/v3/users/aac45589f18e420ebf37294f8a78b374 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:21.673387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94157ba6-a046-47ef-854c-ae7eee49787f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:21.674152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94157ba6-a046-47ef-854c-ae7eee49787f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:21.674450 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94157ba6-a046-47ef-854c-ae7eee49787f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:21.690579 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 947/1887] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:21.698544 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51094cf-9045-4406-a691-e78ebe982150 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:21.699972 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b51094cf-9045-4406-a691-e78ebe982150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:21.706006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-94157ba6-a046-47ef-854c-ae7eee49787f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:21.711205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-94157ba6-a046-47ef-854c-ae7eee49787f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:21.775568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51094cf-9045-4406-a691-e78ebe982150 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:21.814772 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 941/1888] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:21.825934 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94157ba6-a046-47ef-854c-ae7eee49787f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:21.858251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:21.875552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e77cc-de50-4116-92f7-7571ec89f290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:21.876337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e77cc-de50-4116-92f7-7571ec89f290 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:21.876623 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e77cc-de50-4116-92f7-7571ec89f290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:21.877020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e77cc-de50-4116-92f7-7571ec89f290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:21.893034 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e77cc-de50-4116-92f7-7571ec89f290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:21.894993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e77cc-de50-4116-92f7-7571ec89f290 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:21.924606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 948/1889] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:21.988897 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94157ba6-a046-47ef-854c-ae7eee49787f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:22.002210 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f755e-b16b-4b44-b0bb-7cead1f59c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:22.003017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f755e-b16b-4b44-b0bb-7cead1f59c8b service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:22.003426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f755e-b16b-4b44-b0bb-7cead1f59c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:22.003816 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f755e-b16b-4b44-b0bb-7cead1f59c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:22.039424 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f755e-b16b-4b44-b0bb-7cead1f59c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:22.044066 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f755e-b16b-4b44-b0bb-7cead1f59c8b service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:22.081458 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 942/1890] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:09:22.899327 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e77cc-de50-4116-92f7-7571ec89f290 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:22.901805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-eb6e77cc-de50-4116-92f7-7571ec89f290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:22.928929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e77cc-de50-4116-92f7-7571ec89f290 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:22.958736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636852a3-daa7-4a10-af0e-274524ee1eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:22.960878 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636852a3-daa7-4a10-af0e-274524ee1eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:22.961549 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636852a3-daa7-4a10-af0e-274524ee1eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:22.962845 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636852a3-daa7-4a10-af0e-274524ee1eb1 admin admin] PATH_INFO: `/v3/projects/5a267a83c5a049cc89bbe9fd7597a6d9` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:22.967808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636852a3-daa7-4a10-af0e-274524ee1eb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a267a83c5a049cc89bbe9fd7597a6d9)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:22.970611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636852a3-daa7-4a10-af0e-274524ee1eb1 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:23.001645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f755e-b16b-4b44-b0bb-7cead1f59c8b service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:23.006650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-600f755e-b16b-4b44-b0bb-7cead1f59c8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:23.046512 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f755e-b16b-4b44-b0bb-7cead1f59c8b service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:23.065320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ca84d-c88c-42c1-b0e9-6a8137afadb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:23.066308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ca84d-c88c-42c1-b0e9-6a8137afadb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:23.066723 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ca84d-c88c-42c1-b0e9-6a8137afadb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:23.066921 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ca84d-c88c-42c1-b0e9-6a8137afadb3 admin admin] PATH_INFO: `/v3/projects/6c0a3c915a54444e9ce10d8607482d91` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:23.070081 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ca84d-c88c-42c1-b0e9-6a8137afadb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c0a3c915a54444e9ce10d8607482d91)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:23.075507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ca84d-c88c-42c1-b0e9-6a8137afadb3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:23.134341 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-636852a3-daa7-4a10-af0e-274524ee1eb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a267a83c5a049cc89bbe9fd7597a6d9', 'request_id': 'req-636852a3-daa7-4a10-af0e-274524ee1eb1'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:23.154360 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-636852a3-daa7-4a10-af0e-274524ee1eb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a267a83c5a049cc89bbe9fd7597a6d9', 'request_id': 'req-636852a3-daa7-4a10-af0e-274524ee1eb1'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:23.157932 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:23.164573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-636852a3-daa7-4a10-af0e-274524ee1eb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a267a83c5a049cc89bbe9fd7597a6d9', 'request_id': 'req-636852a3-daa7-4a10-af0e-274524ee1eb1'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:23.191427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-636852a3-daa7-4a10-af0e-274524ee1eb1 admin admin] The token cache is being invalidate because project 5a267a83c5a049cc89bbe9fd7597a6d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:23.191829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-636852a3-daa7-4a10-af0e-274524ee1eb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:23.194364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-636852a3-daa7-4a10-af0e-274524ee1eb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:23.201014 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 949/1891] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:22 2022] DELETE /identity/v3/projects/5a267a83c5a049cc89bbe9fd7597a6d9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:23.201208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f48ca84d-c88c-42c1-b0e9-6a8137afadb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c0a3c915a54444e9ce10d8607482d91', 'request_id': 'req-f48ca84d-c88c-42c1-b0e9-6a8137afadb3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:23.203673 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636852a3-daa7-4a10-af0e-274524ee1eb1 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:23.207492 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-636852a3-daa7-4a10-af0e-274524ee1eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:23.230637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f48ca84d-c88c-42c1-b0e9-6a8137afadb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c0a3c915a54444e9ce10d8607482d91', 'request_id': 'req-f48ca84d-c88c-42c1-b0e9-6a8137afadb3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:23.249759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f48ca84d-c88c-42c1-b0e9-6a8137afadb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c0a3c915a54444e9ce10d8607482d91', 'request_id': 'req-f48ca84d-c88c-42c1-b0e9-6a8137afadb3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:23.295426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f48ca84d-c88c-42c1-b0e9-6a8137afadb3 admin admin] The token cache is being invalidate because project 6c0a3c915a54444e9ce10d8607482d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:23.296011 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f48ca84d-c88c-42c1-b0e9-6a8137afadb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:23.306548 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f48ca84d-c88c-42c1-b0e9-6a8137afadb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:23.308567 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 943/1892] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:23 2022] DELETE /identity/v3/projects/6c0a3c915a54444e9ce10d8607482d91 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:23.314515 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3224da-cd62-4c23-8030-c1521a707df5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:23.315029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3224da-cd62-4c23-8030-c1521a707df5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:23.315478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3224da-cd62-4c23-8030-c1521a707df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:23.359794 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2f3224da-cd62-4c23-8030-c1521a707df5 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:23.363197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2f3224da-cd62-4c23-8030-c1521a707df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:23.468154 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636852a3-daa7-4a10-af0e-274524ee1eb1 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:23.517855 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 944/1893] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:23.524550 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eb9e3-d2a3-4017-ab7c-4542f97fe02b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:23.524684 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eb9e3-d2a3-4017-ab7c-4542f97fe02b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:23.525384 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eb9e3-d2a3-4017-ab7c-4542f97fe02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:23.566280 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-082eb9e3-d2a3-4017-ab7c-4542f97fe02b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:23.568518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-082eb9e3-d2a3-4017-ab7c-4542f97fe02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:23.604144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 945/1894] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:23.609152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eb9e3-d2a3-4017-ab7c-4542f97fe02b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:23.622731 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eb9e3-d2a3-4017-ab7c-4542f97fe02b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:23.631006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01374b-e08f-4fed-924b-27525990510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:23.632684 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01374b-e08f-4fed-924b-27525990510b admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:23.633285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01374b-e08f-4fed-924b-27525990510b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:23.633773 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01374b-e08f-4fed-924b-27525990510b admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:23.637592 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01374b-e08f-4fed-924b-27525990510b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:23.638463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01374b-e08f-4fed-924b-27525990510b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:23.638996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a8f2a-83d3-4d49-b91c-f9b1f3091365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:23.641549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01374b-e08f-4fed-924b-27525990510b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:23.643970 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a8f2a-83d3-4d49-b91c-f9b1f3091365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:23.645420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a8f2a-83d3-4d49-b91c-f9b1f3091365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:23.647089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a8f2a-83d3-4d49-b91c-f9b1f3091365 admin admin] PATH_INFO: `/v3/users/84d24270c5b348e1b234e8dded243c90` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:23.654465 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a8f2a-83d3-4d49-b91c-f9b1f3091365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d24270c5b348e1b234e8dded243c90)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:23.664174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a8f2a-83d3-4d49-b91c-f9b1f3091365 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:23.672195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 946/1895] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:09:23.679846 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01374b-e08f-4fed-924b-27525990510b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:23.703769 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01374b-e08f-4fed-924b-27525990510b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:23.705913 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:23.719956 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cb0c2-990a-469a-996a-10aef1690a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:23.723297 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cb0c2-990a-469a-996a-10aef1690a00 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:23.724368 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cb0c2-990a-469a-996a-10aef1690a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:23.724807 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cb0c2-990a-469a-996a-10aef1690a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:23.726870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cb0c2-990a-469a-996a-10aef1690a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:23.736624 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cb0c2-990a-469a-996a-10aef1690a00 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:23.796906 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a46a8f2a-83d3-4d49-b91c-f9b1f3091365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d24270c5b348e1b234e8dded243c90'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:23.797228 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 947/1896] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:23 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:23.798255 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cb0c2-990a-469a-996a-10aef1690a00 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:23.842861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a46a8f2a-83d3-4d49-b91c-f9b1f3091365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d24270c5b348e1b234e8dded243c90'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:23.843633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a46a8f2a-83d3-4d49-b91c-f9b1f3091365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d24270c5b348e1b234e8dded243c90'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:23.854844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a46a8f2a-83d3-4d49-b91c-f9b1f3091365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d24270c5b348e1b234e8dded243c90'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:23.866837 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a46a8f2a-83d3-4d49-b91c-f9b1f3091365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d24270c5b348e1b234e8dded243c90'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:23.874984 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 950/1897] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:23 2022] DELETE /identity/v3/users/84d24270c5b348e1b234e8dded243c90 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:23.893896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cb0c2-990a-469a-996a-10aef1690a00 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:23.921567 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:23.984449 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b944ce-88df-4709-9749-fa0fa9d9b060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:23.985329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b944ce-88df-4709-9749-fa0fa9d9b060 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:23.985686 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b944ce-88df-4709-9749-fa0fa9d9b060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:23.986069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b944ce-88df-4709-9749-fa0fa9d9b060 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:23.986858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b944ce-88df-4709-9749-fa0fa9d9b060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:23.989082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b944ce-88df-4709-9749-fa0fa9d9b060 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:24.022180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 948/1898] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:23 2022] POST /identity/v3/users => generated 285 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:24.027446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a8f2a-83d3-4d49-b91c-f9b1f3091365 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:24.029220 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a46a8f2a-83d3-4d49-b91c-f9b1f3091365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:24.031194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b944ce-88df-4709-9749-fa0fa9d9b060 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:24.033583 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b0b944ce-88df-4709-9749-fa0fa9d9b060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:24.045725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a8f2a-83d3-4d49-b91c-f9b1f3091365 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:24.051535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b944ce-88df-4709-9749-fa0fa9d9b060 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:24.052001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c71c4a-942d-4c80-98c5-bf4a6f4df3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:24.053400 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c71c4a-942d-4c80-98c5-bf4a6f4df3af admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:24.053924 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c71c4a-942d-4c80-98c5-bf4a6f4df3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:24.054176 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c71c4a-942d-4c80-98c5-bf4a6f4df3af admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:24.055158 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c71c4a-942d-4c80-98c5-bf4a6f4df3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:24.058061 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c71c4a-942d-4c80-98c5-bf4a6f4df3af admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:24.062278 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487b647-3610-4c10-a0ca-c09947bfa4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:24.063750 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487b647-3610-4c10-a0ca-c09947bfa4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:24.063984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487b647-3610-4c10-a0ca-c09947bfa4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:24.064347 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487b647-3610-4c10-a0ca-c09947bfa4f8 admin admin] PATH_INFO: `/v3/users/589878679fb7483286ddf2856e293274` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:24.065895 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487b647-3610-4c10-a0ca-c09947bfa4f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=589878679fb7483286ddf2856e293274)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:24.068100 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487b647-3610-4c10-a0ca-c09947bfa4f8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:24.087697 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 951/1899] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:24.089526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c71c4a-942d-4c80-98c5-bf4a6f4df3af admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:24.105962 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c71c4a-942d-4c80-98c5-bf4a6f4df3af admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:24.112077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a40fa3-8aa5-4cc1-bbff-6c27a4ec1805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:24.113256 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a40fa3-8aa5-4cc1-bbff-6c27a4ec1805 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:24.113943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a40fa3-8aa5-4cc1-bbff-6c27a4ec1805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:24.114890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a40fa3-8aa5-4cc1-bbff-6c27a4ec1805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:24.115794 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a40fa3-8aa5-4cc1-bbff-6c27a4ec1805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:24.117470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a40fa3-8aa5-4cc1-bbff-6c27a4ec1805 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:24.144276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 952/1900] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:09:24.145620 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a40fa3-8aa5-4cc1-bbff-6c27a4ec1805 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:24.157223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a40fa3-8aa5-4cc1-bbff-6c27a4ec1805 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:24.166076 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a8de5-6a61-454b-85a9-12aec5f55ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:24.167788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a8de5-6a61-454b-85a9-12aec5f55ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:24.168288 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a8de5-6a61-454b-85a9-12aec5f55ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:24.168765 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a8de5-6a61-454b-85a9-12aec5f55ed4 admin admin] PATH_INFO: `/v3/projects/b9a1ca7156e94eebb9ff03f9b43ab256/users/b46d6273b1b641fb947a124fc8ea4ae4/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:24.177572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f487b647-3610-4c10-a0ca-c09947bfa4f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589878679fb7483286ddf2856e293274'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:24.178366 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f487b647-3610-4c10-a0ca-c09947bfa4f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589878679fb7483286ddf2856e293274'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:24.192987 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f487b647-3610-4c10-a0ca-c09947bfa4f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589878679fb7483286ddf2856e293274'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:24.194867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a8de5-6a61-454b-85a9-12aec5f55ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a1ca7156e94eebb9ff03f9b43ab256, user_id=b46d6273b1b641fb947a124fc8ea4ae4, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:24.198703 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a8de5-6a61-454b-85a9-12aec5f55ed4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:24.222614 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f487b647-3610-4c10-a0ca-c09947bfa4f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589878679fb7483286ddf2856e293274'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:24.225944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 953/1901] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:24 2022] PUT /identity/v3/projects/b9a1ca7156e94eebb9ff03f9b43ab256/users/b46d6273b1b641fb947a124fc8ea4ae4/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:24.230750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4abb7-1444-4259-925e-9a3d71e84868 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:24.231049 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4abb7-1444-4259-925e-9a3d71e84868 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:24.231331 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4abb7-1444-4259-925e-9a3d71e84868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:24.244868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f487b647-3610-4c10-a0ca-c09947bfa4f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589878679fb7483286ddf2856e293274'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:24.252848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 949/1902] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:24 2022] DELETE /identity/v3/users/589878679fb7483286ddf2856e293274 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:24.257459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bce225-ff46-4641-8834-13d69142ad06 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:24.257751 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bce225-ff46-4641-8834-13d69142ad06 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:24.258073 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bce225-ff46-4641-8834-13d69142ad06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:24.266810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-eed4abb7-1444-4259-925e-9a3d71e84868 None None] MFA Rules not processed for user `b46d6273b1b641fb947a124fc8ea4ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:24.271568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-eed4abb7-1444-4259-925e-9a3d71e84868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:24.286776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-90bce225-ff46-4641-8834-13d69142ad06 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:24.288061 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-90bce225-ff46-4641-8834-13d69142ad06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:24.388102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 950/1903] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:24.389146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bce225-ff46-4641-8834-13d69142ad06 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:24.392067 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-90bce225-ff46-4641-8834-13d69142ad06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:24.398556 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 954/1904] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:24.399772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4abb7-1444-4259-925e-9a3d71e84868 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:24.401698 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-eed4abb7-1444-4259-925e-9a3d71e84868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:24.405282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bce225-ff46-4641-8834-13d69142ad06 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:24.411470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:24.412403 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:24.412691 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:24.412970 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6 admin admin] PATH_INFO: `/v3/projects/5ca5a4e138d84f3d8eca22ad9affc9dd` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:24.414495 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca5a4e138d84f3d8eca22ad9affc9dd)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:24.416650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:24.448883 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:24.453446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:24.477342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4abb7-1444-4259-925e-9a3d71e84868 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:24.483358 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca5a4e138d84f3d8eca22ad9affc9dd', 'request_id': 'req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:24.494271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca5a4e138d84f3d8eca22ad9affc9dd', 'request_id': 'req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:24.502922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca5a4e138d84f3d8eca22ad9affc9dd', 'request_id': 'req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:24.529856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6 admin admin] The token cache is being invalidate because project 5ca5a4e138d84f3d8eca22ad9affc9dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:24.530152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:24.530857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:24.532720 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 951/1905] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:24 2022] DELETE /identity/v3/projects/5ca5a4e138d84f3d8eca22ad9affc9dd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:24.533312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:24.534685 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:24.563949 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed656e1-25c3-4105-9502-0a8b5837561e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:24.564785 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed656e1-25c3-4105-9502-0a8b5837561e service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:24.565075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed656e1-25c3-4105-9502-0a8b5837561e service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:24.565494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed656e1-25c3-4105-9502-0a8b5837561e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:24.567532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3ed656e1-25c3-4105-9502-0a8b5837561e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:24.621555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a466f9-03ea-40bd-8e4d-4eb385c0dda6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:24.626411 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0e158-6e68-4781-8aca-5e7467081370 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7e1c8c42cd4f6dab8b27829e5fc5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:24.627325 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0e158-6e68-4781-8aca-5e7467081370 service glance] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:24.629698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0e158-6e68-4781-8aca-5e7467081370 service glance] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:24.629847 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0e158-6e68-4781-8aca-5e7467081370 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:24.631982 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-29e0e158-6e68-4781-8aca-5e7467081370 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:24.735377 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed656e1-25c3-4105-9502-0a8b5837561e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:24.736887 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed656e1-25c3-4105-9502-0a8b5837561e service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:24.771461 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 955/1906] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:24.782976 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0e158-6e68-4781-8aca-5e7467081370 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:24.784438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0e158-6e68-4781-8aca-5e7467081370 service glance] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:24.785138 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af95b1-7efc-454b-8a6a-1f0f2e8ee8fd None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:24.786618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af95b1-7efc-454b-8a6a-1f0f2e8ee8fd None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:24.787244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af95b1-7efc-454b-8a6a-1f0f2e8ee8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:24.809507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 952/1907] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:24.833723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d3af95b1-7efc-454b-8a6a-1f0f2e8ee8fd None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:24.838118 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d3af95b1-7efc-454b-8a6a-1f0f2e8ee8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:24.874108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 956/1908] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:24.885117 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307ec6-05aa-47f0-9c67-5e02f113e9d2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:24.885435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307ec6-05aa-47f0-9c67-5e02f113e9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:24.885710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307ec6-05aa-47f0-9c67-5e02f113e9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:24.929512 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b6307ec6-05aa-47f0-9c67-5e02f113e9d2 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:24.933541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b6307ec6-05aa-47f0-9c67-5e02f113e9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:24.947635 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 953/1909] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:24.952647 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af95b1-7efc-454b-8a6a-1f0f2e8ee8fd None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:24.968990 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af95b1-7efc-454b-8a6a-1f0f2e8ee8fd None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:24.985507 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4da1e-040f-4f5b-9f56-dd6a492f7e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:24.986320 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4da1e-040f-4f5b-9f56-dd6a492f7e5c admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:24.986609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4da1e-040f-4f5b-9f56-dd6a492f7e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:24.986933 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4da1e-040f-4f5b-9f56-dd6a492f7e5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:24.987688 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae4da1e-040f-4f5b-9f56-dd6a492f7e5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:24.988179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae4da1e-040f-4f5b-9f56-dd6a492f7e5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:24.989916 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae4da1e-040f-4f5b-9f56-dd6a492f7e5c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:25.061695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 957/1910] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:25.066700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6307ec6-05aa-47f0-9c67-5e02f113e9d2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:25.067225 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4da1e-040f-4f5b-9f56-dd6a492f7e5c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:25.070321 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fae4da1e-040f-4f5b-9f56-dd6a492f7e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:25.078576 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6307ec6-05aa-47f0-9c67-5e02f113e9d2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:25.094341 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ae8d5-f99f-4c7f-96ac-06cb838015d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:25.095522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ae8d5-f99f-4c7f-96ac-06cb838015d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:25.095522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ae8d5-f99f-4c7f-96ac-06cb838015d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:25.095761 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ae8d5-f99f-4c7f-96ac-06cb838015d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:25.097037 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ae8d5-f99f-4c7f-96ac-06cb838015d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:25.101659 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ae8d5-f99f-4c7f-96ac-06cb838015d4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:25.110434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4da1e-040f-4f5b-9f56-dd6a492f7e5c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:25.124500 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64af9c-e163-4066-ba3f-241f095bc5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:25.125436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64af9c-e163-4066-ba3f-241f095bc5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:25.125725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64af9c-e163-4066-ba3f-241f095bc5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:25.126035 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64af9c-e163-4066-ba3f-241f095bc5cc admin admin] PATH_INFO: `/v3/users/48bba2babf784fc49e67ec41f3c1b5d8` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:25.131817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64af9c-e163-4066-ba3f-241f095bc5cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=48bba2babf784fc49e67ec41f3c1b5d8)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:25.140610 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64af9c-e163-4066-ba3f-241f095bc5cc admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:25.189518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 954/1911] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:25 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:25.198671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ae8d5-f99f-4c7f-96ac-06cb838015d4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:25.282252 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-bb64af9c-e163-4066-ba3f-241f095bc5cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48bba2babf784fc49e67ec41f3c1b5d8'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:25.315777 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-bb64af9c-e163-4066-ba3f-241f095bc5cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48bba2babf784fc49e67ec41f3c1b5d8'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:25.316713 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-bb64af9c-e163-4066-ba3f-241f095bc5cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48bba2babf784fc49e67ec41f3c1b5d8'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:25.334981 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-bb64af9c-e163-4066-ba3f-241f095bc5cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48bba2babf784fc49e67ec41f3c1b5d8'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:25.342772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:25.348327 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:25.351134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-bb64af9c-e163-4066-ba3f-241f095bc5cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48bba2babf784fc49e67ec41f3c1b5d8'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:25.367521 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 958/1912] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:25 2022] DELETE /identity/v3/users/48bba2babf784fc49e67ec41f3c1b5d8 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:25.369845 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f089d6-6834-4d3a-a346-e0d6c5f5cf16 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:25.370231 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f089d6-6834-4d3a-a346-e0d6c5f5cf16 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:25.370611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f089d6-6834-4d3a-a346-e0d6c5f5cf16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:25.420695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-14f089d6-6834-4d3a-a346-e0d6c5f5cf16 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:25.423203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-14f089d6-6834-4d3a-a346-e0d6c5f5cf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:25.446285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ae8d5-f99f-4c7f-96ac-06cb838015d4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:25.573538 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 959/1913] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:25.649174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd78ce-8035-43bd-a4f6-88c4e224dc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:25.650132 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd78ce-8035-43bd-a4f6-88c4e224dc89 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:25.651215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd78ce-8035-43bd-a4f6-88c4e224dc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:25.653986 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd78ce-8035-43bd-a4f6-88c4e224dc89 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:25.655025 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd78ce-8035-43bd-a4f6-88c4e224dc89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:25.657908 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd78ce-8035-43bd-a4f6-88c4e224dc89 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:25.679498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f089d6-6834-4d3a-a346-e0d6c5f5cf16 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:25.683602 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-14f089d6-6834-4d3a-a346-e0d6c5f5cf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:25.713092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 955/1914] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:25 2022] POST /identity/v3/users => generated 287 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:25.715726 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd78ce-8035-43bd-a4f6-88c4e224dc89 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:25.719082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b7fd78ce-8035-43bd-a4f6-88c4e224dc89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:25.750995 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd78ce-8035-43bd-a4f6-88c4e224dc89 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:25.779095 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e919c5-24b3-4c02-af1c-e813772bb596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:25.784154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e919c5-24b3-4c02-af1c-e813772bb596 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:25.784154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e919c5-24b3-4c02-af1c-e813772bb596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:25.784154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e919c5-24b3-4c02-af1c-e813772bb596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:25.788125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e919c5-24b3-4c02-af1c-e813772bb596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:25.818198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e919c5-24b3-4c02-af1c-e813772bb596 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:25.849708 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 956/1915] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:25.855702 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e919c5-24b3-4c02-af1c-e813772bb596 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:25.872064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e919c5-24b3-4c02-af1c-e813772bb596 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:25.888333 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83bba4-ff02-4979-8669-b41ff51c4006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:25.889044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83bba4-ff02-4979-8669-b41ff51c4006 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:25.891557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83bba4-ff02-4979-8669-b41ff51c4006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:25.891852 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83bba4-ff02-4979-8669-b41ff51c4006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:25.895755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83bba4-ff02-4979-8669-b41ff51c4006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:25.912279 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83bba4-ff02-4979-8669-b41ff51c4006 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:25.912739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f089d6-6834-4d3a-a346-e0d6c5f5cf16 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:25.925936 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21f4e8-c260-4b5e-b627-0e394fa73a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:25.927124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21f4e8-c260-4b5e-b627-0e394fa73a82 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:25.927626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21f4e8-c260-4b5e-b627-0e394fa73a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:25.928108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21f4e8-c260-4b5e-b627-0e394fa73a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:25.934708 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 957/1916] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:09:25.948607 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83bba4-ff02-4979-8669-b41ff51c4006 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:25.965720 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83bba4-ff02-4979-8669-b41ff51c4006 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:25.972247 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb56e38-7cf9-428b-a3da-ca8546170d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:25.973868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb56e38-7cf9-428b-a3da-ca8546170d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:25.973868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb56e38-7cf9-428b-a3da-ca8546170d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:25.973868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb56e38-7cf9-428b-a3da-ca8546170d8f admin admin] PATH_INFO: `/v3/projects/8ea8fe39137148ae85a41a1afc93965d/users/379e86abfe2e4955a822c313a5dda472/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:25.975905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21f4e8-c260-4b5e-b627-0e394fa73a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:25.983006 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21f4e8-c260-4b5e-b627-0e394fa73a82 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:25.995400 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb56e38-7cf9-428b-a3da-ca8546170d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea8fe39137148ae85a41a1afc93965d, user_id=379e86abfe2e4955a822c313a5dda472, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:25.999477 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb56e38-7cf9-428b-a3da-ca8546170d8f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:26.031593 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 958/1917] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:25 2022] PUT /identity/v3/projects/8ea8fe39137148ae85a41a1afc93965d/users/379e86abfe2e4955a822c313a5dda472/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:26.034922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 960/1918] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:26.045086 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15517cc9-4bf1-4670-8f80-37f861482cf4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:26.046234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15517cc9-4bf1-4670-8f80-37f861482cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:26.046775 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15517cc9-4bf1-4670-8f80-37f861482cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:26.113160 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-15517cc9-4bf1-4670-8f80-37f861482cf4 None None] MFA Rules not processed for user `379e86abfe2e4955a822c313a5dda472`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:26.114559 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-15517cc9-4bf1-4670-8f80-37f861482cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:26.202790 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 959/1919] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:26.207517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21f4e8-c260-4b5e-b627-0e394fa73a82 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:26.221263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21f4e8-c260-4b5e-b627-0e394fa73a82 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:26.336846 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc93d9-74c6-4b03-828f-00debbcf92b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:26.338034 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc93d9-74c6-4b03-828f-00debbcf92b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:26.338793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc93d9-74c6-4b03-828f-00debbcf92b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:26.339151 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc93d9-74c6-4b03-828f-00debbcf92b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:26.340092 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc93d9-74c6-4b03-828f-00debbcf92b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:26.345183 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc93d9-74c6-4b03-828f-00debbcf92b0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:26.390085 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15517cc9-4bf1-4670-8f80-37f861482cf4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:26.392053 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-15517cc9-4bf1-4670-8f80-37f861482cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:26.408476 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 961/1920] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:26 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:26.412671 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc93d9-74c6-4b03-828f-00debbcf92b0 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:26.432150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15517cc9-4bf1-4670-8f80-37f861482cf4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:26.471481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:26.481951 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:26.547639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc93d9-74c6-4b03-828f-00debbcf92b0 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:26.554441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ac43d-02aa-4034-929f-fddcfa2e5975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:26.555265 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ac43d-02aa-4034-929f-fddcfa2e5975 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:26.556397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ac43d-02aa-4034-929f-fddcfa2e5975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:26.556806 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ac43d-02aa-4034-929f-fddcfa2e5975 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:26.557831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ac43d-02aa-4034-929f-fddcfa2e5975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:26.561404 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ac43d-02aa-4034-929f-fddcfa2e5975 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:26.572907 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37f892-8539-433c-b518-d0caff10d991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:26.578245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37f892-8539-433c-b518-d0caff10d991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:26.580511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37f892-8539-433c-b518-d0caff10d991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:26.581349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37f892-8539-433c-b518-d0caff10d991 admin admin] PATH_INFO: `/v3/projects/f8ad433800bc4dab85a11087b7da41a8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:26.583727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37f892-8539-433c-b518-d0caff10d991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ad433800bc4dab85a11087b7da41a8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:26.592251 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37f892-8539-433c-b518-d0caff10d991 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:26.598946 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 962/1921] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:26 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:26.602958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ac43d-02aa-4034-929f-fddcfa2e5975 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:26.623337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ac43d-02aa-4034-929f-fddcfa2e5975 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:26.630095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a1e50-e55a-4406-8669-e964622ac0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:26.631102 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a1e50-e55a-4406-8669-e964622ac0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:26.632624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a1e50-e55a-4406-8669-e964622ac0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:26.632951 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a1e50-e55a-4406-8669-e964622ac0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:26.633902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a1e50-e55a-4406-8669-e964622ac0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:26.636801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a1e50-e55a-4406-8669-e964622ac0e5 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:26.681638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 963/1922] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:09:26.691717 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a1e50-e55a-4406-8669-e964622ac0e5 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:26.733623 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a1e50-e55a-4406-8669-e964622ac0e5 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:26.742031 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6696cbd-435d-4765-9351-edcccebbb424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:26.743637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6696cbd-435d-4765-9351-edcccebbb424 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:26.744224 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6696cbd-435d-4765-9351-edcccebbb424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:26.744702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6696cbd-435d-4765-9351-edcccebbb424 admin admin] PATH_INFO: `/v3/projects/f460f42bbc964b789ba11b46187e8576/users/e0ea56332f344c5b8eae3a45600538a7/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:26.802723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6696cbd-435d-4765-9351-edcccebbb424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f460f42bbc964b789ba11b46187e8576, user_id=e0ea56332f344c5b8eae3a45600538a7, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:26.808319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6696cbd-435d-4765-9351-edcccebbb424 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:26.859831 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1e37f892-8539-433c-b518-d0caff10d991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ad433800bc4dab85a11087b7da41a8', 'request_id': 'req-1e37f892-8539-433c-b518-d0caff10d991'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:26.872096 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 964/1923] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:26 2022] PUT /identity/v3/projects/f460f42bbc964b789ba11b46187e8576/users/e0ea56332f344c5b8eae3a45600538a7/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:26.877031 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6696cbd-435d-4765-9351-edcccebbb424 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:26.884758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1e37f892-8539-433c-b518-d0caff10d991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ad433800bc4dab85a11087b7da41a8', 'request_id': 'req-1e37f892-8539-433c-b518-d0caff10d991'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:26.904300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1e37f892-8539-433c-b518-d0caff10d991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ad433800bc4dab85a11087b7da41a8', 'request_id': 'req-1e37f892-8539-433c-b518-d0caff10d991'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:26.958253 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1e37f892-8539-433c-b518-d0caff10d991 admin admin] The token cache is being invalidate because project f8ad433800bc4dab85a11087b7da41a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:26.960472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1e37f892-8539-433c-b518-d0caff10d991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:26.962560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1e37f892-8539-433c-b518-d0caff10d991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:26.971370 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 960/1924] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:26 2022] DELETE /identity/v3/projects/f8ad433800bc4dab85a11087b7da41a8 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:26.979011 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37f892-8539-433c-b518-d0caff10d991 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:26.982381 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1e37f892-8539-433c-b518-d0caff10d991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:27.078071 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6696cbd-435d-4765-9351-edcccebbb424 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:27.085209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f84e5-44b2-4637-88d2-db7c8f1d7b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:27.086195 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f84e5-44b2-4637-88d2-db7c8f1d7b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:27.086584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f84e5-44b2-4637-88d2-db7c8f1d7b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:27.086964 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f84e5-44b2-4637-88d2-db7c8f1d7b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:27.089964 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f84e5-44b2-4637-88d2-db7c8f1d7b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:27.090600 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f84e5-44b2-4637-88d2-db7c8f1d7b7b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:27.105257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 965/1925] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:09:27.105699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f84e5-44b2-4637-88d2-db7c8f1d7b7b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:27.107830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ce1f84e5-44b2-4637-88d2-db7c8f1d7b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:27.109213 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37f892-8539-433c-b518-d0caff10d991 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:27.120512 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa140f-9b22-4c59-9c1b-c1f5cf5e53ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:27.122151 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa140f-9b22-4c59-9c1b-c1f5cf5e53ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:27.122727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa140f-9b22-4c59-9c1b-c1f5cf5e53ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:27.123152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa140f-9b22-4c59-9c1b-c1f5cf5e53ee admin admin] PATH_INFO: `/v3/users/af93fc67263d4a1ca1d4ba85c6e3f142` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:27.124869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa140f-9b22-4c59-9c1b-c1f5cf5e53ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=af93fc67263d4a1ca1d4ba85c6e3f142)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:27.125659 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f84e5-44b2-4637-88d2-db7c8f1d7b7b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:27.127745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa140f-9b22-4c59-9c1b-c1f5cf5e53ee admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:27.143694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:27.144805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:27.145250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:27.145600 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77 admin admin] PATH_INFO: `/v3/projects/d40d49aef7a24f1a8cada034dd4b9269` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:27.148464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d40d49aef7a24f1a8cada034dd4b9269)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:27.149330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:27.232607 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40d49aef7a24f1a8cada034dd4b9269', 'request_id': 'req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:27.234407 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-beaa140f-9b22-4c59-9c1b-c1f5cf5e53ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af93fc67263d4a1ca1d4ba85c6e3f142'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:27.235081 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-beaa140f-9b22-4c59-9c1b-c1f5cf5e53ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af93fc67263d4a1ca1d4ba85c6e3f142'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:27.237220 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:27.242315 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40d49aef7a24f1a8cada034dd4b9269', 'request_id': 'req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:27.251113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40d49aef7a24f1a8cada034dd4b9269', 'request_id': 'req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:27.257443 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-beaa140f-9b22-4c59-9c1b-c1f5cf5e53ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af93fc67263d4a1ca1d4ba85c6e3f142'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:27.262720 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:27.268389 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77 admin admin] The token cache is being invalidate because project d40d49aef7a24f1a8cada034dd4b9269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:27.268934 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:27.270547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:27.272291 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 966/1926] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:27 2022] DELETE /identity/v3/projects/d40d49aef7a24f1a8cada034dd4b9269 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:27.275318 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:27.275318 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:27.279260 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-beaa140f-9b22-4c59-9c1b-c1f5cf5e53ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af93fc67263d4a1ca1d4ba85c6e3f142'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:27.286979 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-beaa140f-9b22-4c59-9c1b-c1f5cf5e53ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af93fc67263d4a1ca1d4ba85c6e3f142'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:27.295555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 961/1927] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:26 2022] DELETE /identity/v3/users/af93fc67263d4a1ca1d4ba85c6e3f142 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:27.295555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa140f-9b22-4c59-9c1b-c1f5cf5e53ee admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:27.296976 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-beaa140f-9b22-4c59-9c1b-c1f5cf5e53ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:27.353242 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16f6bc-32d4-4ab9-bc72-05d5a203bd77 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:27.384630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa140f-9b22-4c59-9c1b-c1f5cf5e53ee admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:27.389912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9c888-46e6-45ca-8e69-7a1f1603c00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:27.390851 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9c888-46e6-45ca-8e69-7a1f1603c00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:27.391129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9c888-46e6-45ca-8e69-7a1f1603c00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:27.391428 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9c888-46e6-45ca-8e69-7a1f1603c00c admin admin] PATH_INFO: `/v3/users/73e0629ca66e462fbc505cd08bfa9ecf` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:27.392647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9c888-46e6-45ca-8e69-7a1f1603c00c admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e0629ca66e462fbc505cd08bfa9ecf)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:27.394632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9c888-46e6-45ca-8e69-7a1f1603c00c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:27.428435 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72772ba6-61bc-490f-82fe-3bf766d14554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:27.429424 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72772ba6-61bc-490f-82fe-3bf766d14554 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:27.429713 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72772ba6-61bc-490f-82fe-3bf766d14554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:27.430025 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72772ba6-61bc-490f-82fe-3bf766d14554 admin admin] PATH_INFO: `/v3/projects/f460f42bbc964b789ba11b46187e8576/users/e0ea56332f344c5b8eae3a45600538a7/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:27.433024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72772ba6-61bc-490f-82fe-3bf766d14554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f460f42bbc964b789ba11b46187e8576, user_id=e0ea56332f344c5b8eae3a45600538a7, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:27.438267 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72772ba6-61bc-490f-82fe-3bf766d14554 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:27.455148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 967/1928] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:27 2022] PUT /identity/v3/projects/f460f42bbc964b789ba11b46187e8576/users/e0ea56332f344c5b8eae3a45600538a7/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:27.470134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb87d6e-de85-4ea5-ab87-7c0c680e05c4 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:27.470481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb87d6e-de85-4ea5-ab87-7c0c680e05c4 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:27.470800 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb87d6e-de85-4ea5-ab87-7c0c680e05c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:27.489013 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-24e9c888-46e6-45ca-8e69-7a1f1603c00c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e0629ca66e462fbc505cd08bfa9ecf'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:27.495452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-24e9c888-46e6-45ca-8e69-7a1f1603c00c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e0629ca66e462fbc505cd08bfa9ecf'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:27.510367 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-24e9c888-46e6-45ca-8e69-7a1f1603c00c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e0629ca66e462fbc505cd08bfa9ecf'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:27.513350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-deb87d6e-de85-4ea5-ab87-7c0c680e05c4 None None] MFA Rules not processed for user `e0ea56332f344c5b8eae3a45600538a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:27.514790 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-deb87d6e-de85-4ea5-ab87-7c0c680e05c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:27.533181 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-24e9c888-46e6-45ca-8e69-7a1f1603c00c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e0629ca66e462fbc505cd08bfa9ecf'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:27.541668 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-24e9c888-46e6-45ca-8e69-7a1f1603c00c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e0629ca66e462fbc505cd08bfa9ecf'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:27.552484 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 962/1929] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:27 2022] DELETE /identity/v3/users/73e0629ca66e462fbc505cd08bfa9ecf => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:27.613941 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 968/1930] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:27.625937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9c888-46e6-45ca-8e69-7a1f1603c00c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:27.627466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-24e9c888-46e6-45ca-8e69-7a1f1603c00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:27.668717 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb87d6e-de85-4ea5-ab87-7c0c680e05c4 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:27.671482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-deb87d6e-de85-4ea5-ab87-7c0c680e05c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:27.724378 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:27.724806 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:27.752373 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9c888-46e6-45ca-8e69-7a1f1603c00c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:27.771808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64c749-62a2-49b5-9cfd-4d814c08cf5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:27.772754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64c749-62a2-49b5-9cfd-4d814c08cf5b service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:27.773208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64c749-62a2-49b5-9cfd-4d814c08cf5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:27.773632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64c749-62a2-49b5-9cfd-4d814c08cf5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:27.778905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0a64c749-62a2-49b5-9cfd-4d814c08cf5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:27.813000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb87d6e-de85-4ea5-ab87-7c0c680e05c4 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:27.892111 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64c749-62a2-49b5-9cfd-4d814c08cf5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:27.894574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64c749-62a2-49b5-9cfd-4d814c08cf5b service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:27.913263 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 963/1931] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:27.915290 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2afceb-6f40-4791-9c00-a1164c830a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:27.916808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2afceb-6f40-4791-9c00-a1164c830a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:27.917395 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2afceb-6f40-4791-9c00-a1164c830a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:27.917503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2afceb-6f40-4791-9c00-a1164c830a06 admin admin] PATH_INFO: `/v3/projects/84d4fdd353514b879acfc1cea2e53ad2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:27.918984 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2afceb-6f40-4791-9c00-a1164c830a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84d4fdd353514b879acfc1cea2e53ad2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:27.921272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2afceb-6f40-4791-9c00-a1164c830a06 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:28.003212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ee2afceb-6f40-4791-9c00-a1164c830a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84d4fdd353514b879acfc1cea2e53ad2', 'request_id': 'req-ee2afceb-6f40-4791-9c00-a1164c830a06'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:28.021018 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ee2afceb-6f40-4791-9c00-a1164c830a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84d4fdd353514b879acfc1cea2e53ad2', 'request_id': 'req-ee2afceb-6f40-4791-9c00-a1164c830a06'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:28.027950 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ee2afceb-6f40-4791-9c00-a1164c830a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84d4fdd353514b879acfc1cea2e53ad2', 'request_id': 'req-ee2afceb-6f40-4791-9c00-a1164c830a06'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:28.054406 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ee2afceb-6f40-4791-9c00-a1164c830a06 admin admin] The token cache is being invalidate because project 84d4fdd353514b879acfc1cea2e53ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:28.054697 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ee2afceb-6f40-4791-9c00-a1164c830a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:28.055375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ee2afceb-6f40-4791-9c00-a1164c830a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:28.061833 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 969/1932] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:27 2022] DELETE /identity/v3/projects/84d4fdd353514b879acfc1cea2e53ad2 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:28.066461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9443044-673d-4617-87ba-06ea7886be35 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:28.067179 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9443044-673d-4617-87ba-06ea7886be35 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:28.067597 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9443044-673d-4617-87ba-06ea7886be35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:28.114510 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d9443044-673d-4617-87ba-06ea7886be35 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:28.117911 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d9443044-673d-4617-87ba-06ea7886be35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:28.327674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 964/1933] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:28.337230 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386a061-614c-4da5-ac5a-1f6b21a15a3c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:28.337842 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386a061-614c-4da5-ac5a-1f6b21a15a3c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:28.338454 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386a061-614c-4da5-ac5a-1f6b21a15a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:28.409502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9443044-673d-4617-87ba-06ea7886be35 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:28.411107 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d9443044-673d-4617-87ba-06ea7886be35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:28.430183 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9443044-673d-4617-87ba-06ea7886be35 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:28.442558 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3386a061-614c-4da5-ac5a-1f6b21a15a3c None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:28.451773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3386a061-614c-4da5-ac5a-1f6b21a15a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:28.459074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fa179-de17-413d-b837-dd613661da96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:28.460663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fa179-de17-413d-b837-dd613661da96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:28.462085 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fa179-de17-413d-b837-dd613661da96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:28.464787 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fa179-de17-413d-b837-dd613661da96 admin admin] PATH_INFO: `/v3/projects/a552f0b15bf448af82d4e4d1544e46b3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:28.468155 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fa179-de17-413d-b837-dd613661da96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a552f0b15bf448af82d4e4d1544e46b3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:28.470413 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fa179-de17-413d-b837-dd613661da96 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:28.490770 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 970/1934] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:28.498696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386a061-614c-4da5-ac5a-1f6b21a15a3c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:28.533434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386a061-614c-4da5-ac5a-1f6b21a15a3c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:28.540565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3829ce-1c2b-489c-bc25-c30325d33263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:28.541939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3829ce-1c2b-489c-bc25-c30325d33263 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:28.542480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3829ce-1c2b-489c-bc25-c30325d33263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:28.542926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3829ce-1c2b-489c-bc25-c30325d33263 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:28.543842 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3829ce-1c2b-489c-bc25-c30325d33263 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:28.544146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3829ce-1c2b-489c-bc25-c30325d33263 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:28.545970 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3829ce-1c2b-489c-bc25-c30325d33263 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:28.583805 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0d7fa179-de17-413d-b837-dd613661da96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a552f0b15bf448af82d4e4d1544e46b3', 'request_id': 'req-0d7fa179-de17-413d-b837-dd613661da96'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:28.585848 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 971/1935] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:28.585848 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3829ce-1c2b-489c-bc25-c30325d33263 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:28.613778 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0d7fa179-de17-413d-b837-dd613661da96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a552f0b15bf448af82d4e4d1544e46b3', 'request_id': 'req-0d7fa179-de17-413d-b837-dd613661da96'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:28.619226 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3829ce-1c2b-489c-bc25-c30325d33263 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:28.637083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0d7fa179-de17-413d-b837-dd613661da96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a552f0b15bf448af82d4e4d1544e46b3', 'request_id': 'req-0d7fa179-de17-413d-b837-dd613661da96'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:28.663286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0d7fa179-de17-413d-b837-dd613661da96 admin admin] The token cache is being invalidate because project a552f0b15bf448af82d4e4d1544e46b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:28.663587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0d7fa179-de17-413d-b837-dd613661da96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:28.664723 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0d7fa179-de17-413d-b837-dd613661da96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:28.674525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 965/1936] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:28 2022] DELETE /identity/v3/projects/a552f0b15bf448af82d4e4d1544e46b3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:28.676091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40889813-f4a0-4e93-a43a-7dcc5f2351a2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:28.676382 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40889813-f4a0-4e93-a43a-7dcc5f2351a2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:28.676677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40889813-f4a0-4e93-a43a-7dcc5f2351a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:28.718793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:28.726686 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-40889813-f4a0-4e93-a43a-7dcc5f2351a2 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:28.728018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-40889813-f4a0-4e93-a43a-7dcc5f2351a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:28.737629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e1b91-d2e9-479b-972e-26130d279791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:28.738941 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e1b91-d2e9-479b-972e-26130d279791 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:28.739544 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e1b91-d2e9-479b-972e-26130d279791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:28.740166 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e1b91-d2e9-479b-972e-26130d279791 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:28.741695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e1b91-d2e9-479b-972e-26130d279791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:28.745493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e1b91-d2e9-479b-972e-26130d279791 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:28.755218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:28.794757 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 972/1937] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:28 2022] POST /identity/v3/projects => generated 369 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:28.801877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e1b91-d2e9-479b-972e-26130d279791 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:28.802272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-107e1b91-d2e9-479b-972e-26130d279791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:28.822402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 966/1938] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:28.831644 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c1dd4-3479-4848-af07-f823c23a3fad None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:28.832037 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c1dd4-3479-4848-af07-f823c23a3fad None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:28.832262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c1dd4-3479-4848-af07-f823c23a3fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:28.855443 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-223c1dd4-3479-4848-af07-f823c23a3fad None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:28.858387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-223c1dd4-3479-4848-af07-f823c23a3fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:28.921637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e1b91-d2e9-479b-972e-26130d279791 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:28.926516 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ab1b5-9bb7-421a-9e35-1e7df01f9ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:28.927254 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ab1b5-9bb7-421a-9e35-1e7df01f9ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:28.927821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ab1b5-9bb7-421a-9e35-1e7df01f9ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:28.928026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ab1b5-9bb7-421a-9e35-1e7df01f9ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:28.928743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ab1b5-9bb7-421a-9e35-1e7df01f9ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:28.930839 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ab1b5-9bb7-421a-9e35-1e7df01f9ec9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:28.959218 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 973/1939] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:28 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:28.961863 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 967/1940] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:28.967600 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ab1b5-9bb7-421a-9e35-1e7df01f9ec9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:28.967875 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c1dd4-3479-4848-af07-f823c23a3fad None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:28.988777 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c1dd4-3479-4848-af07-f823c23a3fad None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:28.999146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cada8a-f27d-45bd-b437-4b1d1400c7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:29.000469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cada8a-f27d-45bd-b437-4b1d1400c7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:29.001096 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cada8a-f27d-45bd-b437-4b1d1400c7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:29.002075 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cada8a-f27d-45bd-b437-4b1d1400c7d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:29.003418 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ab1b5-9bb7-421a-9e35-1e7df01f9ec9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:29.003924 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cada8a-f27d-45bd-b437-4b1d1400c7d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:29.005130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cada8a-f27d-45bd-b437-4b1d1400c7d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:29.008176 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cada8a-f27d-45bd-b437-4b1d1400c7d0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:29.013625 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d99ea6-902d-48df-9eb0-be5b80b876ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:29.014927 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99ea6-902d-48df-9eb0-be5b80b876ef admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:29.015426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99ea6-902d-48df-9eb0-be5b80b876ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:29.016084 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99ea6-902d-48df-9eb0-be5b80b876ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:29.017633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d99ea6-902d-48df-9eb0-be5b80b876ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:29.022222 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d99ea6-902d-48df-9eb0-be5b80b876ef admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:29.031839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 968/1941] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:29.034072 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cada8a-f27d-45bd-b437-4b1d1400c7d0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:29.046873 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 974/1942] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:29.048209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d99ea6-902d-48df-9eb0-be5b80b876ef admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:29.053372 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cada8a-f27d-45bd-b437-4b1d1400c7d0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:29.063534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d99ea6-902d-48df-9eb0-be5b80b876ef admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:29.066326 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2def0aa-1144-43a6-95ee-4cdb7890c1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:29.068054 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2def0aa-1144-43a6-95ee-4cdb7890c1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:29.068054 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2def0aa-1144-43a6-95ee-4cdb7890c1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:29.068054 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2def0aa-1144-43a6-95ee-4cdb7890c1c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:29.068759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2def0aa-1144-43a6-95ee-4cdb7890c1c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:29.073502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2def0aa-1144-43a6-95ee-4cdb7890c1c0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:29.076364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92166d1d-2fc5-472e-b684-2e3fed9d0fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:29.077047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92166d1d-2fc5-472e-b684-2e3fed9d0fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:29.077322 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92166d1d-2fc5-472e-b684-2e3fed9d0fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:29.078284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92166d1d-2fc5-472e-b684-2e3fed9d0fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:29.081675 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92166d1d-2fc5-472e-b684-2e3fed9d0fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:29.083691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92166d1d-2fc5-472e-b684-2e3fed9d0fe8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:29.106209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 975/1943] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:29.111881 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92166d1d-2fc5-472e-b684-2e3fed9d0fe8 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:29.129383 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92166d1d-2fc5-472e-b684-2e3fed9d0fe8 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:29.130301 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 969/1944] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:29 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:29.135707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2def0aa-1144-43a6-95ee-4cdb7890c1c0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:29.220922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de501eba-2075-41c5-86cc-099895d9d27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:29.222166 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de501eba-2075-41c5-86cc-099895d9d27e admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:29.222442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de501eba-2075-41c5-86cc-099895d9d27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:29.222732 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de501eba-2075-41c5-86cc-099895d9d27e admin admin] PATH_INFO: `/v3/projects/f9d52efcea8145c9862a6a0604c20331/users/c605cfd16b494670b7a3c453a9927d84/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:29.239005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2def0aa-1144-43a6-95ee-4cdb7890c1c0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:29.241769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de501eba-2075-41c5-86cc-099895d9d27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d52efcea8145c9862a6a0604c20331, user_id=c605cfd16b494670b7a3c453a9927d84, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:29.244882 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de501eba-2075-41c5-86cc-099895d9d27e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:29.246031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f7c75-eb64-4105-9875-5558664ba30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:29.246739 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f7c75-eb64-4105-9875-5558664ba30f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:29.247036 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f7c75-eb64-4105-9875-5558664ba30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:29.247307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f7c75-eb64-4105-9875-5558664ba30f admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:29.248257 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f7c75-eb64-4105-9875-5558664ba30f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:29.250811 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f7c75-eb64-4105-9875-5558664ba30f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:29.264920 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 976/1945] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:29 2022] PUT /identity/v3/projects/f9d52efcea8145c9862a6a0604c20331/users/c605cfd16b494670b7a3c453a9927d84/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:29.283190 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0e7d-d996-4408-bd70-0a6b9b69bd95 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:29.283484 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0e7d-d996-4408-bd70-0a6b9b69bd95 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:29.283763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0e7d-d996-4408-bd70-0a6b9b69bd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:29.285665 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 970/1946] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:29 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:09:29.289602 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f7c75-eb64-4105-9875-5558664ba30f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:29.301408 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f7c75-eb64-4105-9875-5558664ba30f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:29.319077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:29.330333 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-bf1b0e7d-d996-4408-bd70-0a6b9b69bd95 None None] MFA Rules not processed for user `c605cfd16b494670b7a3c453a9927d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:29.331679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bf1b0e7d-d996-4408-bd70-0a6b9b69bd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:29.342805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:29.389859 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7046d-1327-4357-8a1d-783a8c2fa667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:29.391579 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7046d-1327-4357-8a1d-783a8c2fa667 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:29.392054 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7046d-1327-4357-8a1d-783a8c2fa667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:29.392485 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7046d-1327-4357-8a1d-783a8c2fa667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:29.394051 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7046d-1327-4357-8a1d-783a8c2fa667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:29.396410 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7046d-1327-4357-8a1d-783a8c2fa667 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:29.416146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 971/1947] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:29.417455 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7046d-1327-4357-8a1d-783a8c2fa667 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:29.423716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 977/1948] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:29.430364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b0e7d-d996-4408-bd70-0a6b9b69bd95 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:29.431419 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7046d-1327-4357-8a1d-783a8c2fa667 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:29.439177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68c433-b671-4654-9735-e0d796c23c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:29.440141 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68c433-b671-4654-9735-e0d796c23c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:29.440454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68c433-b671-4654-9735-e0d796c23c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:29.440736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68c433-b671-4654-9735-e0d796c23c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:29.442396 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68c433-b671-4654-9735-e0d796c23c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:29.444421 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68c433-b671-4654-9735-e0d796c23c18 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:29.445752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b0e7d-d996-4408-bd70-0a6b9b69bd95 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:29.451896 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfd2dc-ed37-4132-ad32-31e20656028c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:29.452599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfd2dc-ed37-4132-ad32-31e20656028c admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:29.453017 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfd2dc-ed37-4132-ad32-31e20656028c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:29.453362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfd2dc-ed37-4132-ad32-31e20656028c admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:29.454187 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfd2dc-ed37-4132-ad32-31e20656028c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:29.456586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfd2dc-ed37-4132-ad32-31e20656028c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:29.458441 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 972/1949] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:29.463024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68c433-b671-4654-9735-e0d796c23c18 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:29.475445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68c433-b671-4654-9735-e0d796c23c18 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:29.482815 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fac3c-8061-4209-af38-cefe390a8251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:29.484082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fac3c-8061-4209-af38-cefe390a8251 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:29.484622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fac3c-8061-4209-af38-cefe390a8251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:29.485122 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fac3c-8061-4209-af38-cefe390a8251 admin admin] PATH_INFO: `/v3/projects/08c6eaca149b45af8d16ce8fe03933d9/users/7d8192299ee44e42905693c27ec25b48/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:29.496304 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 978/1950] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:29 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:29.500666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfd2dc-ed37-4132-ad32-31e20656028c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:29.505629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fac3c-8061-4209-af38-cefe390a8251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c6eaca149b45af8d16ce8fe03933d9, user_id=7d8192299ee44e42905693c27ec25b48, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:29.510515 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fac3c-8061-4209-af38-cefe390a8251 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:29.533622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 973/1951] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:29 2022] PUT /identity/v3/projects/08c6eaca149b45af8d16ce8fe03933d9/users/7d8192299ee44e42905693c27ec25b48/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:29.545601 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ace68e-e319-4366-b577-611b1ccf774b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:29.545917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ace68e-e319-4366-b577-611b1ccf774b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:29.546192 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ace68e-e319-4366-b577-611b1ccf774b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:29.582061 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-60ace68e-e319-4366-b577-611b1ccf774b None None] MFA Rules not processed for user `7d8192299ee44e42905693c27ec25b48`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:29.583517 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-60ace68e-e319-4366-b577-611b1ccf774b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:29.619896 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfd2dc-ed37-4132-ad32-31e20656028c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:29.710173 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac799f-9189-4a6b-b2b9-9710c3b41253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:29.711802 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac799f-9189-4a6b-b2b9-9710c3b41253 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:29.712169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac799f-9189-4a6b-b2b9-9710c3b41253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:29.713004 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac799f-9189-4a6b-b2b9-9710c3b41253 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:29.713905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac799f-9189-4a6b-b2b9-9710c3b41253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:29.716191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac799f-9189-4a6b-b2b9-9710c3b41253 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:29.723314 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 974/1952] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:29.729297 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ace68e-e319-4366-b577-611b1ccf774b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:29.744254 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ace68e-e319-4366-b577-611b1ccf774b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:29.753584 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc985d-1a49-4fab-b368-1107fe81f1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:29.754596 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc985d-1a49-4fab-b368-1107fe81f1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:29.755340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc985d-1a49-4fab-b368-1107fe81f1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:29.755340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc985d-1a49-4fab-b368-1107fe81f1e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:29.756356 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc985d-1a49-4fab-b368-1107fe81f1e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:29.757177 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 979/1953] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:29 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:29.757914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac799f-9189-4a6b-b2b9-9710c3b41253 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:29.765400 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc985d-1a49-4fab-b368-1107fe81f1e0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:29.798441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac799f-9189-4a6b-b2b9-9710c3b41253 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:29.811735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0a759-f387-42da-86a5-2551b91f0a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:29.813132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0a759-f387-42da-86a5-2551b91f0a39 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:29.813132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0a759-f387-42da-86a5-2551b91f0a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:29.813132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0a759-f387-42da-86a5-2551b91f0a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:29.813780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0a759-f387-42da-86a5-2551b91f0a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:29.815817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0a759-f387-42da-86a5-2551b91f0a39 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:29.840742 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 975/1954] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:29 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:29.842661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 980/1955] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:29.845244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc985d-1a49-4fab-b368-1107fe81f1e0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:29.845637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0a759-f387-42da-86a5-2551b91f0a39 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:29.859057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0a759-f387-42da-86a5-2551b91f0a39 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:29.890930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:30.010377 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:30.051562 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc985d-1a49-4fab-b368-1107fe81f1e0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:30.063368 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227abbd2-9b00-4a2d-a8f8-e4205475ddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:30.064391 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227abbd2-9b00-4a2d-a8f8-e4205475ddef admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:30.065687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227abbd2-9b00-4a2d-a8f8-e4205475ddef admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:30.066212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bba9c5-f950-4555-bf5e-6d78b328eebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:30.066816 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227abbd2-9b00-4a2d-a8f8-e4205475ddef admin admin] PATH_INFO: `/v3/projects/6f9b48ecf04a4a719d6dff66ac3a8e78/users/fc8fd52c248b414ca746b1cedf508d48/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:30.069572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bba9c5-f950-4555-bf5e-6d78b328eebc admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:30.073151 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bba9c5-f950-4555-bf5e-6d78b328eebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:30.074125 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bba9c5-f950-4555-bf5e-6d78b328eebc admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:30.083742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bba9c5-f950-4555-bf5e-6d78b328eebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:30.101170 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bba9c5-f950-4555-bf5e-6d78b328eebc admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:30.118198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227abbd2-9b00-4a2d-a8f8-e4205475ddef admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9b48ecf04a4a719d6dff66ac3a8e78, user_id=fc8fd52c248b414ca746b1cedf508d48, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:30.123987 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227abbd2-9b00-4a2d-a8f8-e4205475ddef admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:30.148611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 976/1956] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:29 2022] PUT /identity/v3/projects/6f9b48ecf04a4a719d6dff66ac3a8e78/users/fc8fd52c248b414ca746b1cedf508d48/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:30.151958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 981/1957] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:29 2022] POST /identity/v3/users => generated 300 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:30.156710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bba9c5-f950-4555-bf5e-6d78b328eebc admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:30.157161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227abbd2-9b00-4a2d-a8f8-e4205475ddef admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:30.177243 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bba9c5-f950-4555-bf5e-6d78b328eebc admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:30.255332 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227abbd2-9b00-4a2d-a8f8-e4205475ddef admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:30.262483 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff46450-5959-4067-ad49-b91a72baf551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:30.263894 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff46450-5959-4067-ad49-b91a72baf551 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:30.263990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff46450-5959-4067-ad49-b91a72baf551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:30.264264 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff46450-5959-4067-ad49-b91a72baf551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:30.265657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff46450-5959-4067-ad49-b91a72baf551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:30.269120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff46450-5959-4067-ad49-b91a72baf551 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:30.285634 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 977/1958] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:30.290754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff46450-5959-4067-ad49-b91a72baf551 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:30.309129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff46450-5959-4067-ad49-b91a72baf551 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:30.316119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9512bf-bcd3-4815-8426-9ff5ab5fed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:30.318128 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9512bf-bcd3-4815-8426-9ff5ab5fed49 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:30.318682 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9512bf-bcd3-4815-8426-9ff5ab5fed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:30.319211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9512bf-bcd3-4815-8426-9ff5ab5fed49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:30.320705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9512bf-bcd3-4815-8426-9ff5ab5fed49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:30.324902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582c45a-e3eb-4ddb-b1d5-affe694d974b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:30.325189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9512bf-bcd3-4815-8426-9ff5ab5fed49 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:30.325371 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582c45a-e3eb-4ddb-b1d5-affe694d974b admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:30.325371 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582c45a-e3eb-4ddb-b1d5-affe694d974b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:30.325371 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582c45a-e3eb-4ddb-b1d5-affe694d974b admin admin] PATH_INFO: `/v3/projects/6f9b48ecf04a4a719d6dff66ac3a8e78/users/fc8fd52c248b414ca746b1cedf508d48/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:30.327483 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582c45a-e3eb-4ddb-b1d5-affe694d974b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9b48ecf04a4a719d6dff66ac3a8e78, user_id=fc8fd52c248b414ca746b1cedf508d48, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:30.331600 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582c45a-e3eb-4ddb-b1d5-affe694d974b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:30.346168 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 982/1959] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:30.347752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9512bf-bcd3-4815-8426-9ff5ab5fed49 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:30.358352 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 978/1960] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:30 2022] PUT /identity/v3/projects/6f9b48ecf04a4a719d6dff66ac3a8e78/users/fc8fd52c248b414ca746b1cedf508d48/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:30.370946 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f5153-5139-40c7-a9d1-c2f8ad0c2e8c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:30.371521 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f5153-5139-40c7-a9d1-c2f8ad0c2e8c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:30.371651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9512bf-bcd3-4815-8426-9ff5ab5fed49 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:30.372074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f5153-5139-40c7-a9d1-c2f8ad0c2e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:30.447694 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8f9f5153-5139-40c7-a9d1-c2f8ad0c2e8c None None] MFA Rules not processed for user `fc8fd52c248b414ca746b1cedf508d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:30.450197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8f9f5153-5139-40c7-a9d1-c2f8ad0c2e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:30.540797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a0090-4477-4dc5-b50f-9d139c26187c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:30.542050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a0090-4477-4dc5-b50f-9d139c26187c admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:30.542298 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a0090-4477-4dc5-b50f-9d139c26187c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:30.542628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a0090-4477-4dc5-b50f-9d139c26187c admin admin] PATH_INFO: `/v3/projects/52043da3c0dd4678911fbb6049bb81d2/users/a904ce0937d34630a3a40658c3190aba/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:30.564856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a0090-4477-4dc5-b50f-9d139c26187c admin admin] RBAC: Authorizing `identity:create_grant(project_id=52043da3c0dd4678911fbb6049bb81d2, user_id=a904ce0937d34630a3a40658c3190aba, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:30.565068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 979/1961] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:30.569302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a0090-4477-4dc5-b50f-9d139c26187c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:30.583986 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f5153-5139-40c7-a9d1-c2f8ad0c2e8c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:30.586004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8f9f5153-5139-40c7-a9d1-c2f8ad0c2e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:30.600869 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 983/1962] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:30 2022] PUT /identity/v3/projects/52043da3c0dd4678911fbb6049bb81d2/users/a904ce0937d34630a3a40658c3190aba/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:30.607119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a0090-4477-4dc5-b50f-9d139c26187c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:30.642454 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:30.647790 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:30.685978 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f5153-5139-40c7-a9d1-c2f8ad0c2e8c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:30.714663 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a0090-4477-4dc5-b50f-9d139c26187c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:30.721305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a00795-b3ae-4697-9a05-f399cf320111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:30.722094 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a00795-b3ae-4697-9a05-f399cf320111 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:30.723091 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a00795-b3ae-4697-9a05-f399cf320111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:30.723262 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a00795-b3ae-4697-9a05-f399cf320111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:30.724073 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a00795-b3ae-4697-9a05-f399cf320111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:30.725981 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a00795-b3ae-4697-9a05-f399cf320111 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:30.739619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 984/1963] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:30.744321 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a00795-b3ae-4697-9a05-f399cf320111 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:30.760663 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a00795-b3ae-4697-9a05-f399cf320111 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:30.767983 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52f068-2be8-4e9b-8810-21f646604f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:30.769609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f068-2be8-4e9b-8810-21f646604f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:30.769609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f068-2be8-4e9b-8810-21f646604f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:30.770163 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f068-2be8-4e9b-8810-21f646604f83 admin admin] PATH_INFO: `/v3/projects/52043da3c0dd4678911fbb6049bb81d2/users/a904ce0937d34630a3a40658c3190aba/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:30.772071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf677c-d640-4749-8d70-f7ef3e8f037c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:30.772411 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf677c-d640-4749-8d70-f7ef3e8f037c service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:30.772771 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf677c-d640-4749-8d70-f7ef3e8f037c service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:30.773121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf677c-d640-4749-8d70-f7ef3e8f037c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:30.775308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52f068-2be8-4e9b-8810-21f646604f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52043da3c0dd4678911fbb6049bb81d2, user_id=a904ce0937d34630a3a40658c3190aba, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:30.778562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52f068-2be8-4e9b-8810-21f646604f83 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:30.805983 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 985/1964] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:30 2022] PUT /identity/v3/projects/52043da3c0dd4678911fbb6049bb81d2/users/a904ce0937d34630a3a40658c3190aba/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:30.809092 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73505cc-a1f4-45f7-8179-f69fa69135a2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:30.809548 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73505cc-a1f4-45f7-8179-f69fa69135a2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:30.809926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73505cc-a1f4-45f7-8179-f69fa69135a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:30.879327 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d73505cc-a1f4-45f7-8179-f69fa69135a2 None None] MFA Rules not processed for user `a904ce0937d34630a3a40658c3190aba`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:30.881355 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d73505cc-a1f4-45f7-8179-f69fa69135a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:30.926901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf677c-d640-4749-8d70-f7ef3e8f037c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:30.933945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf677c-d640-4749-8d70-f7ef3e8f037c service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:30.952473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 980/1965] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:30 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:09:31.018752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 986/1966] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:31.033725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf677c-d640-4749-8d70-f7ef3e8f037c service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:31.035933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-01cf677c-d640-4749-8d70-f7ef3e8f037c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:31.038490 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73505cc-a1f4-45f7-8179-f69fa69135a2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:31.051581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf677c-d640-4749-8d70-f7ef3e8f037c service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:31.117359 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b9231-97e8-4eda-afdb-aeed28e2e942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:31.118254 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b9231-97e8-4eda-afdb-aeed28e2e942 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:31.118577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b9231-97e8-4eda-afdb-aeed28e2e942 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:31.118857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b9231-97e8-4eda-afdb-aeed28e2e942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:31.141224 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73505cc-a1f4-45f7-8179-f69fa69135a2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:31.147266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752d2c1-6487-46e7-813f-9021e2fa2e92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:31.148020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752d2c1-6487-46e7-813f-9021e2fa2e92 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:31.148309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752d2c1-6487-46e7-813f-9021e2fa2e92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:31.148748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752d2c1-6487-46e7-813f-9021e2fa2e92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:31.169248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752d2c1-6487-46e7-813f-9021e2fa2e92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:31.171254 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752d2c1-6487-46e7-813f-9021e2fa2e92 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:31.186331 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 987/1967] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:31.223846 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752d2c1-6487-46e7-813f-9021e2fa2e92 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:31.238375 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b9231-97e8-4eda-afdb-aeed28e2e942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:31.240282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b9231-97e8-4eda-afdb-aeed28e2e942 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:31.246669 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:31.254606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 981/1968] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:31.255725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b9231-97e8-4eda-afdb-aeed28e2e942 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:31.258313 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-514b9231-97e8-4eda-afdb-aeed28e2e942 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:31.289784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:31.355415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752d2c1-6487-46e7-813f-9021e2fa2e92 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:31.368747 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0a021-1764-4acb-838f-fb1b607deb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:31.369522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a021-1764-4acb-838f-fb1b607deb53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:31.370053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a021-1764-4acb-838f-fb1b607deb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:31.370385 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a021-1764-4acb-838f-fb1b607deb53 admin admin] PATH_INFO: `/v3/users/7d8192299ee44e42905693c27ec25b48` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:31.372966 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0a021-1764-4acb-838f-fb1b607deb53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d8192299ee44e42905693c27ec25b48)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:31.378431 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0a021-1764-4acb-838f-fb1b607deb53 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:31.408829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b9231-97e8-4eda-afdb-aeed28e2e942 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:31.420395 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913fe66-cbeb-4f58-b7d2-fb4cb2ea9efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:31.421439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913fe66-cbeb-4f58-b7d2-fb4cb2ea9efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:31.421827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913fe66-cbeb-4f58-b7d2-fb4cb2ea9efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:31.422106 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913fe66-cbeb-4f58-b7d2-fb4cb2ea9efe admin admin] PATH_INFO: `/v3/users/379e86abfe2e4955a822c313a5dda472` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:31.423775 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913fe66-cbeb-4f58-b7d2-fb4cb2ea9efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=379e86abfe2e4955a822c313a5dda472)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:31.426032 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913fe66-cbeb-4f58-b7d2-fb4cb2ea9efe admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:31.496691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-62d0a021-1764-4acb-838f-fb1b607deb53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d8192299ee44e42905693c27ec25b48'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:31.543135 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-62d0a021-1764-4acb-838f-fb1b607deb53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d8192299ee44e42905693c27ec25b48'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:31.544817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-62d0a021-1764-4acb-838f-fb1b607deb53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d8192299ee44e42905693c27ec25b48'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:31.555064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9913fe66-cbeb-4f58-b7d2-fb4cb2ea9efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379e86abfe2e4955a822c313a5dda472'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:31.557672 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9913fe66-cbeb-4f58-b7d2-fb4cb2ea9efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379e86abfe2e4955a822c313a5dda472'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:31.561767 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-62d0a021-1764-4acb-838f-fb1b607deb53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d8192299ee44e42905693c27ec25b48'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:31.582394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9913fe66-cbeb-4f58-b7d2-fb4cb2ea9efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379e86abfe2e4955a822c313a5dda472'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:31.583850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-62d0a021-1764-4acb-838f-fb1b607deb53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d8192299ee44e42905693c27ec25b48'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:31.605229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9913fe66-cbeb-4f58-b7d2-fb4cb2ea9efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379e86abfe2e4955a822c313a5dda472'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:31.608912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 988/1969] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:31 2022] DELETE /identity/v3/users/7d8192299ee44e42905693c27ec25b48 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:31.613632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568163f-4ef4-4665-b4a3-0e77900e3167 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:31.613951 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568163f-4ef4-4665-b4a3-0e77900e3167 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:31.614205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568163f-4ef4-4665-b4a3-0e77900e3167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:31.634998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9913fe66-cbeb-4f58-b7d2-fb4cb2ea9efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379e86abfe2e4955a822c313a5dda472'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:31.656352 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 982/1970] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:31 2022] DELETE /identity/v3/users/379e86abfe2e4955a822c313a5dda472 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:31.659758 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3568163f-4ef4-4665-b4a3-0e77900e3167 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:31.659758 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3568163f-4ef4-4665-b4a3-0e77900e3167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:31.662274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd50052-a428-42bd-8cf5-090c841f3eb5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:31.662844 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd50052-a428-42bd-8cf5-090c841f3eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:31.663299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd50052-a428-42bd-8cf5-090c841f3eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:31.711287 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1fd50052-a428-42bd-8cf5-090c841f3eb5 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:31.714962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1fd50052-a428-42bd-8cf5-090c841f3eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:31.861913 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 989/1971] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:31.874660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568163f-4ef4-4665-b4a3-0e77900e3167 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:31.876734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3568163f-4ef4-4665-b4a3-0e77900e3167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:31.923234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 983/1972] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:31.935796 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd50052-a428-42bd-8cf5-090c841f3eb5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:31.941183 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1fd50052-a428-42bd-8cf5-090c841f3eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:31.988292 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:32.001931 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568163f-4ef4-4665-b4a3-0e77900e3167 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:32.008621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d8f15-3091-49b3-bde1-21384a737733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:32.009294 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d8f15-3091-49b3-bde1-21384a737733 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:32.009886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d8f15-3091-49b3-bde1-21384a737733 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:32.010317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d8f15-3091-49b3-bde1-21384a737733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:32.036635 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd50052-a428-42bd-8cf5-090c841f3eb5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:32.040951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6968e4-a91a-47c1-9cab-7fa6dcb47704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:32.041930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:32.043203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6968e4-a91a-47c1-9cab-7fa6dcb47704 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:32.043588 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6968e4-a91a-47c1-9cab-7fa6dcb47704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:32.043951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6968e4-a91a-47c1-9cab-7fa6dcb47704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:32.057610 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6968e4-a91a-47c1-9cab-7fa6dcb47704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:32.058101 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d8f15-3091-49b3-bde1-21384a737733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:32.059950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6968e4-a91a-47c1-9cab-7fa6dcb47704 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:32.061628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d8f15-3091-49b3-bde1-21384a737733 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:32.074358 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 984/1973] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:32.078046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 990/1974] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:09:32.571150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6968e4-a91a-47c1-9cab-7fa6dcb47704 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:32.574939 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9c6968e4-a91a-47c1-9cab-7fa6dcb47704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:32.599767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6968e4-a91a-47c1-9cab-7fa6dcb47704 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:32.610136 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57e50b-de6d-4c39-a6fb-ce7720ea0d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:32.610681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57e50b-de6d-4c39-a6fb-ce7720ea0d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:32.610969 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57e50b-de6d-4c39-a6fb-ce7720ea0d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:32.611254 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57e50b-de6d-4c39-a6fb-ce7720ea0d3e admin admin] PATH_INFO: `/v3/users/ad0474bb478444a1a329194b7a41696a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:32.612501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57e50b-de6d-4c39-a6fb-ce7720ea0d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad0474bb478444a1a329194b7a41696a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:32.615792 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57e50b-de6d-4c39-a6fb-ce7720ea0d3e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:32.692215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d8f15-3091-49b3-bde1-21384a737733 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:32.692215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-270d8f15-3091-49b3-bde1-21384a737733 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:32.694794 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5f57e50b-de6d-4c39-a6fb-ce7720ea0d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad0474bb478444a1a329194b7a41696a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:32.695544 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5f57e50b-de6d-4c39-a6fb-ce7720ea0d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad0474bb478444a1a329194b7a41696a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:32.708719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5f57e50b-de6d-4c39-a6fb-ce7720ea0d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad0474bb478444a1a329194b7a41696a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:32.711577 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d8f15-3091-49b3-bde1-21384a737733 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:32.727076 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f3244-30eb-4e4d-beee-cb20918ed0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:32.729303 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f3244-30eb-4e4d-beee-cb20918ed0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:32.729605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f3244-30eb-4e4d-beee-cb20918ed0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:32.729920 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f3244-30eb-4e4d-beee-cb20918ed0d1 admin admin] PATH_INFO: `/v3/projects/08c6eaca149b45af8d16ce8fe03933d9` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:32.733057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f3244-30eb-4e4d-beee-cb20918ed0d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c6eaca149b45af8d16ce8fe03933d9)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:32.735099 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f3244-30eb-4e4d-beee-cb20918ed0d1 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:32.740832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5f57e50b-de6d-4c39-a6fb-ce7720ea0d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad0474bb478444a1a329194b7a41696a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:32.754297 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5f57e50b-de6d-4c39-a6fb-ce7720ea0d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad0474bb478444a1a329194b7a41696a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:32.773426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 985/1975] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:32 2022] DELETE /identity/v3/users/ad0474bb478444a1a329194b7a41696a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:32.774503 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57e50b-de6d-4c39-a6fb-ce7720ea0d3e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:32.776254 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5f57e50b-de6d-4c39-a6fb-ce7720ea0d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:32.846643 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-045f3244-30eb-4e4d-beee-cb20918ed0d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c6eaca149b45af8d16ce8fe03933d9', 'request_id': 'req-045f3244-30eb-4e4d-beee-cb20918ed0d1'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:32.865723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-045f3244-30eb-4e4d-beee-cb20918ed0d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c6eaca149b45af8d16ce8fe03933d9', 'request_id': 'req-045f3244-30eb-4e4d-beee-cb20918ed0d1'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:32.879513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57e50b-de6d-4c39-a6fb-ce7720ea0d3e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:32.883362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-045f3244-30eb-4e4d-beee-cb20918ed0d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c6eaca149b45af8d16ce8fe03933d9', 'request_id': 'req-045f3244-30eb-4e4d-beee-cb20918ed0d1'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:32.912031 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-045f3244-30eb-4e4d-beee-cb20918ed0d1 admin admin] The token cache is being invalidate because project 08c6eaca149b45af8d16ce8fe03933d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:32.914586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-045f3244-30eb-4e4d-beee-cb20918ed0d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:32.914586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-045f3244-30eb-4e4d-beee-cb20918ed0d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:32.915937 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 991/1976] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:32 2022] DELETE /identity/v3/projects/08c6eaca149b45af8d16ce8fe03933d9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:32.919928 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f3244-30eb-4e4d-beee-cb20918ed0d1 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:32.921479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-045f3244-30eb-4e4d-beee-cb20918ed0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:32.953271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:32.981751 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c623df-eec5-4400-93eb-b75a30dcd0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:32.985098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c623df-eec5-4400-93eb-b75a30dcd0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:32.986017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c623df-eec5-4400-93eb-b75a30dcd0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:32.986632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c623df-eec5-4400-93eb-b75a30dcd0c9 admin admin] PATH_INFO: `/v3/projects/8ea8fe39137148ae85a41a1afc93965d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:32.988367 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c623df-eec5-4400-93eb-b75a30dcd0c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea8fe39137148ae85a41a1afc93965d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:32.991074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c623df-eec5-4400-93eb-b75a30dcd0c9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:33.007058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f3244-30eb-4e4d-beee-cb20918ed0d1 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:33.015287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cfa70-5c8c-480f-a5df-fba7ac1347c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:33.016992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cfa70-5c8c-480f-a5df-fba7ac1347c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:33.017383 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cfa70-5c8c-480f-a5df-fba7ac1347c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:33.018122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cfa70-5c8c-480f-a5df-fba7ac1347c3 admin admin] PATH_INFO: `/v3/users/a904ce0937d34630a3a40658c3190aba` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:33.019808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cfa70-5c8c-480f-a5df-fba7ac1347c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a904ce0937d34630a3a40658c3190aba)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:33.022276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cfa70-5c8c-480f-a5df-fba7ac1347c3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:33.071261 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a0c623df-eec5-4400-93eb-b75a30dcd0c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea8fe39137148ae85a41a1afc93965d', 'request_id': 'req-a0c623df-eec5-4400-93eb-b75a30dcd0c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.091923 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a0c623df-eec5-4400-93eb-b75a30dcd0c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea8fe39137148ae85a41a1afc93965d', 'request_id': 'req-a0c623df-eec5-4400-93eb-b75a30dcd0c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.104885 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a0c623df-eec5-4400-93eb-b75a30dcd0c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea8fe39137148ae85a41a1afc93965d', 'request_id': 'req-a0c623df-eec5-4400-93eb-b75a30dcd0c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.115922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-768cfa70-5c8c-480f-a5df-fba7ac1347c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a904ce0937d34630a3a40658c3190aba'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.128822 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a0c623df-eec5-4400-93eb-b75a30dcd0c9 admin admin] The token cache is being invalidate because project 8ea8fe39137148ae85a41a1afc93965d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:33.129101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a0c623df-eec5-4400-93eb-b75a30dcd0c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.129834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a0c623df-eec5-4400-93eb-b75a30dcd0c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.136106 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-768cfa70-5c8c-480f-a5df-fba7ac1347c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a904ce0937d34630a3a40658c3190aba'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.136957 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-768cfa70-5c8c-480f-a5df-fba7ac1347c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a904ce0937d34630a3a40658c3190aba'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.138049 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 986/1977] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:32 2022] DELETE /identity/v3/projects/8ea8fe39137148ae85a41a1afc93965d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:33.141136 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c623df-eec5-4400-93eb-b75a30dcd0c9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:33.143839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a0c623df-eec5-4400-93eb-b75a30dcd0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:33.148016 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-768cfa70-5c8c-480f-a5df-fba7ac1347c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a904ce0937d34630a3a40658c3190aba'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.161494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:33.166900 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-768cfa70-5c8c-480f-a5df-fba7ac1347c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a904ce0937d34630a3a40658c3190aba'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.185244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 992/1978] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:32 2022] DELETE /identity/v3/users/a904ce0937d34630a3a40658c3190aba => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:33.273827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c623df-eec5-4400-93eb-b75a30dcd0c9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:33.284023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cfa70-5c8c-480f-a5df-fba7ac1347c3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:33.286647 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-768cfa70-5c8c-480f-a5df-fba7ac1347c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:33.394443 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255b194-ddf5-4ab2-81cc-3b896157d26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:33.395522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255b194-ddf5-4ab2-81cc-3b896157d26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:33.395856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255b194-ddf5-4ab2-81cc-3b896157d26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:33.396222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255b194-ddf5-4ab2-81cc-3b896157d26a admin admin] PATH_INFO: `/v3/users/e0ea56332f344c5b8eae3a45600538a7` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:33.399606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255b194-ddf5-4ab2-81cc-3b896157d26a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ea56332f344c5b8eae3a45600538a7)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:33.400667 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255b194-ddf5-4ab2-81cc-3b896157d26a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:33.430641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:33.434470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cfa70-5c8c-480f-a5df-fba7ac1347c3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:33.440615 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee7871-31f1-45fa-a4e0-fd976e1733e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:33.441880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee7871-31f1-45fa-a4e0-fd976e1733e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:33.442573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee7871-31f1-45fa-a4e0-fd976e1733e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:33.442994 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee7871-31f1-45fa-a4e0-fd976e1733e6 admin admin] PATH_INFO: `/v3/projects/ecf7ee56410d4385b08fcd40dd1a5127` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:33.451493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee7871-31f1-45fa-a4e0-fd976e1733e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf7ee56410d4385b08fcd40dd1a5127)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:33.451493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee7871-31f1-45fa-a4e0-fd976e1733e6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:33.485329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7255b194-ddf5-4ab2-81cc-3b896157d26a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ea56332f344c5b8eae3a45600538a7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.487283 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7255b194-ddf5-4ab2-81cc-3b896157d26a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ea56332f344c5b8eae3a45600538a7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.505732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7255b194-ddf5-4ab2-81cc-3b896157d26a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ea56332f344c5b8eae3a45600538a7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.517657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-86ee7871-31f1-45fa-a4e0-fd976e1733e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf7ee56410d4385b08fcd40dd1a5127', 'request_id': 'req-86ee7871-31f1-45fa-a4e0-fd976e1733e6'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.521386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7255b194-ddf5-4ab2-81cc-3b896157d26a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ea56332f344c5b8eae3a45600538a7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.525875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-86ee7871-31f1-45fa-a4e0-fd976e1733e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf7ee56410d4385b08fcd40dd1a5127', 'request_id': 'req-86ee7871-31f1-45fa-a4e0-fd976e1733e6'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.530058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7255b194-ddf5-4ab2-81cc-3b896157d26a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ea56332f344c5b8eae3a45600538a7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.536484 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-86ee7871-31f1-45fa-a4e0-fd976e1733e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf7ee56410d4385b08fcd40dd1a5127', 'request_id': 'req-86ee7871-31f1-45fa-a4e0-fd976e1733e6'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.538188 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 987/1979] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:33 2022] DELETE /identity/v3/users/e0ea56332f344c5b8eae3a45600538a7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:33.558979 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-86ee7871-31f1-45fa-a4e0-fd976e1733e6 admin admin] The token cache is being invalidate because project ecf7ee56410d4385b08fcd40dd1a5127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:33.559580 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-86ee7871-31f1-45fa-a4e0-fd976e1733e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.560699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-86ee7871-31f1-45fa-a4e0-fd976e1733e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:33.564057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 993/1980] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:33 2022] DELETE /identity/v3/projects/ecf7ee56410d4385b08fcd40dd1a5127 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:33.570787 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9356dd3-ecea-4295-9039-482b04adfa14 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:33.571577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9356dd3-ecea-4295-9039-482b04adfa14 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:33.572875 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9356dd3-ecea-4295-9039-482b04adfa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:33.601841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a9356dd3-ecea-4295-9039-482b04adfa14 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:33.603529 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a9356dd3-ecea-4295-9039-482b04adfa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:33.684399 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 988/1981] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:33.698966 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df5def-3e44-4ebd-95ac-2285331cad3c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:33.699511 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df5def-3e44-4ebd-95ac-2285331cad3c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:33.699943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df5def-3e44-4ebd-95ac-2285331cad3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:33.784984 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d9df5def-3e44-4ebd-95ac-2285331cad3c None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:33.787502 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d9df5def-3e44-4ebd-95ac-2285331cad3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:33.804662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 994/1982] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:33.810918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9356dd3-ecea-4295-9039-482b04adfa14 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:33.822834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9356dd3-ecea-4295-9039-482b04adfa14 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:33.828527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a758e70-9070-49e1-a9f2-f0cc194322db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:33.829226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a758e70-9070-49e1-a9f2-f0cc194322db admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:33.829853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a758e70-9070-49e1-a9f2-f0cc194322db admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:33.830143 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a758e70-9070-49e1-a9f2-f0cc194322db admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:33.830914 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a758e70-9070-49e1-a9f2-f0cc194322db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:33.831201 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a758e70-9070-49e1-a9f2-f0cc194322db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:33.833013 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a758e70-9070-49e1-a9f2-f0cc194322db admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:33.855456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 989/1983] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:09:33.857289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df5def-3e44-4ebd-95ac-2285331cad3c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:33.875999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df5def-3e44-4ebd-95ac-2285331cad3c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:33.890618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7689a1-bdb3-442d-89d7-4f8417e4fe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:33.891432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7689a1-bdb3-442d-89d7-4f8417e4fe33 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:33.891932 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7689a1-bdb3-442d-89d7-4f8417e4fe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:33.892336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7689a1-bdb3-442d-89d7-4f8417e4fe33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:33.893189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7689a1-bdb3-442d-89d7-4f8417e4fe33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:33.895451 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7689a1-bdb3-442d-89d7-4f8417e4fe33 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:33.898652 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a758e70-9070-49e1-a9f2-f0cc194322db admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:33.900766 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7a758e70-9070-49e1-a9f2-f0cc194322db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:33.923358 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a758e70-9070-49e1-a9f2-f0cc194322db admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:33.932268 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b06e0-6d53-489e-9af6-b49e8289c42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:33.933286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b06e0-6d53-489e-9af6-b49e8289c42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:33.933579 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b06e0-6d53-489e-9af6-b49e8289c42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:33.933994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b06e0-6d53-489e-9af6-b49e8289c42e admin admin] PATH_INFO: `/v3/projects/52043da3c0dd4678911fbb6049bb81d2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:33.935385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b06e0-6d53-489e-9af6-b49e8289c42e admin admin] RBAC: Authorizing `identity:delete_project(project_id=52043da3c0dd4678911fbb6049bb81d2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:33.937654 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b06e0-6d53-489e-9af6-b49e8289c42e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:33.968213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 995/1984] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:33 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:09:33.972493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7689a1-bdb3-442d-89d7-4f8417e4fe33 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:34.029321 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7e9b06e0-6d53-489e-9af6-b49e8289c42e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52043da3c0dd4678911fbb6049bb81d2', 'request_id': 'req-7e9b06e0-6d53-489e-9af6-b49e8289c42e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:34.045513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7e9b06e0-6d53-489e-9af6-b49e8289c42e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52043da3c0dd4678911fbb6049bb81d2', 'request_id': 'req-7e9b06e0-6d53-489e-9af6-b49e8289c42e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:34.068774 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7e9b06e0-6d53-489e-9af6-b49e8289c42e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52043da3c0dd4678911fbb6049bb81d2', 'request_id': 'req-7e9b06e0-6d53-489e-9af6-b49e8289c42e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:34.078407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:34.088065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7689a1-bdb3-442d-89d7-4f8417e4fe33 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:34.097646 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7e9b06e0-6d53-489e-9af6-b49e8289c42e admin admin] The token cache is being invalidate because project 52043da3c0dd4678911fbb6049bb81d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:34.097885 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7e9b06e0-6d53-489e-9af6-b49e8289c42e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:34.099142 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7e9b06e0-6d53-489e-9af6-b49e8289c42e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:34.101246 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 990/1985] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:33 2022] DELETE /identity/v3/projects/52043da3c0dd4678911fbb6049bb81d2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:34.107154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e0a07-6ccc-4579-af59-a59c80af958b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.107940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e0a07-6ccc-4579-af59-a59c80af958b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.108180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e0a07-6ccc-4579-af59-a59c80af958b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.128871 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:34.133588 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2e9e0a07-6ccc-4579-af59-a59c80af958b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:34.137465 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2e9e0a07-6ccc-4579-af59-a59c80af958b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:34.171841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5b7c0-c373-4634-9c34-1cbe7d92835f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:34.172735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5b7c0-c373-4634-9c34-1cbe7d92835f admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.173034 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5b7c0-c373-4634-9c34-1cbe7d92835f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.173303 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5b7c0-c373-4634-9c34-1cbe7d92835f admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.174129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5b7c0-c373-4634-9c34-1cbe7d92835f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:34.176948 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5b7c0-c373-4634-9c34-1cbe7d92835f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:34.213857 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 996/1986] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:33 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:09:34.213857 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5b7c0-c373-4634-9c34-1cbe7d92835f admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:34.215998 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-45f5b7c0-c373-4634-9c34-1cbe7d92835f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:34.230957 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5b7c0-c373-4634-9c34-1cbe7d92835f admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:34.236569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247811c-1097-4ad3-8230-499651823b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:34.237506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247811c-1097-4ad3-8230-499651823b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.237786 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247811c-1097-4ad3-8230-499651823b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.238092 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247811c-1097-4ad3-8230-499651823b28 admin admin] PATH_INFO: `/v3/projects/f460f42bbc964b789ba11b46187e8576` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.239429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247811c-1097-4ad3-8230-499651823b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f460f42bbc964b789ba11b46187e8576)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:34.241392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247811c-1097-4ad3-8230-499651823b28 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:34.250300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 991/1987] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:34.252258 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e0a07-6ccc-4579-af59-a59c80af958b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:34.254669 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2e9e0a07-6ccc-4579-af59-a59c80af958b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:34.273725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e0a07-6ccc-4579-af59-a59c80af958b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:34.287762 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bfd5af-3d58-41ae-8365-c99b377da002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:34.288964 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfd5af-3d58-41ae-8365-c99b377da002 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.292851 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfd5af-3d58-41ae-8365-c99b377da002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.292851 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfd5af-3d58-41ae-8365-c99b377da002 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.293496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bfd5af-3d58-41ae-8365-c99b377da002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:34.296794 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bfd5af-3d58-41ae-8365-c99b377da002 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:34.306972 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5247811c-1097-4ad3-8230-499651823b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f460f42bbc964b789ba11b46187e8576', 'request_id': 'req-5247811c-1097-4ad3-8230-499651823b28'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:34.311574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 992/1988] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:34.311574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1207b7e-beb7-402b-9fda-b5205920049f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.311574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1207b7e-beb7-402b-9fda-b5205920049f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.311574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1207b7e-beb7-402b-9fda-b5205920049f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.317783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5247811c-1097-4ad3-8230-499651823b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f460f42bbc964b789ba11b46187e8576', 'request_id': 'req-5247811c-1097-4ad3-8230-499651823b28'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:34.330432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5247811c-1097-4ad3-8230-499651823b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f460f42bbc964b789ba11b46187e8576', 'request_id': 'req-5247811c-1097-4ad3-8230-499651823b28'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:34.330945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b1207b7e-beb7-402b-9fda-b5205920049f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:34.332187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b1207b7e-beb7-402b-9fda-b5205920049f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:34.354440 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5247811c-1097-4ad3-8230-499651823b28 admin admin] The token cache is being invalidate because project f460f42bbc964b789ba11b46187e8576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:34.354682 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5247811c-1097-4ad3-8230-499651823b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:34.355302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5247811c-1097-4ad3-8230-499651823b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:34.356907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 997/1989] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:34 2022] DELETE /identity/v3/projects/f460f42bbc964b789ba11b46187e8576 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:34.357689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247811c-1097-4ad3-8230-499651823b28 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:34.361698 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5247811c-1097-4ad3-8230-499651823b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:34.410996 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 993/1990] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:34.412481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984fa4f-7e26-4561-8da3-60464ee997ae None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.412818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984fa4f-7e26-4561-8da3-60464ee997ae None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.413092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984fa4f-7e26-4561-8da3-60464ee997ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.435371 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1984fa4f-7e26-4561-8da3-60464ee997ae None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:34.436613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1984fa4f-7e26-4561-8da3-60464ee997ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:34.445194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 994/1991] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:34.445553 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247811c-1097-4ad3-8230-499651823b28 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:34.451227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984fa4f-7e26-4561-8da3-60464ee997ae None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:34.453829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d10f8-fd0b-4d1f-8d9d-7c3bdfedf7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:34.455307 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d10f8-fd0b-4d1f-8d9d-7c3bdfedf7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.455779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d10f8-fd0b-4d1f-8d9d-7c3bdfedf7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.456278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d10f8-fd0b-4d1f-8d9d-7c3bdfedf7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.459562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d10f8-fd0b-4d1f-8d9d-7c3bdfedf7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:34.460852 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d10f8-fd0b-4d1f-8d9d-7c3bdfedf7ea admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:34.465478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984fa4f-7e26-4561-8da3-60464ee997ae None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:34.470647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2a67b-233d-4ee3-9c52-4528b3b25972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:34.471333 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2a67b-233d-4ee3-9c52-4528b3b25972 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.471623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2a67b-233d-4ee3-9c52-4528b3b25972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.471911 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2a67b-233d-4ee3-9c52-4528b3b25972 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.472641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2a67b-233d-4ee3-9c52-4528b3b25972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:34.472953 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2a67b-233d-4ee3-9c52-4528b3b25972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:34.474621 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2a67b-233d-4ee3-9c52-4528b3b25972 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:34.478547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 998/1992] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:34.484353 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552ace8-45da-4374-bc09-239db5cba60c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.484818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552ace8-45da-4374-bc09-239db5cba60c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.485280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552ace8-45da-4374-bc09-239db5cba60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.491518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 995/1993] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:34.491898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2a67b-233d-4ee3-9c52-4528b3b25972 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:34.507721 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2a67b-233d-4ee3-9c52-4528b3b25972 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:34.511566 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6552ace8-45da-4374-bc09-239db5cba60c None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:34.512813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6552ace8-45da-4374-bc09-239db5cba60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:34.516421 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696979d6-0ae8-468a-8532-2a034c4bf562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:34.517386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696979d6-0ae8-468a-8532-2a034c4bf562 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.517669 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696979d6-0ae8-468a-8532-2a034c4bf562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.517967 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696979d6-0ae8-468a-8532-2a034c4bf562 admin admin] PATH_INFO: `/v3/projects/dad7075ac93549279db168eb6440836a/users/7a827c1a02534106a2d38c8670fd298e/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.521080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 999/1994] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:34.525479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552ace8-45da-4374-bc09-239db5cba60c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:34.532409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552ace8-45da-4374-bc09-239db5cba60c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:34.535231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696979d6-0ae8-468a-8532-2a034c4bf562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad7075ac93549279db168eb6440836a, user_id=7a827c1a02534106a2d38c8670fd298e, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:34.537302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad4bed-b5f8-41ff-b6bb-2df09ce2a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:34.537952 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696979d6-0ae8-468a-8532-2a034c4bf562 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:34.538065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad4bed-b5f8-41ff-b6bb-2df09ce2a06f admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.538329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad4bed-b5f8-41ff-b6bb-2df09ce2a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.538604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad4bed-b5f8-41ff-b6bb-2df09ce2a06f admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.539524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad4bed-b5f8-41ff-b6bb-2df09ce2a06f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:34.542876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad4bed-b5f8-41ff-b6bb-2df09ce2a06f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:34.548553 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:34.557189 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 996/1995] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:34 2022] PUT /identity/v3/projects/dad7075ac93549279db168eb6440836a/users/7a827c1a02534106a2d38c8670fd298e/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:34.558255 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696979d6-0ae8-468a-8532-2a034c4bf562 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:34.604438 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1000/1996] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:34 2022] POST /identity/v3/projects => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:34.604438 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d69a1-724d-4cc4-ab55-110424949260 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.604438 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d69a1-724d-4cc4-ab55-110424949260 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.604438 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d69a1-724d-4cc4-ab55-110424949260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.621632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:34.634700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696979d6-0ae8-468a-8532-2a034c4bf562 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:34.634939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-9f4d69a1-724d-4cc4-ab55-110424949260 None None] MFA Rules not processed for user `7a827c1a02534106a2d38c8670fd298e`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:34.636026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9f4d69a1-724d-4cc4-ab55-110424949260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:34.700714 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c194396-6b8f-41bc-85a6-3df3e1009e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:34.701414 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c194396-6b8f-41bc-85a6-3df3e1009e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.701696 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c194396-6b8f-41bc-85a6-3df3e1009e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.702013 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c194396-6b8f-41bc-85a6-3df3e1009e1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.702755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c194396-6b8f-41bc-85a6-3df3e1009e1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:34.703055 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c194396-6b8f-41bc-85a6-3df3e1009e1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:34.705046 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c194396-6b8f-41bc-85a6-3df3e1009e1a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:34.710261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1001/1997] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:34.710978 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d69a1-724d-4cc4-ab55-110424949260 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:34.718368 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 997/1998] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:34.719146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c194396-6b8f-41bc-85a6-3df3e1009e1a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:34.724689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d69a1-724d-4cc4-ab55-110424949260 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:34.729780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c194396-6b8f-41bc-85a6-3df3e1009e1a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:34.730824 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f9e70-dd34-4b02-8d19-e68dc8662a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:34.731575 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f9e70-dd34-4b02-8d19-e68dc8662a1e admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.731860 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f9e70-dd34-4b02-8d19-e68dc8662a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.732134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f9e70-dd34-4b02-8d19-e68dc8662a1e admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.732847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f9e70-dd34-4b02-8d19-e68dc8662a1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:34.734593 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6adad-0e3f-4c92-9fd3-baeff8a6dc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:34.734898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f9e70-dd34-4b02-8d19-e68dc8662a1e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:34.735265 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6adad-0e3f-4c92-9fd3-baeff8a6dc47 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.735551 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6adad-0e3f-4c92-9fd3-baeff8a6dc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.735831 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6adad-0e3f-4c92-9fd3-baeff8a6dc47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.736556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6adad-0e3f-4c92-9fd3-baeff8a6dc47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:34.738703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6adad-0e3f-4c92-9fd3-baeff8a6dc47 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:34.759361 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1002/1999] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:34 2022] POST /identity/v3/users => generated 284 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:34.760186 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f9e70-dd34-4b02-8d19-e68dc8662a1e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:34.771180 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f9e70-dd34-4b02-8d19-e68dc8662a1e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:34.781346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341138be-2123-4ab9-9780-eb8a449e8fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:34.782092 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341138be-2123-4ab9-9780-eb8a449e8fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.782378 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341138be-2123-4ab9-9780-eb8a449e8fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.782664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341138be-2123-4ab9-9780-eb8a449e8fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.786230 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 998/2000] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:34 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:34.786390 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341138be-2123-4ab9-9780-eb8a449e8fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:34.786500 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6adad-0e3f-4c92-9fd3-baeff8a6dc47 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:34.786591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341138be-2123-4ab9-9780-eb8a449e8fd3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:34.822066 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1003/2001] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:34 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:34.823321 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341138be-2123-4ab9-9780-eb8a449e8fd3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:34.860475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6adad-0e3f-4c92-9fd3-baeff8a6dc47 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:34.926243 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341138be-2123-4ab9-9780-eb8a449e8fd3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:34.937248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111eb7d-f6a9-4ed8-ad5a-997a061e9d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:34.938487 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111eb7d-f6a9-4ed8-ad5a-997a061e9d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.939331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111eb7d-f6a9-4ed8-ad5a-997a061e9d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.939703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111eb7d-f6a9-4ed8-ad5a-997a061e9d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.940638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111eb7d-f6a9-4ed8-ad5a-997a061e9d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:34.941758 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e46cd-bf94-4dc3-ae76-1b814dffdf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:34.942561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111eb7d-f6a9-4ed8-ad5a-997a061e9d17 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:34.943018 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e46cd-bf94-4dc3-ae76-1b814dffdf87 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:34.943501 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e46cd-bf94-4dc3-ae76-1b814dffdf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:34.944093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e46cd-bf94-4dc3-ae76-1b814dffdf87 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:34.945017 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e46cd-bf94-4dc3-ae76-1b814dffdf87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:34.958856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e46cd-bf94-4dc3-ae76-1b814dffdf87 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:34.976890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 999/2002] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:34.978812 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111eb7d-f6a9-4ed8-ad5a-997a061e9d17 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:34.996834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111eb7d-f6a9-4ed8-ad5a-997a061e9d17 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:35.000869 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1004/2003] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:34 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:35.001882 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e46cd-bf94-4dc3-ae76-1b814dffdf87 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:35.006407 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1285b1-8667-4dcb-8357-b4d450ead3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:35.007248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1285b1-8667-4dcb-8357-b4d450ead3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:35.007696 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1285b1-8667-4dcb-8357-b4d450ead3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:35.008176 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1285b1-8667-4dcb-8357-b4d450ead3b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:35.010133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1285b1-8667-4dcb-8357-b4d450ead3b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:35.013921 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1285b1-8667-4dcb-8357-b4d450ead3b3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:35.022413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e46cd-bf94-4dc3-ae76-1b814dffdf87 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:35.029218 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fafdc-4c1b-4946-adc6-a160b3ce2165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:35.030022 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fafdc-4c1b-4946-adc6-a160b3ce2165 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:35.030377 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fafdc-4c1b-4946-adc6-a160b3ce2165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:35.030654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fafdc-4c1b-4946-adc6-a160b3ce2165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:35.031405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fafdc-4c1b-4946-adc6-a160b3ce2165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:35.035293 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fafdc-4c1b-4946-adc6-a160b3ce2165 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:35.044999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:35.047474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1005/2004] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:35.048355 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fafdc-4c1b-4946-adc6-a160b3ce2165 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:35.066169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fafdc-4c1b-4946-adc6-a160b3ce2165 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:35.071779 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1000/2005] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:34 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:35.073606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1285b1-8667-4dcb-8357-b4d450ead3b3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:35.083178 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac2418-2a7d-461d-9a21-c08b2ea15cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:35.084764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac2418-2a7d-461d-9a21-c08b2ea15cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:35.085397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac2418-2a7d-461d-9a21-c08b2ea15cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:35.085961 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac2418-2a7d-461d-9a21-c08b2ea15cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:35.087451 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac2418-2a7d-461d-9a21-c08b2ea15cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:35.091369 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac2418-2a7d-461d-9a21-c08b2ea15cc4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:35.097662 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1285b1-8667-4dcb-8357-b4d450ead3b3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:35.105472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b588ad-4b2e-414f-9be3-05adf885544f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:35.106544 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b588ad-4b2e-414f-9be3-05adf885544f admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:35.107027 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b588ad-4b2e-414f-9be3-05adf885544f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:35.107362 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b588ad-4b2e-414f-9be3-05adf885544f admin admin] PATH_INFO: `/v3/projects/c4e544e8658f43c4a8fac5a71d37b0f9/users/ccc95d4f35b34c1b9f685784c12941e5/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:35.119383 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1006/2006] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:35.124231 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac2418-2a7d-461d-9a21-c08b2ea15cc4 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:35.133081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:35.144564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac2418-2a7d-461d-9a21-c08b2ea15cc4 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:35.145395 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b588ad-4b2e-414f-9be3-05adf885544f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e544e8658f43c4a8fac5a71d37b0f9, user_id=ccc95d4f35b34c1b9f685784c12941e5, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:35.151173 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf2835-1e0b-44c1-8640-bec4507f1ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:35.151863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf2835-1e0b-44c1-8640-bec4507f1ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:35.152148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf2835-1e0b-44c1-8640-bec4507f1ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:35.152422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf2835-1e0b-44c1-8640-bec4507f1ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:35.153160 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf2835-1e0b-44c1-8640-bec4507f1ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:35.153594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b588ad-4b2e-414f-9be3-05adf885544f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:35.154977 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf2835-1e0b-44c1-8640-bec4507f1ce2 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:35.176762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1007/2007] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:35.177781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf2835-1e0b-44c1-8640-bec4507f1ce2 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:35.190069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1001/2008] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:35 2022] PUT /identity/v3/projects/c4e544e8658f43c4a8fac5a71d37b0f9/users/ccc95d4f35b34c1b9f685784c12941e5/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:35.190780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf2835-1e0b-44c1-8640-bec4507f1ce2 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:35.202662 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b588ad-4b2e-414f-9be3-05adf885544f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:35.274517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282d664-f8ac-4d3b-ba66-095ec95f370a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:35.275842 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282d664-f8ac-4d3b-ba66-095ec95f370a admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:35.276310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282d664-f8ac-4d3b-ba66-095ec95f370a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:35.276715 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282d664-f8ac-4d3b-ba66-095ec95f370a admin admin] PATH_INFO: `/v3/projects/c1b7104353744e9dbcc3ee300f246932/users/6037d2618e3e42cda5193253979ba4ad/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:35.292850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b588ad-4b2e-414f-9be3-05adf885544f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:35.297762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282d664-f8ac-4d3b-ba66-095ec95f370a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b7104353744e9dbcc3ee300f246932, user_id=6037d2618e3e42cda5193253979ba4ad, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:35.298803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a634b-76b4-4add-9504-8232834adb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:35.299495 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a634b-76b4-4add-9504-8232834adb1f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:35.299778 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a634b-76b4-4add-9504-8232834adb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:35.300081 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a634b-76b4-4add-9504-8232834adb1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:35.300797 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a634b-76b4-4add-9504-8232834adb1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:35.300923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282d664-f8ac-4d3b-ba66-095ec95f370a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:35.302526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a634b-76b4-4add-9504-8232834adb1f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:35.315232 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1002/2009] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:35.316765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6067-cf53-4324-b4f7-979978ebdd4a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:35.317057 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6067-cf53-4324-b4f7-979978ebdd4a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:35.317332 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6067-cf53-4324-b4f7-979978ebdd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:35.324468 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1008/2010] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:35 2022] PUT /identity/v3/projects/c1b7104353744e9dbcc3ee300f246932/users/6037d2618e3e42cda5193253979ba4ad/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:35.324468 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282d664-f8ac-4d3b-ba66-095ec95f370a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:35.349736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1c5a6067-cf53-4324-b4f7-979978ebdd4a None None] MFA Rules not processed for user `ccc95d4f35b34c1b9f685784c12941e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:35.350836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1c5a6067-cf53-4324-b4f7-979978ebdd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:35.450823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282d664-f8ac-4d3b-ba66-095ec95f370a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:35.457071 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28de1a4-bd9f-448a-9066-fd91cbb44ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:35.458028 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28de1a4-bd9f-448a-9066-fd91cbb44ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:35.458320 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28de1a4-bd9f-448a-9066-fd91cbb44ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:35.458599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28de1a4-bd9f-448a-9066-fd91cbb44ae5 admin admin] PATH_INFO: `/v3/projects/815b55b162c84d04bd759869d5247501/users/c569bc65d9e64034a0b65de3de8d5a3c/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:35.468688 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1003/2011] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:35.472544 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6067-cf53-4324-b4f7-979978ebdd4a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:35.490221 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28de1a4-bd9f-448a-9066-fd91cbb44ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=815b55b162c84d04bd759869d5247501, user_id=c569bc65d9e64034a0b65de3de8d5a3c, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:35.492631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6067-cf53-4324-b4f7-979978ebdd4a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:35.495895 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28de1a4-bd9f-448a-9066-fd91cbb44ae5 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:35.501612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81873e0d-1192-4cb7-a0b7-c41434d84ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:35.503000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873e0d-1192-4cb7-a0b7-c41434d84ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:35.503702 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873e0d-1192-4cb7-a0b7-c41434d84ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:35.504129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873e0d-1192-4cb7-a0b7-c41434d84ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:35.505492 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81873e0d-1192-4cb7-a0b7-c41434d84ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:35.507040 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81873e0d-1192-4cb7-a0b7-c41434d84ac2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:35.519026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1009/2012] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:35 2022] PUT /identity/v3/projects/815b55b162c84d04bd759869d5247501/users/c569bc65d9e64034a0b65de3de8d5a3c/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:35.519955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28de1a4-bd9f-448a-9066-fd91cbb44ae5 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:35.524806 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1004/2013] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:35.530269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa4bd9-3c3c-44aa-93e2-d8f04c95aa0a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:35.530700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa4bd9-3c3c-44aa-93e2-d8f04c95aa0a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:35.531284 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa4bd9-3c3c-44aa-93e2-d8f04c95aa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:35.564935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4caa4bd9-3c3c-44aa-93e2-d8f04c95aa0a None None] MFA Rules not processed for user `c569bc65d9e64034a0b65de3de8d5a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:35.566199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4caa4bd9-3c3c-44aa-93e2-d8f04c95aa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:35.606763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:35.613189 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:35.614117 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28de1a4-bd9f-448a-9066-fd91cbb44ae5 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:35.624468 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45771aaa-a5dc-41a6-8a0a-a03dea07ebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:35.625626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45771aaa-a5dc-41a6-8a0a-a03dea07ebd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:35.625834 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45771aaa-a5dc-41a6-8a0a-a03dea07ebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:35.626190 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45771aaa-a5dc-41a6-8a0a-a03dea07ebd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:35.627763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45771aaa-a5dc-41a6-8a0a-a03dea07ebd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:35.631100 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45771aaa-a5dc-41a6-8a0a-a03dea07ebd4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:35.650644 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1005/2014] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:35.651748 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa4bd9-3c3c-44aa-93e2-d8f04c95aa0a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:35.664152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa4bd9-3c3c-44aa-93e2-d8f04c95aa0a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:35.670049 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1010/2015] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:35 2022] POST /identity/v3/projects => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:35.671127 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45771aaa-a5dc-41a6-8a0a-a03dea07ebd4 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:35.674041 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcf999-e668-4442-934f-c21da4a15287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:35.674826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-45771aaa-a5dc-41a6-8a0a-a03dea07ebd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:35.674996 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcf999-e668-4442-934f-c21da4a15287 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:35.675296 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcf999-e668-4442-934f-c21da4a15287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:35.675572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcf999-e668-4442-934f-c21da4a15287 admin admin] PATH_INFO: `/v3/projects/c1b7104353744e9dbcc3ee300f246932/users/6037d2618e3e42cda5193253979ba4ad/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:35.677826 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcf999-e668-4442-934f-c21da4a15287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b7104353744e9dbcc3ee300f246932, user_id=6037d2618e3e42cda5193253979ba4ad, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:35.680918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcf999-e668-4442-934f-c21da4a15287 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:35.692719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1006/2016] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:35 2022] PUT /identity/v3/projects/c1b7104353744e9dbcc3ee300f246932/users/6037d2618e3e42cda5193253979ba4ad/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:35.693752 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcf999-e668-4442-934f-c21da4a15287 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:35.697975 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7dbcf999-e668-4442-934f-c21da4a15287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:35.766877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45771aaa-a5dc-41a6-8a0a-a03dea07ebd4 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:35.782676 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcf999-e668-4442-934f-c21da4a15287 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:35.786753 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89224083-6a45-46ab-bc28-2b32f467f50e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:35.787429 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89224083-6a45-46ab-bc28-2b32f467f50e service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:35.787714 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89224083-6a45-46ab-bc28-2b32f467f50e service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:35.787990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89224083-6a45-46ab-bc28-2b32f467f50e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:35.872921 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128d090-1bd7-43ea-bcae-e7331ad38414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:35.874112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128d090-1bd7-43ea-bcae-e7331ad38414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:35.874787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128d090-1bd7-43ea-bcae-e7331ad38414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:35.875570 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128d090-1bd7-43ea-bcae-e7331ad38414 admin admin] PATH_INFO: `/v3/users/c605cfd16b494670b7a3c453a9927d84` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:35.878672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128d090-1bd7-43ea-bcae-e7331ad38414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c605cfd16b494670b7a3c453a9927d84)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:35.881278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128d090-1bd7-43ea-bcae-e7331ad38414 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:35.890302 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89224083-6a45-46ab-bc28-2b32f467f50e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:35.891347 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89224083-6a45-46ab-bc28-2b32f467f50e service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:35.902098 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1007/2017] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:35.903151 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89224083-6a45-46ab-bc28-2b32f467f50e service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:35.917155 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89224083-6a45-46ab-bc28-2b32f467f50e service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:35.925182 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b6f89-4739-4f23-a4bd-9e8a85cda7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:35.925926 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6f89-4739-4f23-a4bd-9e8a85cda7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:35.926206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6f89-4739-4f23-a4bd-9e8a85cda7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:35.926481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6f89-4739-4f23-a4bd-9e8a85cda7b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:35.927180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b6f89-4739-4f23-a4bd-9e8a85cda7b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:35.929157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b6f89-4739-4f23-a4bd-9e8a85cda7b0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:35.950491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1128d090-1bd7-43ea-bcae-e7331ad38414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c605cfd16b494670b7a3c453a9927d84'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:35.954848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1008/2018] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:35 2022] POST /identity/v3/users => generated 290 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:35.956304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dd9bc-23bb-4407-9796-eb8a2c3b10ca None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:35.956667 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dd9bc-23bb-4407-9796-eb8a2c3b10ca None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:35.957009 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dd9bc-23bb-4407-9796-eb8a2c3b10ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:35.972145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1128d090-1bd7-43ea-bcae-e7331ad38414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c605cfd16b494670b7a3c453a9927d84'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:35.973078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1128d090-1bd7-43ea-bcae-e7331ad38414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c605cfd16b494670b7a3c453a9927d84'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:35.987142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1128d090-1bd7-43ea-bcae-e7331ad38414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c605cfd16b494670b7a3c453a9927d84'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:35.987994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7e2dd9bc-23bb-4407-9796-eb8a2c3b10ca None None] MFA Rules not processed for user `6037d2618e3e42cda5193253979ba4ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:35.989254 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7e2dd9bc-23bb-4407-9796-eb8a2c3b10ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:35.996108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1128d090-1bd7-43ea-bcae-e7331ad38414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c605cfd16b494670b7a3c453a9927d84'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:36.003720 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1011/2019] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:35 2022] DELETE /identity/v3/users/c605cfd16b494670b7a3c453a9927d84 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:36.004650 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128d090-1bd7-43ea-bcae-e7331ad38414 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:36.006266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1128d090-1bd7-43ea-bcae-e7331ad38414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:36.018327 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:36.052180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:36.090837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1009/2020] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:35 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:36.092475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688210e-0e58-4c27-8003-8ce24ca605ba None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:36.092832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688210e-0e58-4c27-8003-8ce24ca605ba None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:36.093113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688210e-0e58-4c27-8003-8ce24ca605ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:36.115229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128d090-1bd7-43ea-bcae-e7331ad38414 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:36.118803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e688210e-0e58-4c27-8003-8ce24ca605ba None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:36.120099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e688210e-0e58-4c27-8003-8ce24ca605ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:36.121867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a5ef7-5deb-412b-bd8c-a41a0fff8a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:36.122618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5ef7-5deb-412b-bd8c-a41a0fff8a5b admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:36.122966 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5ef7-5deb-412b-bd8c-a41a0fff8a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:36.123310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5ef7-5deb-412b-bd8c-a41a0fff8a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:36.124232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a5ef7-5deb-412b-bd8c-a41a0fff8a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:36.126509 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a5ef7-5deb-412b-bd8c-a41a0fff8a5b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:36.129158 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1010/2021] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:36.129826 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688210e-0e58-4c27-8003-8ce24ca605ba None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:36.131272 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e688210e-0e58-4c27-8003-8ce24ca605ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:36.145619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1012/2022] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:36.146766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a5ef7-5deb-412b-bd8c-a41a0fff8a5b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:36.151713 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-4a5a5ef7-5deb-412b-bd8c-a41a0fff8a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:36.226962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688210e-0e58-4c27-8003-8ce24ca605ba None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:36.238461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c34d42-1b15-49f0-b029-49363a25b423 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:36.239327 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c34d42-1b15-49f0-b029-49363a25b423 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:36.239929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c34d42-1b15-49f0-b029-49363a25b423 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:36.240412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c34d42-1b15-49f0-b029-49363a25b423 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:36.243564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a5ef7-5deb-412b-bd8c-a41a0fff8a5b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:36.250950 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664bd84-107f-44bc-899d-b8777fb9eded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:36.252713 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664bd84-107f-44bc-899d-b8777fb9eded service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:36.253423 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664bd84-107f-44bc-899d-b8777fb9eded service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:36.254268 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664bd84-107f-44bc-899d-b8777fb9eded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:36.295767 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664bd84-107f-44bc-899d-b8777fb9eded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:36.298957 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664bd84-107f-44bc-899d-b8777fb9eded service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:36.326309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1013/2023] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:36.327858 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664bd84-107f-44bc-899d-b8777fb9eded service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:36.348959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664bd84-107f-44bc-899d-b8777fb9eded service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:36.360979 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224e4ff-496b-4e9e-b8f2-98608f197d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:36.380356 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224e4ff-496b-4e9e-b8f2-98608f197d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:36.380356 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224e4ff-496b-4e9e-b8f2-98608f197d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:36.380356 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224e4ff-496b-4e9e-b8f2-98608f197d4c admin admin] PATH_INFO: `/v3/projects/65f9ea0d82ca4cc99eeb0dad5af36b38/users/6339877c807d4062bf01451972b95261/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:36.419567 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224e4ff-496b-4e9e-b8f2-98608f197d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f9ea0d82ca4cc99eeb0dad5af36b38, user_id=6339877c807d4062bf01451972b95261, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:36.427756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224e4ff-496b-4e9e-b8f2-98608f197d4c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:36.443595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c34d42-1b15-49f0-b029-49363a25b423 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:36.461010 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c34d42-1b15-49f0-b029-49363a25b423 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:36.462866 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1014/2024] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:36 2022] PUT /identity/v3/projects/65f9ea0d82ca4cc99eeb0dad5af36b38/users/6339877c807d4062bf01451972b95261/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:36.465069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224e4ff-496b-4e9e-b8f2-98608f197d4c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:36.476314 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1011/2025] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:36 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:36.572156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224e4ff-496b-4e9e-b8f2-98608f197d4c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:36.587289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac5f1a-3d00-443f-bc3a-8a62c6f1beb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:36.588014 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac5f1a-3d00-443f-bc3a-8a62c6f1beb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:36.588273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac5f1a-3d00-443f-bc3a-8a62c6f1beb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:36.588572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac5f1a-3d00-443f-bc3a-8a62c6f1beb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:36.589350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac5f1a-3d00-443f-bc3a-8a62c6f1beb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:36.591218 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac5f1a-3d00-443f-bc3a-8a62c6f1beb9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:36.598163 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c34d42-1b15-49f0-b029-49363a25b423 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:36.608775 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c34d42-1b15-49f0-b029-49363a25b423 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:36.613861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1015/2026] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:36.615160 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac5f1a-3d00-443f-bc3a-8a62c6f1beb9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:36.630337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac5f1a-3d00-443f-bc3a-8a62c6f1beb9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:36.637028 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb6243-fa98-40ef-8cd8-8c9ed41e9801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:36.638877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb6243-fa98-40ef-8cd8-8c9ed41e9801 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:36.639329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb6243-fa98-40ef-8cd8-8c9ed41e9801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:36.639727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb6243-fa98-40ef-8cd8-8c9ed41e9801 admin admin] PATH_INFO: `/v3/projects/65f9ea0d82ca4cc99eeb0dad5af36b38/users/6339877c807d4062bf01451972b95261/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:36.642905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb6243-fa98-40ef-8cd8-8c9ed41e9801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f9ea0d82ca4cc99eeb0dad5af36b38, user_id=6339877c807d4062bf01451972b95261, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:36.646828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb6243-fa98-40ef-8cd8-8c9ed41e9801 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:36.663203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1016/2027] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:36 2022] PUT /identity/v3/projects/65f9ea0d82ca4cc99eeb0dad5af36b38/users/6339877c807d4062bf01451972b95261/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:36.670744 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ee9f8-026a-4311-8f7d-ec40470be93e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:36.671623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ee9f8-026a-4311-8f7d-ec40470be93e service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:36.671765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ee9f8-026a-4311-8f7d-ec40470be93e service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:36.672028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ee9f8-026a-4311-8f7d-ec40470be93e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:36.676633 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-536ee9f8-026a-4311-8f7d-ec40470be93e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:36.679067 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8a31b-1ad5-4b3e-8bb6-f109810bfe2e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:36.679472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8a31b-1ad5-4b3e-8bb6-f109810bfe2e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:36.679972 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8a31b-1ad5-4b3e-8bb6-f109810bfe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:36.702490 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:36.730673 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-20e8a31b-1ad5-4b3e-8bb6-f109810bfe2e None None] MFA Rules not processed for user `6339877c807d4062bf01451972b95261`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:36.732593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-20e8a31b-1ad5-4b3e-8bb6-f109810bfe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:36.770269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:36.795988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ee9f8-026a-4311-8f7d-ec40470be93e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:36.797452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ee9f8-026a-4311-8f7d-ec40470be93e service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:36.808636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1012/2028] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:09:36.809299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ee9f8-026a-4311-8f7d-ec40470be93e service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:36.810866 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-536ee9f8-026a-4311-8f7d-ec40470be93e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:36.826343 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ee9f8-026a-4311-8f7d-ec40470be93e service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:36.829355 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1017/2029] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:36 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:36.847570 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8a31b-1ad5-4b3e-8bb6-f109810bfe2e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:36.849244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-20e8a31b-1ad5-4b3e-8bb6-f109810bfe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:36.908730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace7552-2169-4928-8b0a-640b34cb141b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:36.910069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace7552-2169-4928-8b0a-640b34cb141b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:36.910427 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace7552-2169-4928-8b0a-640b34cb141b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:36.910791 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace7552-2169-4928-8b0a-640b34cb141b admin admin] PATH_INFO: `/v3/projects/f9d52efcea8145c9862a6a0604c20331` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:36.912370 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace7552-2169-4928-8b0a-640b34cb141b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9d52efcea8145c9862a6a0604c20331)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:36.914486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace7552-2169-4928-8b0a-640b34cb141b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:36.924158 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8a31b-1ad5-4b3e-8bb6-f109810bfe2e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:36.928306 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5f682-6cd2-480c-94c0-13be95d16141 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:36.928987 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5f682-6cd2-480c-94c0-13be95d16141 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:36.929306 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5f682-6cd2-480c-94c0-13be95d16141 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:36.929546 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5f682-6cd2-480c-94c0-13be95d16141 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:36.940288 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5f682-6cd2-480c-94c0-13be95d16141 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:36.942213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5f682-6cd2-480c-94c0-13be95d16141 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:36.959748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1018/2030] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:36 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:36.990792 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3ace7552-2169-4928-8b0a-640b34cb141b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d52efcea8145c9862a6a0604c20331', 'request_id': 'req-3ace7552-2169-4928-8b0a-640b34cb141b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:37.000538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3ace7552-2169-4928-8b0a-640b34cb141b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d52efcea8145c9862a6a0604c20331', 'request_id': 'req-3ace7552-2169-4928-8b0a-640b34cb141b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:37.015534 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3ace7552-2169-4928-8b0a-640b34cb141b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d52efcea8145c9862a6a0604c20331', 'request_id': 'req-3ace7552-2169-4928-8b0a-640b34cb141b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:37.029145 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3ace7552-2169-4928-8b0a-640b34cb141b admin admin] The token cache is being invalidate because project f9d52efcea8145c9862a6a0604c20331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:37.029537 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3ace7552-2169-4928-8b0a-640b34cb141b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:37.030311 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3ace7552-2169-4928-8b0a-640b34cb141b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:37.032300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1013/2031] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:36 2022] DELETE /identity/v3/projects/f9d52efcea8145c9862a6a0604c20331 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:37.036427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5f682-6cd2-480c-94c0-13be95d16141 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:37.049491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5f682-6cd2-480c-94c0-13be95d16141 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:37.069241 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace7552-2169-4928-8b0a-640b34cb141b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:37.070799 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3ace7552-2169-4928-8b0a-640b34cb141b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:37.125700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19640e3-5770-432c-8866-34622bf6e247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:37.126954 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19640e3-5770-432c-8866-34622bf6e247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:37.126954 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19640e3-5770-432c-8866-34622bf6e247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:37.127364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19640e3-5770-432c-8866-34622bf6e247 admin admin] PATH_INFO: `/v3/users/fc8fd52c248b414ca746b1cedf508d48` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:37.129527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19640e3-5770-432c-8866-34622bf6e247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8fd52c248b414ca746b1cedf508d48)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:37.132246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19640e3-5770-432c-8866-34622bf6e247 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:37.145128 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace7552-2169-4928-8b0a-640b34cb141b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:37.149335 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb786779-5795-4d7a-8154-afa409c37358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:37.150254 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb786779-5795-4d7a-8154-afa409c37358 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:37.150661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb786779-5795-4d7a-8154-afa409c37358 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:37.150945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb786779-5795-4d7a-8154-afa409c37358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:37.153624 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fb786779-5795-4d7a-8154-afa409c37358 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:37.186083 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:37.192821 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:37.195841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e19640e3-5770-432c-8866-34622bf6e247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8fd52c248b414ca746b1cedf508d48'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:37.214420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e19640e3-5770-432c-8866-34622bf6e247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8fd52c248b414ca746b1cedf508d48'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:37.215178 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e19640e3-5770-432c-8866-34622bf6e247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8fd52c248b414ca746b1cedf508d48'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:37.226178 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e19640e3-5770-432c-8866-34622bf6e247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8fd52c248b414ca746b1cedf508d48'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:37.228305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb786779-5795-4d7a-8154-afa409c37358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:37.230353 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb786779-5795-4d7a-8154-afa409c37358 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:37.234973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e19640e3-5770-432c-8866-34622bf6e247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8fd52c248b414ca746b1cedf508d48'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:37.241094 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1014/2032] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:09:37.241385 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1019/2033] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:37 2022] DELETE /identity/v3/users/fc8fd52c248b414ca746b1cedf508d48 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:37.705501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb786779-5795-4d7a-8154-afa409c37358 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:37.707155 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fb786779-5795-4d7a-8154-afa409c37358 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:37.734504 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb786779-5795-4d7a-8154-afa409c37358 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:37.879445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940d9a0-756d-40f2-9beb-51b22debd5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:37.880443 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940d9a0-756d-40f2-9beb-51b22debd5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:37.880813 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940d9a0-756d-40f2-9beb-51b22debd5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:37.881155 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940d9a0-756d-40f2-9beb-51b22debd5af admin admin] PATH_INFO: `/v3/projects/6f9b48ecf04a4a719d6dff66ac3a8e78` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:37.882448 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940d9a0-756d-40f2-9beb-51b22debd5af admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f9b48ecf04a4a719d6dff66ac3a8e78)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:37.884503 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940d9a0-756d-40f2-9beb-51b22debd5af admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:37.944044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1940d9a0-756d-40f2-9beb-51b22debd5af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f9b48ecf04a4a719d6dff66ac3a8e78', 'request_id': 'req-1940d9a0-756d-40f2-9beb-51b22debd5af'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:37.956736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1940d9a0-756d-40f2-9beb-51b22debd5af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f9b48ecf04a4a719d6dff66ac3a8e78', 'request_id': 'req-1940d9a0-756d-40f2-9beb-51b22debd5af'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:37.964859 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1940d9a0-756d-40f2-9beb-51b22debd5af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f9b48ecf04a4a719d6dff66ac3a8e78', 'request_id': 'req-1940d9a0-756d-40f2-9beb-51b22debd5af'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:37.978127 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1940d9a0-756d-40f2-9beb-51b22debd5af admin admin] The token cache is being invalidate because project 6f9b48ecf04a4a719d6dff66ac3a8e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:37.978460 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1940d9a0-756d-40f2-9beb-51b22debd5af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:37.979262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1940d9a0-756d-40f2-9beb-51b22debd5af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:37.981063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1015/2034] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:37 2022] DELETE /identity/v3/projects/6f9b48ecf04a4a719d6dff66ac3a8e78 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:37.986121 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d1b7b-8ee1-4e88-8e9b-2b9c694f7b1f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:37.986651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d1b7b-8ee1-4e88-8e9b-2b9c694f7b1f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:37.986759 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d1b7b-8ee1-4e88-8e9b-2b9c694f7b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:38.008503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-8b4d1b7b-8ee1-4e88-8e9b-2b9c694f7b1f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:38.010109 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8b4d1b7b-8ee1-4e88-8e9b-2b9c694f7b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:38.108909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1020/2035] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:38.116822 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb1dd0-632d-4aef-8a6f-3e7328924532 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:38.117115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb1dd0-632d-4aef-8a6f-3e7328924532 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:38.117466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb1dd0-632d-4aef-8a6f-3e7328924532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:38.139416 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-19eb1dd0-632d-4aef-8a6f-3e7328924532 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:38.140806 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-19eb1dd0-632d-4aef-8a6f-3e7328924532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:38.150796 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1016/2036] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:38.155779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d1b7b-8ee1-4e88-8e9b-2b9c694f7b1f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:38.166379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d1b7b-8ee1-4e88-8e9b-2b9c694f7b1f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:38.171251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ca8e7-d47a-4cfe-9783-ce39ec1ce5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:38.171832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ca8e7-d47a-4cfe-9783-ce39ec1ce5fe admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:38.172113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ca8e7-d47a-4cfe-9783-ce39ec1ce5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:38.172388 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ca8e7-d47a-4cfe-9783-ce39ec1ce5fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:38.173119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ca8e7-d47a-4cfe-9783-ce39ec1ce5fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:38.173420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ca8e7-d47a-4cfe-9783-ce39ec1ce5fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:38.175091 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ca8e7-d47a-4cfe-9783-ce39ec1ce5fe admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:38.188664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1021/2037] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:09:38.197511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb1dd0-632d-4aef-8a6f-3e7328924532 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:38.206434 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb1dd0-632d-4aef-8a6f-3e7328924532 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:38.214001 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5102ce-368d-474e-995b-149001e636db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:38.214941 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5102ce-368d-474e-995b-149001e636db admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:38.215430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5102ce-368d-474e-995b-149001e636db admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:38.215881 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5102ce-368d-474e-995b-149001e636db admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:38.217026 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5102ce-368d-474e-995b-149001e636db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:38.220548 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5102ce-368d-474e-995b-149001e636db admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:38.261970 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1017/2038] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:38 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:38.264656 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ca8e7-d47a-4cfe-9783-ce39ec1ce5fe admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:38.276547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ca8e7-d47a-4cfe-9783-ce39ec1ce5fe admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:38.346445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e14bf6-5929-40c9-a512-e5956898d90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:38.347311 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e14bf6-5929-40c9-a512-e5956898d90a admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:38.347628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e14bf6-5929-40c9-a512-e5956898d90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:38.347903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e14bf6-5929-40c9-a512-e5956898d90a admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:38.348688 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e14bf6-5929-40c9-a512-e5956898d90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:38.350851 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e14bf6-5929-40c9-a512-e5956898d90a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:38.376097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1022/2039] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:38 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:09:38.380871 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5102ce-368d-474e-995b-149001e636db admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:38.396811 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5102ce-368d-474e-995b-149001e636db admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:38.403165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd189c-fd49-4698-b9c4-f8c81775b12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:38.403968 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd189c-fd49-4698-b9c4-f8c81775b12e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:38.404311 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd189c-fd49-4698-b9c4-f8c81775b12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:38.405103 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd189c-fd49-4698-b9c4-f8c81775b12e admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:38.405386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd189c-fd49-4698-b9c4-f8c81775b12e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:38.407034 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd189c-fd49-4698-b9c4-f8c81775b12e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:38.418671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1018/2040] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:38.423084 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e14bf6-5929-40c9-a512-e5956898d90a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:38.433924 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e14bf6-5929-40c9-a512-e5956898d90a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:38.438809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f7067-d3e7-47b4-a36d-bbc26b1b9216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:38.439585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f7067-d3e7-47b4-a36d-bbc26b1b9216 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:38.439938 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f7067-d3e7-47b4-a36d-bbc26b1b9216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:38.440278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f7067-d3e7-47b4-a36d-bbc26b1b9216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:38.441107 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f7067-d3e7-47b4-a36d-bbc26b1b9216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:38.443028 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f7067-d3e7-47b4-a36d-bbc26b1b9216 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:38.459282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1023/2041] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:38.460818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd189c-fd49-4698-b9c4-f8c81775b12e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:38.472552 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd189c-fd49-4698-b9c4-f8c81775b12e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:38.477106 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d2eab-8f77-493b-a154-645b0ee2d55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:38.478417 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d2eab-8f77-493b-a154-645b0ee2d55e admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:38.478826 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d2eab-8f77-493b-a154-645b0ee2d55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:38.479337 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d2eab-8f77-493b-a154-645b0ee2d55e admin admin] PATH_INFO: `/v3/projects/49c60639f81447da92a78aa9ddec3641/users/6a31c08678404649b8464be63e69d449/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:38.497769 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d2eab-8f77-493b-a154-645b0ee2d55e admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c60639f81447da92a78aa9ddec3641, user_id=6a31c08678404649b8464be63e69d449, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:38.500836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d2eab-8f77-493b-a154-645b0ee2d55e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:38.504437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:38.537277 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1019/2042] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:38 2022] PUT /identity/v3/projects/49c60639f81447da92a78aa9ddec3641/users/6a31c08678404649b8464be63e69d449/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:38.539228 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d98ae-b8cf-4b87-97e7-1c9dcbf40bfe None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:38.539522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d98ae-b8cf-4b87-97e7-1c9dcbf40bfe None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:38.539796 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d98ae-b8cf-4b87-97e7-1c9dcbf40bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:38.577317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3e6d98ae-b8cf-4b87-97e7-1c9dcbf40bfe None None] MFA Rules not processed for user `6a31c08678404649b8464be63e69d449`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:38.579754 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3e6d98ae-b8cf-4b87-97e7-1c9dcbf40bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:38.593893 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:38.663378 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1024/2043] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:38.671055 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d2eab-8f77-493b-a154-645b0ee2d55e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:38.768653 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d2eab-8f77-493b-a154-645b0ee2d55e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:38.776166 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb1ac4-f3f2-4a90-a6e6-3bc0d7ac86ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:38.776947 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb1ac4-f3f2-4a90-a6e6-3bc0d7ac86ac admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:38.777326 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb1ac4-f3f2-4a90-a6e6-3bc0d7ac86ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:38.777673 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb1ac4-f3f2-4a90-a6e6-3bc0d7ac86ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:38.778500 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb1ac4-f3f2-4a90-a6e6-3bc0d7ac86ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:38.781324 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb1ac4-f3f2-4a90-a6e6-3bc0d7ac86ac admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:38.817576 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1020/2044] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:38 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:38.821668 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d98ae-b8cf-4b87-97e7-1c9dcbf40bfe None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:38.840267 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d98ae-b8cf-4b87-97e7-1c9dcbf40bfe None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:38.927265 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da573c4c-ba3a-4a40-9e5c-bc5e5fa8003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:38.928056 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da573c4c-ba3a-4a40-9e5c-bc5e5fa8003e admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:38.928307 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da573c4c-ba3a-4a40-9e5c-bc5e5fa8003e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:38.928578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da573c4c-ba3a-4a40-9e5c-bc5e5fa8003e admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:38.929294 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da573c4c-ba3a-4a40-9e5c-bc5e5fa8003e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:38.931809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da573c4c-ba3a-4a40-9e5c-bc5e5fa8003e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:38.969977 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1025/2045] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:38 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:38.970251 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb1ac4-f3f2-4a90-a6e6-3bc0d7ac86ac admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:38.986159 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb1ac4-f3f2-4a90-a6e6-3bc0d7ac86ac admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:38.994448 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b930bc-d845-4a8e-88eb-58f91f1872d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:38.996033 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b930bc-d845-4a8e-88eb-58f91f1872d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:38.996567 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b930bc-d845-4a8e-88eb-58f91f1872d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:38.997550 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b930bc-d845-4a8e-88eb-58f91f1872d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:38.998767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b930bc-d845-4a8e-88eb-58f91f1872d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:39.001250 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b930bc-d845-4a8e-88eb-58f91f1872d8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:39.032551 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1021/2046] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:39.034786 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da573c4c-ba3a-4a40-9e5c-bc5e5fa8003e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:39.055360 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da573c4c-ba3a-4a40-9e5c-bc5e5fa8003e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:39.062217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319dfe3-d06a-4735-b3a2-48188e552c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:39.063498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319dfe3-d06a-4735-b3a2-48188e552c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:39.064057 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319dfe3-d06a-4735-b3a2-48188e552c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:39.064488 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319dfe3-d06a-4735-b3a2-48188e552c90 admin admin] PATH_INFO: `/v3/projects/a4097e2c57f54b2ba4d1e87651bce2ef/users/16e051e726394066938664a52617da2c/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:39.086724 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319dfe3-d06a-4735-b3a2-48188e552c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4097e2c57f54b2ba4d1e87651bce2ef, user_id=16e051e726394066938664a52617da2c, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:39.089711 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319dfe3-d06a-4735-b3a2-48188e552c90 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:39.121861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1026/2047] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:39 2022] PUT /identity/v3/projects/a4097e2c57f54b2ba4d1e87651bce2ef/users/16e051e726394066938664a52617da2c/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:39.125237 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b930bc-d845-4a8e-88eb-58f91f1872d8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:39.143052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b930bc-d845-4a8e-88eb-58f91f1872d8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:39.207995 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94868d1-3b08-4d46-ba65-7279191137fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:39.208727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94868d1-3b08-4d46-ba65-7279191137fd admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:39.209014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94868d1-3b08-4d46-ba65-7279191137fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:39.209290 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94868d1-3b08-4d46-ba65-7279191137fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:39.210077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94868d1-3b08-4d46-ba65-7279191137fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:39.211734 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94868d1-3b08-4d46-ba65-7279191137fd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:39.222532 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1022/2048] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:39.226842 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319dfe3-d06a-4735-b3a2-48188e552c90 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:39.238066 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319dfe3-d06a-4735-b3a2-48188e552c90 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:39.243827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19ba2a-4db0-4022-a856-6a5fe84969cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:39.244828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19ba2a-4db0-4022-a856-6a5fe84969cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:39.245120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19ba2a-4db0-4022-a856-6a5fe84969cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:39.245403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19ba2a-4db0-4022-a856-6a5fe84969cf admin admin] PATH_INFO: `/v3/projects/a4097e2c57f54b2ba4d1e87651bce2ef/users/16e051e726394066938664a52617da2c/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:39.247515 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19ba2a-4db0-4022-a856-6a5fe84969cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4097e2c57f54b2ba4d1e87651bce2ef, user_id=16e051e726394066938664a52617da2c, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:39.250261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19ba2a-4db0-4022-a856-6a5fe84969cf admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:39.261889 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1027/2049] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:39 2022] PUT /identity/v3/projects/a4097e2c57f54b2ba4d1e87651bce2ef/users/16e051e726394066938664a52617da2c/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:39.272426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab86d-ca85-4121-a969-4f0983349ebc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:39.272714 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab86d-ca85-4121-a969-4f0983349ebc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:39.272997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab86d-ca85-4121-a969-4f0983349ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:39.305333 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-101ab86d-ca85-4121-a969-4f0983349ebc None None] MFA Rules not processed for user `16e051e726394066938664a52617da2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:39.307901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-101ab86d-ca85-4121-a969-4f0983349ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:39.375876 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:39.397613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1023/2050] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:39.409205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19ba2a-4db0-4022-a856-6a5fe84969cf admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:39.411161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fa19ba2a-4db0-4022-a856-6a5fe84969cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:39.474817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19ba2a-4db0-4022-a856-6a5fe84969cf admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:39.480419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7211b-9392-468b-a843-0232ec41740f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:39.481110 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7211b-9392-468b-a843-0232ec41740f service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:39.481373 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7211b-9392-468b-a843-0232ec41740f service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:39.481676 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7211b-9392-468b-a843-0232ec41740f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:39.492010 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7211b-9392-468b-a843-0232ec41740f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:39.493471 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7211b-9392-468b-a843-0232ec41740f service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:39.504235 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1028/2051] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:39.614273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ab86d-ca85-4121-a969-4f0983349ebc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:39.615909 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-101ab86d-ca85-4121-a969-4f0983349ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:39.634275 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ab86d-ca85-4121-a969-4f0983349ebc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:39.639219 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc2be6-ef92-42ce-bcf7-97710498185b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:39.640096 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc2be6-ef92-42ce-bcf7-97710498185b service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:39.640564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc2be6-ef92-42ce-bcf7-97710498185b service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:39.640897 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc2be6-ef92-42ce-bcf7-97710498185b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:39.703617 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc2be6-ef92-42ce-bcf7-97710498185b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:39.705467 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc2be6-ef92-42ce-bcf7-97710498185b service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:39.716139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1024/2052] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:39.732351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7211b-9392-468b-a843-0232ec41740f service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:39.733906 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c4b7211b-9392-468b-a843-0232ec41740f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:39.741649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:39.815873 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7211b-9392-468b-a843-0232ec41740f service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:39.820960 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c77164-7a7f-4210-8f1a-d0cc26d51ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:39.822059 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c77164-7a7f-4210-8f1a-d0cc26d51ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:39.822342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c77164-7a7f-4210-8f1a-d0cc26d51ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:39.822640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c77164-7a7f-4210-8f1a-d0cc26d51ea8 admin admin] PATH_INFO: `/v3/users/7a827c1a02534106a2d38c8670fd298e` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:39.823854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c77164-7a7f-4210-8f1a-d0cc26d51ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a827c1a02534106a2d38c8670fd298e)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:39.825844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c77164-7a7f-4210-8f1a-d0cc26d51ea8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:39.884410 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-68c77164-7a7f-4210-8f1a-d0cc26d51ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a827c1a02534106a2d38c8670fd298e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:39.899699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-68c77164-7a7f-4210-8f1a-d0cc26d51ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a827c1a02534106a2d38c8670fd298e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:39.903975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-68c77164-7a7f-4210-8f1a-d0cc26d51ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a827c1a02534106a2d38c8670fd298e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:39.913038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-68c77164-7a7f-4210-8f1a-d0cc26d51ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a827c1a02534106a2d38c8670fd298e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:39.923873 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-68c77164-7a7f-4210-8f1a-d0cc26d51ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a827c1a02534106a2d38c8670fd298e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:39.930294 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1029/2053] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:39 2022] DELETE /identity/v3/users/7a827c1a02534106a2d38c8670fd298e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:39.935237 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361977c-f090-4172-955b-890252ba9f18 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:39.935849 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361977c-f090-4172-955b-890252ba9f18 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:39.935849 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361977c-f090-4172-955b-890252ba9f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:39.953955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0361977c-f090-4172-955b-890252ba9f18 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:39.955493 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0361977c-f090-4172-955b-890252ba9f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:40.071549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1025/2054] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:40.083039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c77164-7a7f-4210-8f1a-d0cc26d51ea8 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:40.085208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-68c77164-7a7f-4210-8f1a-d0cc26d51ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:40.211000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c77164-7a7f-4210-8f1a-d0cc26d51ea8 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:40.221953 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01e129-c2c4-43b1-9e81-c3713a6aaa6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:40.222641 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01e129-c2c4-43b1-9e81-c3713a6aaa6a service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:40.222971 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01e129-c2c4-43b1-9e81-c3713a6aaa6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:40.223266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01e129-c2c4-43b1-9e81-c3713a6aaa6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:40.254065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01e129-c2c4-43b1-9e81-c3713a6aaa6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:40.254065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01e129-c2c4-43b1-9e81-c3713a6aaa6a service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:40.264184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1030/2055] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:40.616657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361977c-f090-4172-955b-890252ba9f18 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:40.618610 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0361977c-f090-4172-955b-890252ba9f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:40.631756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361977c-f090-4172-955b-890252ba9f18 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:40.637724 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:40.638976 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:40.639257 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:40.639709 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2 admin admin] PATH_INFO: `/v3/projects/dad7075ac93549279db168eb6440836a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:40.641260 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad7075ac93549279db168eb6440836a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:40.643759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:40.710431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad7075ac93549279db168eb6440836a', 'request_id': 'req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:40.731727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad7075ac93549279db168eb6440836a', 'request_id': 'req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:40.740004 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad7075ac93549279db168eb6440836a', 'request_id': 'req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:40.752643 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2 admin admin] The token cache is being invalidate because project dad7075ac93549279db168eb6440836a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:40.752939 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:40.753670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:40.755360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1026/2056] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:40 2022] DELETE /identity/v3/projects/dad7075ac93549279db168eb6440836a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:40.763723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01e129-c2c4-43b1-9e81-c3713a6aaa6a service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:40.781844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01e129-c2c4-43b1-9e81-c3713a6aaa6a service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:40.816633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:40.873433 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93216b91-ada6-4d8a-b41a-88c8ffabe2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:40.874387 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93216b91-ada6-4d8a-b41a-88c8ffabe2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:40.874665 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93216b91-ada6-4d8a-b41a-88c8ffabe2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:40.874942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93216b91-ada6-4d8a-b41a-88c8ffabe2cb admin admin] PATH_INFO: `/v3/users/6037d2618e3e42cda5193253979ba4ad` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:40.876164 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93216b91-ada6-4d8a-b41a-88c8ffabe2cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6037d2618e3e42cda5193253979ba4ad)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:40.878323 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93216b91-ada6-4d8a-b41a-88c8ffabe2cb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:40.930802 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-93216b91-ada6-4d8a-b41a-88c8ffabe2cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6037d2618e3e42cda5193253979ba4ad'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:40.943585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-93216b91-ada6-4d8a-b41a-88c8ffabe2cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6037d2618e3e42cda5193253979ba4ad'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:40.944300 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-93216b91-ada6-4d8a-b41a-88c8ffabe2cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6037d2618e3e42cda5193253979ba4ad'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:40.953063 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-93216b91-ada6-4d8a-b41a-88c8ffabe2cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6037d2618e3e42cda5193253979ba4ad'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:40.961064 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-93216b91-ada6-4d8a-b41a-88c8ffabe2cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6037d2618e3e42cda5193253979ba4ad'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:40.967793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1031/2057] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:40 2022] DELETE /identity/v3/users/6037d2618e3e42cda5193253979ba4ad => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:41.343991 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:41.347464 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:41.371015 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc6c5-bea9-4d41-8eb4-538917bc7fe2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:41.382675 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:41.460199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713776c-eb8d-4013-b45b-ab57ebc45dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:41.461164 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713776c-eb8d-4013-b45b-ab57ebc45dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:41.461451 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713776c-eb8d-4013-b45b-ab57ebc45dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:41.461727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713776c-eb8d-4013-b45b-ab57ebc45dce admin admin] PATH_INFO: `/v3/projects/c1b7104353744e9dbcc3ee300f246932` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:41.464475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713776c-eb8d-4013-b45b-ab57ebc45dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b7104353744e9dbcc3ee300f246932)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:41.466757 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713776c-eb8d-4013-b45b-ab57ebc45dce admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:41.523718 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5713776c-eb8d-4013-b45b-ab57ebc45dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b7104353744e9dbcc3ee300f246932', 'request_id': 'req-5713776c-eb8d-4013-b45b-ab57ebc45dce'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:41.534216 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5713776c-eb8d-4013-b45b-ab57ebc45dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b7104353744e9dbcc3ee300f246932', 'request_id': 'req-5713776c-eb8d-4013-b45b-ab57ebc45dce'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:41.541524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5713776c-eb8d-4013-b45b-ab57ebc45dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b7104353744e9dbcc3ee300f246932', 'request_id': 'req-5713776c-eb8d-4013-b45b-ab57ebc45dce'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:41.552060 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5713776c-eb8d-4013-b45b-ab57ebc45dce admin admin] The token cache is being invalidate because project c1b7104353744e9dbcc3ee300f246932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:41.552349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5713776c-eb8d-4013-b45b-ab57ebc45dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:41.553042 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5713776c-eb8d-4013-b45b-ab57ebc45dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:41.554816 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1027/2058] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:41 2022] DELETE /identity/v3/projects/c1b7104353744e9dbcc3ee300f246932 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:41.560053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ebde-495f-490c-b3b3-bea7f7ef2a3d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:41.560560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ebde-495f-490c-b3b3-bea7f7ef2a3d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:41.560651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ebde-495f-490c-b3b3-bea7f7ef2a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:41.581349 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-45b0ebde-495f-490c-b3b3-bea7f7ef2a3d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:41.582770 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-45b0ebde-495f-490c-b3b3-bea7f7ef2a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:41.666493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1032/2059] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:41.674680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10e8c4-12d0-49c7-a387-eb2e14f32e77 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:41.674970 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10e8c4-12d0-49c7-a387-eb2e14f32e77 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:41.675249 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10e8c4-12d0-49c7-a387-eb2e14f32e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:41.694937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fb10e8c4-12d0-49c7-a387-eb2e14f32e77 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:41.696209 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fb10e8c4-12d0-49c7-a387-eb2e14f32e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:41.705189 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1028/2060] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:41.710648 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0ebde-495f-490c-b3b3-bea7f7ef2a3d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:41.728288 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0ebde-495f-490c-b3b3-bea7f7ef2a3d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:41.733553 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc33dbd-5e09-4d44-a013-d06453010695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:41.734297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc33dbd-5e09-4d44-a013-d06453010695 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:41.734574 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc33dbd-5e09-4d44-a013-d06453010695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:41.734836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc33dbd-5e09-4d44-a013-d06453010695 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:41.735575 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc33dbd-5e09-4d44-a013-d06453010695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:41.735878 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc33dbd-5e09-4d44-a013-d06453010695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:41.737537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc33dbd-5e09-4d44-a013-d06453010695 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:41.751806 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1033/2061] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:41.756925 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10e8c4-12d0-49c7-a387-eb2e14f32e77 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:41.772594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10e8c4-12d0-49c7-a387-eb2e14f32e77 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:41.778333 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6952574-f48f-4ff8-9674-aa8ba8445871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:41.779203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6952574-f48f-4ff8-9674-aa8ba8445871 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:41.779468 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6952574-f48f-4ff8-9674-aa8ba8445871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:41.779739 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6952574-f48f-4ff8-9674-aa8ba8445871 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:41.780749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6952574-f48f-4ff8-9674-aa8ba8445871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:41.783771 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6952574-f48f-4ff8-9674-aa8ba8445871 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:41.819675 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1029/2062] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:41 2022] POST /identity/v3/projects => generated 391 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:09:41.824858 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc33dbd-5e09-4d44-a013-d06453010695 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:41.835937 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc33dbd-5e09-4d44-a013-d06453010695 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:41.870441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:41.901863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f846087-02c7-4086-b5c0-5152a2c7acba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:41.902560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f846087-02c7-4086-b5c0-5152a2c7acba admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:41.902843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f846087-02c7-4086-b5c0-5152a2c7acba admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:41.903121 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f846087-02c7-4086-b5c0-5152a2c7acba admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:41.903833 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f846087-02c7-4086-b5c0-5152a2c7acba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:41.905823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f846087-02c7-4086-b5c0-5152a2c7acba admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:41.934855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1034/2063] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:41 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:41.939357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6952574-f48f-4ff8-9674-aa8ba8445871 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:41.951268 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6952574-f48f-4ff8-9674-aa8ba8445871 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:41.956511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483019c8-4c3d-4e3c-97fa-29ddda04cd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:41.957222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483019c8-4c3d-4e3c-97fa-29ddda04cd92 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:41.957638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483019c8-4c3d-4e3c-97fa-29ddda04cd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:41.957972 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483019c8-4c3d-4e3c-97fa-29ddda04cd92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:41.958744 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483019c8-4c3d-4e3c-97fa-29ddda04cd92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:41.960670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483019c8-4c3d-4e3c-97fa-29ddda04cd92 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:41.972764 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1030/2064] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:41.978006 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f846087-02c7-4086-b5c0-5152a2c7acba admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:41.988604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f846087-02c7-4086-b5c0-5152a2c7acba admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:41.994722 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d18ba-d79b-46dd-ad21-df0e6b85cefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:41.995632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d18ba-d79b-46dd-ad21-df0e6b85cefe admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:41.995998 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d18ba-d79b-46dd-ad21-df0e6b85cefe admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:41.996312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d18ba-d79b-46dd-ad21-df0e6b85cefe admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:41.997188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d18ba-d79b-46dd-ad21-df0e6b85cefe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:41.998990 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d18ba-d79b-46dd-ad21-df0e6b85cefe admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:42.011147 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1035/2065] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:42.015902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483019c8-4c3d-4e3c-97fa-29ddda04cd92 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:42.026651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483019c8-4c3d-4e3c-97fa-29ddda04cd92 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:42.031469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cf91a-7181-431c-921f-d6e9a98a57ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:42.032322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cf91a-7181-431c-921f-d6e9a98a57ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:42.032603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cf91a-7181-431c-921f-d6e9a98a57ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:42.032872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cf91a-7181-431c-921f-d6e9a98a57ab admin admin] PATH_INFO: `/v3/projects/8a806e34c70b4b558b8ce423eb1a7e3f/users/3c54b67181ed455ea3c5feb6fb63d7bf/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:42.050345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cf91a-7181-431c-921f-d6e9a98a57ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a806e34c70b4b558b8ce423eb1a7e3f, user_id=3c54b67181ed455ea3c5feb6fb63d7bf, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:42.053029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cf91a-7181-431c-921f-d6e9a98a57ab admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:42.066855 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1031/2066] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:42 2022] PUT /identity/v3/projects/8a806e34c70b4b558b8ce423eb1a7e3f/users/3c54b67181ed455ea3c5feb6fb63d7bf/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:42.080411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03375e39-2543-4234-adfe-1c380adeb774 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:42.080702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03375e39-2543-4234-adfe-1c380adeb774 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:42.080978 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03375e39-2543-4234-adfe-1c380adeb774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:42.109854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-03375e39-2543-4234-adfe-1c380adeb774 None None] MFA Rules not processed for user `3c54b67181ed455ea3c5feb6fb63d7bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:42.111097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-03375e39-2543-4234-adfe-1c380adeb774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:42.193565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1036/2067] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:42.200431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cf91a-7181-431c-921f-d6e9a98a57ab admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:42.249668 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:42.276992 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cf91a-7181-431c-921f-d6e9a98a57ab admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:42.282568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a3a64-0910-4ace-a8b3-86cf23035038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:42.283170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a3a64-0910-4ace-a8b3-86cf23035038 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:42.283450 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a3a64-0910-4ace-a8b3-86cf23035038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:42.283726 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a3a64-0910-4ace-a8b3-86cf23035038 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:42.284424 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a3a64-0910-4ace-a8b3-86cf23035038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:42.286399 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a3a64-0910-4ace-a8b3-86cf23035038 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:42.321773 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1032/2068] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:42 2022] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:42.326448 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03375e39-2543-4234-adfe-1c380adeb774 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:42.340680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03375e39-2543-4234-adfe-1c380adeb774 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:42.408563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5faacf-c2f9-432d-b736-17ca429bbfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:42.409204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5faacf-c2f9-432d-b736-17ca429bbfaa admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:42.409483 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5faacf-c2f9-432d-b736-17ca429bbfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:42.409825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5faacf-c2f9-432d-b736-17ca429bbfaa admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:42.410521 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5faacf-c2f9-432d-b736-17ca429bbfaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:42.412513 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5faacf-c2f9-432d-b736-17ca429bbfaa admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:42.436807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1037/2069] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:42 2022] POST /identity/v3/users => generated 303 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:42.453337 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a3a64-0910-4ace-a8b3-86cf23035038 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:42.463211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5faacf-c2f9-432d-b736-17ca429bbfaa admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:42.469448 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a3a64-0910-4ace-a8b3-86cf23035038 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:42.469553 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0c5faacf-c2f9-432d-b736-17ca429bbfaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:42.477604 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8efcce-fb44-49b4-87ce-7496b32b621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:42.478887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8efcce-fb44-49b4-87ce-7496b32b621d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:42.481785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8efcce-fb44-49b4-87ce-7496b32b621d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:42.482183 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8efcce-fb44-49b4-87ce-7496b32b621d admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:42.482987 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8efcce-fb44-49b4-87ce-7496b32b621d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:42.488722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8efcce-fb44-49b4-87ce-7496b32b621d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:42.491393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5faacf-c2f9-432d-b736-17ca429bbfaa admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:42.502486 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ad547-959e-4603-b76f-4f652c19f659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:42.504704 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ad547-959e-4603-b76f-4f652c19f659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:42.505632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ad547-959e-4603-b76f-4f652c19f659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:42.506527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ad547-959e-4603-b76f-4f652c19f659 admin admin] PATH_INFO: `/v3/users/6a31c08678404649b8464be63e69d449` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:42.509682 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ad547-959e-4603-b76f-4f652c19f659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a31c08678404649b8464be63e69d449)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:42.517956 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1033/2070] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:42.518182 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ad547-959e-4603-b76f-4f652c19f659 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:42.520179 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8efcce-fb44-49b4-87ce-7496b32b621d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:42.537913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8efcce-fb44-49b4-87ce-7496b32b621d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:42.543890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2277759-90ef-4f3d-b49d-dad0df6ee253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:42.545259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2277759-90ef-4f3d-b49d-dad0df6ee253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:42.546361 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2277759-90ef-4f3d-b49d-dad0df6ee253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:42.546816 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2277759-90ef-4f3d-b49d-dad0df6ee253 admin admin] PATH_INFO: `/v3/projects/285012167b54438e91d15b769b27eec0/users/4bb3d78839c74d7193aaa02a02fb83f1/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:42.561672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:42.565856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2277759-90ef-4f3d-b49d-dad0df6ee253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=285012167b54438e91d15b769b27eec0, user_id=4bb3d78839c74d7193aaa02a02fb83f1, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:42.568785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2277759-90ef-4f3d-b49d-dad0df6ee253 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:42.584949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1034/2071] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:42 2022] PUT /identity/v3/projects/285012167b54438e91d15b769b27eec0/users/4bb3d78839c74d7193aaa02a02fb83f1/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:42.588025 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2277759-90ef-4f3d-b49d-dad0df6ee253 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:42.589823 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a2277759-90ef-4f3d-b49d-dad0df6ee253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:42.596042 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2b2ad547-959e-4603-b76f-4f652c19f659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a31c08678404649b8464be63e69d449'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:42.616180 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2b2ad547-959e-4603-b76f-4f652c19f659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a31c08678404649b8464be63e69d449'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:42.618347 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2b2ad547-959e-4603-b76f-4f652c19f659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a31c08678404649b8464be63e69d449'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:42.628040 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2b2ad547-959e-4603-b76f-4f652c19f659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a31c08678404649b8464be63e69d449'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:42.642135 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2b2ad547-959e-4603-b76f-4f652c19f659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a31c08678404649b8464be63e69d449'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:42.650657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1038/2072] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:42 2022] DELETE /identity/v3/users/6a31c08678404649b8464be63e69d449 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:42.651737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ad547-959e-4603-b76f-4f652c19f659 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:42.653332 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2b2ad547-959e-4603-b76f-4f652c19f659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:42.673756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2277759-90ef-4f3d-b49d-dad0df6ee253 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:42.722827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ad547-959e-4603-b76f-4f652c19f659 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:42.727884 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72893fb4-1ead-41d1-ac15-b5d148e86146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:42.728569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72893fb4-1ead-41d1-ac15-b5d148e86146 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:42.728874 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72893fb4-1ead-41d1-ac15-b5d148e86146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:42.729133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72893fb4-1ead-41d1-ac15-b5d148e86146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:42.729936 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72893fb4-1ead-41d1-ac15-b5d148e86146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:42.731577 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72893fb4-1ead-41d1-ac15-b5d148e86146 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:42.731974 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483e8d6-3437-4767-aa58-b9f3e7469aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:42.732866 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483e8d6-3437-4767-aa58-b9f3e7469aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:42.733151 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483e8d6-3437-4767-aa58-b9f3e7469aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:42.733421 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483e8d6-3437-4767-aa58-b9f3e7469aef admin admin] PATH_INFO: `/v3/users/ccc95d4f35b34c1b9f685784c12941e5` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:42.734746 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483e8d6-3437-4767-aa58-b9f3e7469aef admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc95d4f35b34c1b9f685784c12941e5)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:42.736745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483e8d6-3437-4767-aa58-b9f3e7469aef admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:42.742396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1039/2073] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:42.747187 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225aa85-2a93-4d8d-88d0-876b0dda08ff None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:42.747470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225aa85-2a93-4d8d-88d0-876b0dda08ff None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:42.747753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225aa85-2a93-4d8d-88d0-876b0dda08ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:42.767183 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1225aa85-2a93-4d8d-88d0-876b0dda08ff None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:42.768436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1225aa85-2a93-4d8d-88d0-876b0dda08ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:42.778909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1040/2074] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:42.780194 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225aa85-2a93-4d8d-88d0-876b0dda08ff None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:42.785297 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:42.790670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225aa85-2a93-4d8d-88d0-876b0dda08ff None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:42.792689 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d483e8d6-3437-4767-aa58-b9f3e7469aef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc95d4f35b34c1b9f685784c12941e5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:42.793513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d483e8d6-3437-4767-aa58-b9f3e7469aef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc95d4f35b34c1b9f685784c12941e5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:42.795679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb4ab9-cdc2-4526-973e-85d4beb537d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:42.796588 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb4ab9-cdc2-4526-973e-85d4beb537d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:42.797035 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb4ab9-cdc2-4526-973e-85d4beb537d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:42.797449 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb4ab9-cdc2-4526-973e-85d4beb537d1 admin admin] PATH_INFO: `/v3/projects/285012167b54438e91d15b769b27eec0/users/4bb3d78839c74d7193aaa02a02fb83f1/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:42.799548 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb4ab9-cdc2-4526-973e-85d4beb537d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=285012167b54438e91d15b769b27eec0, user_id=4bb3d78839c74d7193aaa02a02fb83f1, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:42.802471 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d483e8d6-3437-4767-aa58-b9f3e7469aef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc95d4f35b34c1b9f685784c12941e5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:42.802614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb4ab9-cdc2-4526-973e-85d4beb537d1 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:42.813210 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1041/2075] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:42 2022] PUT /identity/v3/projects/285012167b54438e91d15b769b27eec0/users/4bb3d78839c74d7193aaa02a02fb83f1/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:42.814398 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb4ab9-cdc2-4526-973e-85d4beb537d1 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:42.815475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d483e8d6-3437-4767-aa58-b9f3e7469aef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc95d4f35b34c1b9f685784c12941e5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:42.816262 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-10cb4ab9-cdc2-4526-973e-85d4beb537d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:42.823542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d483e8d6-3437-4767-aa58-b9f3e7469aef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc95d4f35b34c1b9f685784c12941e5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:42.831460 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1035/2076] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:42 2022] DELETE /identity/v3/users/ccc95d4f35b34c1b9f685784c12941e5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:42.832735 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997f1c2-8b0f-430e-8e1f-0a6831da24e9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:42.833029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997f1c2-8b0f-430e-8e1f-0a6831da24e9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:42.833307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997f1c2-8b0f-430e-8e1f-0a6831da24e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:42.862011 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d997f1c2-8b0f-430e-8e1f-0a6831da24e9 None None] MFA Rules not processed for user `4bb3d78839c74d7193aaa02a02fb83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:42.863229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d997f1c2-8b0f-430e-8e1f-0a6831da24e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:42.875947 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb4ab9-cdc2-4526-973e-85d4beb537d1 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:42.908407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:42.929243 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829849dd-0fbf-4110-b1a3-30dc2d25d720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:42.929955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829849dd-0fbf-4110-b1a3-30dc2d25d720 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:42.930242 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829849dd-0fbf-4110-b1a3-30dc2d25d720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:42.930567 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829849dd-0fbf-4110-b1a3-30dc2d25d720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:42.933161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-829849dd-0fbf-4110-b1a3-30dc2d25d720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:42.935585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1036/2077] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:42.936856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be22e5f-6385-49df-9589-3da274da8ee5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:42.937150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be22e5f-6385-49df-9589-3da274da8ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:42.937427 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be22e5f-6385-49df-9589-3da274da8ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:42.956703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4be22e5f-6385-49df-9589-3da274da8ee5 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:42.958013 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4be22e5f-6385-49df-9589-3da274da8ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:43.007942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829849dd-0fbf-4110-b1a3-30dc2d25d720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:43.009565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829849dd-0fbf-4110-b1a3-30dc2d25d720 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:43.019143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1042/2078] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:43.019973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829849dd-0fbf-4110-b1a3-30dc2d25d720 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:43.021438 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-829849dd-0fbf-4110-b1a3-30dc2d25d720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:43.023805 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1037/2079] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:43.036058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be22e5f-6385-49df-9589-3da274da8ee5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:43.037697 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4be22e5f-6385-49df-9589-3da274da8ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:43.050532 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be22e5f-6385-49df-9589-3da274da8ee5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:43.054783 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd0eb8-1615-4f64-a293-d8b00e75dcf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:43.055617 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd0eb8-1615-4f64-a293-d8b00e75dcf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:43.055901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd0eb8-1615-4f64-a293-d8b00e75dcf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:43.056217 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd0eb8-1615-4f64-a293-d8b00e75dcf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:43.067293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd0eb8-1615-4f64-a293-d8b00e75dcf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:43.068801 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd0eb8-1615-4f64-a293-d8b00e75dcf3 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:43.080115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1038/2080] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:09:43.089338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829849dd-0fbf-4110-b1a3-30dc2d25d720 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:43.092989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191f694-82db-4977-9f89-f9d8870fa13c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:43.093653 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191f694-82db-4977-9f89-f9d8870fa13c service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:43.093978 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191f694-82db-4977-9f89-f9d8870fa13c service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:43.094260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191f694-82db-4977-9f89-f9d8870fa13c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:43.105288 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191f694-82db-4977-9f89-f9d8870fa13c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:43.106810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191f694-82db-4977-9f89-f9d8870fa13c service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:43.116975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1043/2081] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:43.167362 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd0eb8-1615-4f64-a293-d8b00e75dcf3 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:43.168876 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-11fd0eb8-1615-4f64-a293-d8b00e75dcf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:43.182044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd0eb8-1615-4f64-a293-d8b00e75dcf3 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:43.186304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a2ed9-8a40-4577-8cbc-4e1dee89fcf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:43.186993 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2ed9-8a40-4577-8cbc-4e1dee89fcf6 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:43.187306 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2ed9-8a40-4577-8cbc-4e1dee89fcf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:43.187573 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2ed9-8a40-4577-8cbc-4e1dee89fcf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:43.189536 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1c2a2ed9-8a40-4577-8cbc-4e1dee89fcf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:43.220438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:43.265122 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a2ed9-8a40-4577-8cbc-4e1dee89fcf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:43.266856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a2ed9-8a40-4577-8cbc-4e1dee89fcf6 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:43.278339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1039/2082] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:43.388710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191f694-82db-4977-9f89-f9d8870fa13c service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:43.390439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9191f694-82db-4977-9f89-f9d8870fa13c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:43.415423 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191f694-82db-4977-9f89-f9d8870fa13c service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:43.428452 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65989b9c-a2e9-4e5c-baef-648ffc682c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:43.429441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65989b9c-a2e9-4e5c-baef-648ffc682c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:43.429807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65989b9c-a2e9-4e5c-baef-648ffc682c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:43.430164 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65989b9c-a2e9-4e5c-baef-648ffc682c74 admin admin] PATH_INFO: `/v3/projects/49c60639f81447da92a78aa9ddec3641` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:43.433598 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65989b9c-a2e9-4e5c-baef-648ffc682c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49c60639f81447da92a78aa9ddec3641)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:43.436662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65989b9c-a2e9-4e5c-baef-648ffc682c74 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:43.468733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a2ed9-8a40-4577-8cbc-4e1dee89fcf6 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:43.471837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1c2a2ed9-8a40-4577-8cbc-4e1dee89fcf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:43.491921 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a2ed9-8a40-4577-8cbc-4e1dee89fcf6 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:43.502433 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c51b5-ff3a-4182-be71-0b13de61e36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:43.503426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c51b5-ff3a-4182-be71-0b13de61e36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:43.503711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c51b5-ff3a-4182-be71-0b13de61e36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:43.503990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c51b5-ff3a-4182-be71-0b13de61e36c admin admin] PATH_INFO: `/v3/projects/c4e544e8658f43c4a8fac5a71d37b0f9` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:43.505385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c51b5-ff3a-4182-be71-0b13de61e36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4e544e8658f43c4a8fac5a71d37b0f9)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:43.507604 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c51b5-ff3a-4182-be71-0b13de61e36c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:43.529755 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-65989b9c-a2e9-4e5c-baef-648ffc682c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c60639f81447da92a78aa9ddec3641', 'request_id': 'req-65989b9c-a2e9-4e5c-baef-648ffc682c74'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.535850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-65989b9c-a2e9-4e5c-baef-648ffc682c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c60639f81447da92a78aa9ddec3641', 'request_id': 'req-65989b9c-a2e9-4e5c-baef-648ffc682c74'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.543587 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-65989b9c-a2e9-4e5c-baef-648ffc682c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c60639f81447da92a78aa9ddec3641', 'request_id': 'req-65989b9c-a2e9-4e5c-baef-648ffc682c74'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.557622 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-65989b9c-a2e9-4e5c-baef-648ffc682c74 admin admin] The token cache is being invalidate because project 49c60639f81447da92a78aa9ddec3641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:43.558063 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-65989b9c-a2e9-4e5c-baef-648ffc682c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.558550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-65989b9c-a2e9-4e5c-baef-648ffc682c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.560321 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1044/2083] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:43 2022] DELETE /identity/v3/projects/49c60639f81447da92a78aa9ddec3641 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:43.564149 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65989b9c-a2e9-4e5c-baef-648ffc682c74 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:43.566111 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-65989b9c-a2e9-4e5c-baef-648ffc682c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:43.582852 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:43.583266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-200c51b5-ff3a-4182-be71-0b13de61e36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e544e8658f43c4a8fac5a71d37b0f9', 'request_id': 'req-200c51b5-ff3a-4182-be71-0b13de61e36c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.601938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-200c51b5-ff3a-4182-be71-0b13de61e36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e544e8658f43c4a8fac5a71d37b0f9', 'request_id': 'req-200c51b5-ff3a-4182-be71-0b13de61e36c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.616843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-200c51b5-ff3a-4182-be71-0b13de61e36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e544e8658f43c4a8fac5a71d37b0f9', 'request_id': 'req-200c51b5-ff3a-4182-be71-0b13de61e36c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.631157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-200c51b5-ff3a-4182-be71-0b13de61e36c admin admin] The token cache is being invalidate because project c4e544e8658f43c4a8fac5a71d37b0f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:43.631481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-200c51b5-ff3a-4182-be71-0b13de61e36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.632340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-200c51b5-ff3a-4182-be71-0b13de61e36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.634922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1040/2084] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:43 2022] DELETE /identity/v3/projects/c4e544e8658f43c4a8fac5a71d37b0f9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:43.640007 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c51b5-ff3a-4182-be71-0b13de61e36c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:43.641362 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-200c51b5-ff3a-4182-be71-0b13de61e36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:43.687604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65989b9c-a2e9-4e5c-baef-648ffc682c74 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:43.787572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac5ed3-eccf-4bb3-a69a-82dc114011dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:43.788613 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5ed3-eccf-4bb3-a69a-82dc114011dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:43.788873 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5ed3-eccf-4bb3-a69a-82dc114011dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:43.789559 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c51b5-ff3a-4182-be71-0b13de61e36c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:43.790216 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5ed3-eccf-4bb3-a69a-82dc114011dd admin admin] PATH_INFO: `/v3/users/16e051e726394066938664a52617da2c` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:43.793766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac5ed3-eccf-4bb3-a69a-82dc114011dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e051e726394066938664a52617da2c)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:43.795116 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344faf72-6aba-4d11-9ec9-342e1b258c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:43.795827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac5ed3-eccf-4bb3-a69a-82dc114011dd admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:43.796500 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344faf72-6aba-4d11-9ec9-342e1b258c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:43.796500 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344faf72-6aba-4d11-9ec9-342e1b258c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:43.796931 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344faf72-6aba-4d11-9ec9-342e1b258c31 admin admin] PATH_INFO: `/v3/users/6339877c807d4062bf01451972b95261` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:43.798379 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344faf72-6aba-4d11-9ec9-342e1b258c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6339877c807d4062bf01451972b95261)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:43.800649 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344faf72-6aba-4d11-9ec9-342e1b258c31 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:43.869008 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-344faf72-6aba-4d11-9ec9-342e1b258c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6339877c807d4062bf01451972b95261'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.869843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-344faf72-6aba-4d11-9ec9-342e1b258c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6339877c807d4062bf01451972b95261'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.875154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:43.878872 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-abac5ed3-eccf-4bb3-a69a-82dc114011dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e051e726394066938664a52617da2c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.882947 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-344faf72-6aba-4d11-9ec9-342e1b258c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6339877c807d4062bf01451972b95261'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.907120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-344faf72-6aba-4d11-9ec9-342e1b258c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6339877c807d4062bf01451972b95261'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.911108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-abac5ed3-eccf-4bb3-a69a-82dc114011dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e051e726394066938664a52617da2c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.912398 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-abac5ed3-eccf-4bb3-a69a-82dc114011dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e051e726394066938664a52617da2c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.916691 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-344faf72-6aba-4d11-9ec9-342e1b258c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6339877c807d4062bf01451972b95261'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.924886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-abac5ed3-eccf-4bb3-a69a-82dc114011dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e051e726394066938664a52617da2c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.925599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1041/2085] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:43 2022] DELETE /identity/v3/users/6339877c807d4062bf01451972b95261 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:43.935019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-abac5ed3-eccf-4bb3-a69a-82dc114011dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e051e726394066938664a52617da2c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:43.941693 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1045/2086] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:43 2022] DELETE /identity/v3/users/16e051e726394066938664a52617da2c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:44.260662 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344faf72-6aba-4d11-9ec9-342e1b258c31 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:44.262401 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-344faf72-6aba-4d11-9ec9-342e1b258c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:44.297302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac5ed3-eccf-4bb3-a69a-82dc114011dd admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:44.299258 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-abac5ed3-eccf-4bb3-a69a-82dc114011dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:44.350865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:44.357545 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344faf72-6aba-4d11-9ec9-342e1b258c31 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:44.377205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac5ed3-eccf-4bb3-a69a-82dc114011dd admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:44.384257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062fd19-ecdc-4ff8-8d8d-a3444138d9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:44.385386 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062fd19-ecdc-4ff8-8d8d-a3444138d9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:44.385668 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062fd19-ecdc-4ff8-8d8d-a3444138d9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:44.386120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062fd19-ecdc-4ff8-8d8d-a3444138d9a4 admin admin] PATH_INFO: `/v3/projects/65f9ea0d82ca4cc99eeb0dad5af36b38` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:44.387373 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062fd19-ecdc-4ff8-8d8d-a3444138d9a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f9ea0d82ca4cc99eeb0dad5af36b38)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:44.389531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062fd19-ecdc-4ff8-8d8d-a3444138d9a4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:44.419110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd5f40-9ef0-4f6c-93b7-8496c0003146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:44.420063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd5f40-9ef0-4f6c-93b7-8496c0003146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:44.420330 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd5f40-9ef0-4f6c-93b7-8496c0003146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:44.420632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd5f40-9ef0-4f6c-93b7-8496c0003146 admin admin] PATH_INFO: `/v3/projects/a4097e2c57f54b2ba4d1e87651bce2ef` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:44.422120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd5f40-9ef0-4f6c-93b7-8496c0003146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4097e2c57f54b2ba4d1e87651bce2ef)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:44.424612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd5f40-9ef0-4f6c-93b7-8496c0003146 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:44.440418 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6062fd19-ecdc-4ff8-8d8d-a3444138d9a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f9ea0d82ca4cc99eeb0dad5af36b38', 'request_id': 'req-6062fd19-ecdc-4ff8-8d8d-a3444138d9a4'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:44.446058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6062fd19-ecdc-4ff8-8d8d-a3444138d9a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f9ea0d82ca4cc99eeb0dad5af36b38', 'request_id': 'req-6062fd19-ecdc-4ff8-8d8d-a3444138d9a4'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:44.452277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6062fd19-ecdc-4ff8-8d8d-a3444138d9a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f9ea0d82ca4cc99eeb0dad5af36b38', 'request_id': 'req-6062fd19-ecdc-4ff8-8d8d-a3444138d9a4'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:44.466628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6062fd19-ecdc-4ff8-8d8d-a3444138d9a4 admin admin] The token cache is being invalidate because project 65f9ea0d82ca4cc99eeb0dad5af36b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:44.466914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6062fd19-ecdc-4ff8-8d8d-a3444138d9a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:44.467540 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6062fd19-ecdc-4ff8-8d8d-a3444138d9a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:44.469095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1046/2087] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:44 2022] DELETE /identity/v3/projects/65f9ea0d82ca4cc99eeb0dad5af36b38 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:44.473737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f99b7-54a2-46ef-b928-469ab2fe13e5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:44.474051 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f99b7-54a2-46ef-b928-469ab2fe13e5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:44.474334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f99b7-54a2-46ef-b928-469ab2fe13e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:44.476974 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bffd5f40-9ef0-4f6c-93b7-8496c0003146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4097e2c57f54b2ba4d1e87651bce2ef', 'request_id': 'req-bffd5f40-9ef0-4f6c-93b7-8496c0003146'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:44.485974 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bffd5f40-9ef0-4f6c-93b7-8496c0003146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4097e2c57f54b2ba4d1e87651bce2ef', 'request_id': 'req-bffd5f40-9ef0-4f6c-93b7-8496c0003146'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:44.492514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-637f99b7-54a2-46ef-b928-469ab2fe13e5 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:44.492703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bffd5f40-9ef0-4f6c-93b7-8496c0003146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4097e2c57f54b2ba4d1e87651bce2ef', 'request_id': 'req-bffd5f40-9ef0-4f6c-93b7-8496c0003146'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:44.493829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-637f99b7-54a2-46ef-b928-469ab2fe13e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:44.504149 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bffd5f40-9ef0-4f6c-93b7-8496c0003146 admin admin] The token cache is being invalidate because project a4097e2c57f54b2ba4d1e87651bce2ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:44.504510 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bffd5f40-9ef0-4f6c-93b7-8496c0003146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:44.505176 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bffd5f40-9ef0-4f6c-93b7-8496c0003146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:44.507092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1042/2088] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:44 2022] DELETE /identity/v3/projects/a4097e2c57f54b2ba4d1e87651bce2ef => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:44.511681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55982aaa-a244-4941-8a0c-807431d99791 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:44.511971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55982aaa-a244-4941-8a0c-807431d99791 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:44.512247 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55982aaa-a244-4941-8a0c-807431d99791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:44.526198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:44.532956 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-55982aaa-a244-4941-8a0c-807431d99791 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:44.534304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-55982aaa-a244-4941-8a0c-807431d99791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:44.560534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1047/2089] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:44.569181 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd00c50-1192-462f-b99c-0caade42d2e3 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:44.569858 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd00c50-1192-462f-b99c-0caade42d2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:44.569858 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd00c50-1192-462f-b99c-0caade42d2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:44.599184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1cd00c50-1192-462f-b99c-0caade42d2e3 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:44.600581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1cd00c50-1192-462f-b99c-0caade42d2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:44.609621 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1043/2090] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:44.610797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1048/2091] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:44.614945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55982aaa-a244-4941-8a0c-807431d99791 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:44.619242 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6a781-71ee-4198-9566-123eb6d84461 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:44.619555 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6a781-71ee-4198-9566-123eb6d84461 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:44.619995 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6a781-71ee-4198-9566-123eb6d84461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:44.628084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55982aaa-a244-4941-8a0c-807431d99791 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:44.633381 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9234cfa-f9d2-4472-8d93-095863ac7aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:44.634417 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9234cfa-f9d2-4472-8d93-095863ac7aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:44.634718 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9234cfa-f9d2-4472-8d93-095863ac7aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:44.634997 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9234cfa-f9d2-4472-8d93-095863ac7aa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:44.635833 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9234cfa-f9d2-4472-8d93-095863ac7aa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:44.636526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9234cfa-f9d2-4472-8d93-095863ac7aa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:44.638099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9234cfa-f9d2-4472-8d93-095863ac7aa4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:44.639874 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ede6a781-71ee-4198-9566-123eb6d84461 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:44.641205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ede6a781-71ee-4198-9566-123eb6d84461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:44.650073 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1049/2092] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:44.654203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6a781-71ee-4198-9566-123eb6d84461 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:44.656910 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1044/2093] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:44.657906 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9234cfa-f9d2-4472-8d93-095863ac7aa4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:44.666095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6a781-71ee-4198-9566-123eb6d84461 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:44.668236 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9234cfa-f9d2-4472-8d93-095863ac7aa4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:44.671831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6af24-4ee4-4328-973a-62ae2305b0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:44.672587 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6af24-4ee4-4328-973a-62ae2305b0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:44.673111 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6af24-4ee4-4328-973a-62ae2305b0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:44.673329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6af24-4ee4-4328-973a-62ae2305b0c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:44.674125 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6af24-4ee4-4328-973a-62ae2305b0c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:44.674434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6af24-4ee4-4328-973a-62ae2305b0c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:44.674971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff351bf-dbc6-489f-bc35-716fefb91431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:44.675656 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff351bf-dbc6-489f-bc35-716fefb91431 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:44.675940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff351bf-dbc6-489f-bc35-716fefb91431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:44.676115 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6af24-4ee4-4328-973a-62ae2305b0c4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:44.676221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff351bf-dbc6-489f-bc35-716fefb91431 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:44.677226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff351bf-dbc6-489f-bc35-716fefb91431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:44.679329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff351bf-dbc6-489f-bc35-716fefb91431 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:44.697838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1050/2094] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:09:44.700862 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6af24-4ee4-4328-973a-62ae2305b0c4 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:44.714410 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6af24-4ee4-4328-973a-62ae2305b0c4 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:44.723043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acec312-fc26-44e7-bafc-b4a6375edbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:44.724214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec312-fc26-44e7-bafc-b4a6375edbad admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:44.724795 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec312-fc26-44e7-bafc-b4a6375edbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:44.725076 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec312-fc26-44e7-bafc-b4a6375edbad admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:44.726113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acec312-fc26-44e7-bafc-b4a6375edbad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:44.728798 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acec312-fc26-44e7-bafc-b4a6375edbad admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:44.734001 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1045/2095] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:44 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:44.737641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff351bf-dbc6-489f-bc35-716fefb91431 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:44.771381 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1051/2096] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:44 2022] POST /identity/v3/projects => generated 389 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:44.776181 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acec312-fc26-44e7-bafc-b4a6375edbad admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:44.800310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:44.840344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff351bf-dbc6-489f-bc35-716fefb91431 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:44.880091 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acec312-fc26-44e7-bafc-b4a6375edbad admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:44.885994 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ace8e3-c645-49e7-98e5-4fd4b19c818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:44.887012 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ace8e3-c645-49e7-98e5-4fd4b19c818a admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:44.887454 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ace8e3-c645-49e7-98e5-4fd4b19c818a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:44.887879 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ace8e3-c645-49e7-98e5-4fd4b19c818a admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:44.889022 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ace8e3-c645-49e7-98e5-4fd4b19c818a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:44.891450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ace8e3-c645-49e7-98e5-4fd4b19c818a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:44.916360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc31140-8f13-44b8-9012-46097a8dcaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:44.917345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc31140-8f13-44b8-9012-46097a8dcaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:44.918774 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc31140-8f13-44b8-9012-46097a8dcaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:44.919249 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc31140-8f13-44b8-9012-46097a8dcaa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:44.929270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc31140-8f13-44b8-9012-46097a8dcaa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:44.929270 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc31140-8f13-44b8-9012-46097a8dcaa9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:44.934345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1052/2097] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:44 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:09:44.939601 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ace8e3-c645-49e7-98e5-4fd4b19c818a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:44.955444 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ace8e3-c645-49e7-98e5-4fd4b19c818a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:44.957245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1046/2098] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:44 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:44.962210 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bc434-1334-474e-8beb-91d103efdff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:44.962530 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc31140-8f13-44b8-9012-46097a8dcaa9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:44.963545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bc434-1334-474e-8beb-91d103efdff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:44.964033 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bc434-1334-474e-8beb-91d103efdff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:44.964501 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bc434-1334-474e-8beb-91d103efdff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:44.965656 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bc434-1334-474e-8beb-91d103efdff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:44.968053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bc434-1334-474e-8beb-91d103efdff7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:44.986871 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc31140-8f13-44b8-9012-46097a8dcaa9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:44.987082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1053/2099] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:44.987082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bc434-1334-474e-8beb-91d103efdff7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:44.991631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773877e-bf62-44f1-9750-05cbc5a95309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:44.994390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773877e-bf62-44f1-9750-05cbc5a95309 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:44.994853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773877e-bf62-44f1-9750-05cbc5a95309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:44.995300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773877e-bf62-44f1-9750-05cbc5a95309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:44.996372 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773877e-bf62-44f1-9750-05cbc5a95309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:44.996807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bc434-1334-474e-8beb-91d103efdff7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:44.998702 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773877e-bf62-44f1-9750-05cbc5a95309 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:45.001992 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:45.008221 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d8245-385a-4110-be39-468012d83c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:45.009085 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d8245-385a-4110-be39-468012d83c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.009432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d8245-385a-4110-be39-468012d83c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.009772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d8245-385a-4110-be39-468012d83c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.010648 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d8245-385a-4110-be39-468012d83c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:45.012409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d8245-385a-4110-be39-468012d83c49 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:45.022161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1047/2100] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:09:45.025677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773877e-bf62-44f1-9750-05cbc5a95309 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:45.030780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1054/2101] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:45.031787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d8245-385a-4110-be39-468012d83c49 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:45.043720 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d8245-385a-4110-be39-468012d83c49 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:45.048554 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773877e-bf62-44f1-9750-05cbc5a95309 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:45.050613 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aefa60-d356-42da-9862-9e6c34ae729f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:45.051832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aefa60-d356-42da-9862-9e6c34ae729f admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.053051 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aefa60-d356-42da-9862-9e6c34ae729f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.053051 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aefa60-d356-42da-9862-9e6c34ae729f admin admin] PATH_INFO: `/v3/projects/6e8478aacfe74f35bbbada0de546d85d/users/4f191723de0440e8af6ac0fe5903f74b/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.059184 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3233a7-6156-4b9d-9ab8-0cfa063da9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:45.060791 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3233a7-6156-4b9d-9ab8-0cfa063da9ac admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.060791 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3233a7-6156-4b9d-9ab8-0cfa063da9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.060791 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3233a7-6156-4b9d-9ab8-0cfa063da9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.061162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3233a7-6156-4b9d-9ab8-0cfa063da9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:45.062901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3233a7-6156-4b9d-9ab8-0cfa063da9ac admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:45.076886 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1048/2102] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:45.081111 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3233a7-6156-4b9d-9ab8-0cfa063da9ac admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:45.085595 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aefa60-d356-42da-9862-9e6c34ae729f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8478aacfe74f35bbbada0de546d85d, user_id=4f191723de0440e8af6ac0fe5903f74b, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:45.098509 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aefa60-d356-42da-9862-9e6c34ae729f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:45.112963 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3233a7-6156-4b9d-9ab8-0cfa063da9ac admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:45.125180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1a92f-ac75-423e-99e1-b308368632e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:45.126124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1055/2103] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:45 2022] PUT /identity/v3/projects/6e8478aacfe74f35bbbada0de546d85d/users/4f191723de0440e8af6ac0fe5903f74b/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:45.136614 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1a92f-ac75-423e-99e1-b308368632e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.136913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1a92f-ac75-423e-99e1-b308368632e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.137188 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1a92f-ac75-423e-99e1-b308368632e6 admin admin] PATH_INFO: `/v3/projects/0c3483568e1c4f6c828b8b2b57dd76c5/users/47e3dfe54aad4bdf81b502044d534edd/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.137669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4c0f1-795b-4379-9e84-342bebbc143f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.138064 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4c0f1-795b-4379-9e84-342bebbc143f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.138416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4c0f1-795b-4379-9e84-342bebbc143f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.173176 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1a92f-ac75-423e-99e1-b308368632e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3483568e1c4f6c828b8b2b57dd76c5, user_id=47e3dfe54aad4bdf81b502044d534edd, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:45.182291 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1a92f-ac75-423e-99e1-b308368632e6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:45.184758 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-72f4c0f1-795b-4379-9e84-342bebbc143f None None] MFA Rules not processed for user `4f191723de0440e8af6ac0fe5903f74b`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:45.186650 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-72f4c0f1-795b-4379-9e84-342bebbc143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:45.201829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1049/2104] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:45 2022] PUT /identity/v3/projects/0c3483568e1c4f6c828b8b2b57dd76c5/users/47e3dfe54aad4bdf81b502044d534edd/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:45.212542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6845dd7-c1d2-48b7-b3fb-62d354fd9dee None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.212918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6845dd7-c1d2-48b7-b3fb-62d354fd9dee None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.213269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6845dd7-c1d2-48b7-b3fb-62d354fd9dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.243845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a6845dd7-c1d2-48b7-b3fb-62d354fd9dee None None] MFA Rules not processed for user `47e3dfe54aad4bdf81b502044d534edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:45.246309 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a6845dd7-c1d2-48b7-b3fb-62d354fd9dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:45.276274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1056/2105] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:45.282564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4c0f1-795b-4379-9e84-342bebbc143f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:45.355656 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1050/2106] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:45.360138 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:45.360401 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6845dd7-c1d2-48b7-b3fb-62d354fd9dee None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:45.379922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4c0f1-795b-4379-9e84-342bebbc143f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:45.460447 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbfdd5-d60c-4679-a81a-54239a246c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:45.462018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6845dd7-c1d2-48b7-b3fb-62d354fd9dee None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:45.462489 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbfdd5-d60c-4679-a81a-54239a246c33 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.462873 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbfdd5-d60c-4679-a81a-54239a246c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.463217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbfdd5-d60c-4679-a81a-54239a246c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.464697 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbfdd5-d60c-4679-a81a-54239a246c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:45.466264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbfdd5-d60c-4679-a81a-54239a246c33 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:45.467183 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d6ada-40e6-4605-bf42-ee4a18c0ab52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:45.467856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d6ada-40e6-4605-bf42-ee4a18c0ab52 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.468136 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d6ada-40e6-4605-bf42-ee4a18c0ab52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.468409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d6ada-40e6-4605-bf42-ee4a18c0ab52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.469136 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d6ada-40e6-4605-bf42-ee4a18c0ab52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:45.471600 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d6ada-40e6-4605-bf42-ee4a18c0ab52 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:45.503941 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1057/2107] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:45 2022] POST /identity/v3/projects => generated 387 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:45.504267 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1051/2108] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:45 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:09:45.505970 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbfdd5-d60c-4679-a81a-54239a246c33 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:45.509459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d6ada-40e6-4605-bf42-ee4a18c0ab52 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:45.553901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:45.581533 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d6ada-40e6-4605-bf42-ee4a18c0ab52 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:45.582345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbfdd5-d60c-4679-a81a-54239a246c33 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:45.587532 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac6a5d-4842-40f4-9312-ef62a0dd27f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:45.587714 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d670ae9-9419-4a5b-b9a0-7927400e3cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:45.588302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d670ae9-9419-4a5b-b9a0-7927400e3cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.588410 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac6a5d-4842-40f4-9312-ef62a0dd27f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.588590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d670ae9-9419-4a5b-b9a0-7927400e3cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.588750 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac6a5d-4842-40f4-9312-ef62a0dd27f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.588889 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d670ae9-9419-4a5b-b9a0-7927400e3cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.589159 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac6a5d-4842-40f4-9312-ef62a0dd27f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.589572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d670ae9-9419-4a5b-b9a0-7927400e3cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:45.590093 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac6a5d-4842-40f4-9312-ef62a0dd27f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:45.591595 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d670ae9-9419-4a5b-b9a0-7927400e3cc5 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:45.592348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac6a5d-4842-40f4-9312-ef62a0dd27f0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:45.614859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1058/2109] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:45 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:45.616841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1052/2110] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:45 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:45.621097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d670ae9-9419-4a5b-b9a0-7927400e3cc5 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:45.621542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac6a5d-4842-40f4-9312-ef62a0dd27f0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:45.634323 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac6a5d-4842-40f4-9312-ef62a0dd27f0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:45.636209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d670ae9-9419-4a5b-b9a0-7927400e3cc5 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:45.640350 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b97a3-4243-49c5-8d3b-84037b5805dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:45.641193 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b97a3-4243-49c5-8d3b-84037b5805dd admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.641489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b97a3-4243-49c5-8d3b-84037b5805dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.641876 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b97a3-4243-49c5-8d3b-84037b5805dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.642669 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b97a3-4243-49c5-8d3b-84037b5805dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:45.644516 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611d63c-f531-4091-850e-19f2de26b980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:45.644768 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b97a3-4243-49c5-8d3b-84037b5805dd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:45.645280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611d63c-f531-4091-850e-19f2de26b980 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.645577 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611d63c-f531-4091-850e-19f2de26b980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.646058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611d63c-f531-4091-850e-19f2de26b980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.647109 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611d63c-f531-4091-850e-19f2de26b980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:45.649745 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611d63c-f531-4091-850e-19f2de26b980 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:45.657836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1053/2111] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:45.662490 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b97a3-4243-49c5-8d3b-84037b5805dd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:45.665274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1059/2112] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:45.669886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611d63c-f531-4091-850e-19f2de26b980 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:45.674076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b97a3-4243-49c5-8d3b-84037b5805dd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:45.678885 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5a218-3912-4e26-80ce-b5b1b6bee1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:45.679800 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5a218-3912-4e26-80ce-b5b1b6bee1e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.680090 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5a218-3912-4e26-80ce-b5b1b6bee1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.680523 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5a218-3912-4e26-80ce-b5b1b6bee1e8 admin admin] PATH_INFO: `/v3/projects/c3895168c16449928423d4f1e83f34e5/users/ab94703709554a04971ee5209bb62db6/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.681642 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611d63c-f531-4091-850e-19f2de26b980 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:45.687476 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cec6a-39e9-4183-a9f7-a8d1af96401e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:45.688276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cec6a-39e9-4183-a9f7-a8d1af96401e admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.688627 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cec6a-39e9-4183-a9f7-a8d1af96401e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.688853 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cec6a-39e9-4183-a9f7-a8d1af96401e admin admin] PATH_INFO: `/v3/projects/6ce600fc8e9c4b59bd8f96c0b6116500/users/20d33aeff8b04a03b9b28a529e76b0b1/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.700166 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5a218-3912-4e26-80ce-b5b1b6bee1e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3895168c16449928423d4f1e83f34e5, user_id=ab94703709554a04971ee5209bb62db6, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:45.703141 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5a218-3912-4e26-80ce-b5b1b6bee1e8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:45.710484 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cec6a-39e9-4183-a9f7-a8d1af96401e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce600fc8e9c4b59bd8f96c0b6116500, user_id=20d33aeff8b04a03b9b28a529e76b0b1, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:45.713568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cec6a-39e9-4183-a9f7-a8d1af96401e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:45.720785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1054/2113] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:45 2022] PUT /identity/v3/projects/c3895168c16449928423d4f1e83f34e5/users/ab94703709554a04971ee5209bb62db6/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:45.724755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5a218-3912-4e26-80ce-b5b1b6bee1e8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:45.729021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1060/2114] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:45 2022] PUT /identity/v3/projects/6ce600fc8e9c4b59bd8f96c0b6116500/users/20d33aeff8b04a03b9b28a529e76b0b1/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:45.733289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cec6a-39e9-4183-a9f7-a8d1af96401e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:45.789133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:45.812281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5a218-3912-4e26-80ce-b5b1b6bee1e8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:45.812673 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cec6a-39e9-4183-a9f7-a8d1af96401e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:45.817645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581d107-7ff6-4f08-9292-dbb41015a9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:45.818548 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581d107-7ff6-4f08-9292-dbb41015a9ea admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.819007 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581d107-7ff6-4f08-9292-dbb41015a9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.819402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e2eb9-a94b-40a7-adb7-5fed1f1e6063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:45.819568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581d107-7ff6-4f08-9292-dbb41015a9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.820184 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581d107-7ff6-4f08-9292-dbb41015a9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:45.820335 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e2eb9-a94b-40a7-adb7-5fed1f1e6063 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.820702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e2eb9-a94b-40a7-adb7-5fed1f1e6063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.821327 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e2eb9-a94b-40a7-adb7-5fed1f1e6063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.822088 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581d107-7ff6-4f08-9292-dbb41015a9ea admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:45.822341 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e2eb9-a94b-40a7-adb7-5fed1f1e6063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:45.831643 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e2eb9-a94b-40a7-adb7-5fed1f1e6063 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:45.835608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1061/2115] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:09:45.839800 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e2eb9-a94b-40a7-adb7-5fed1f1e6063 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:45.845112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1055/2116] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:09:45.846165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581d107-7ff6-4f08-9292-dbb41015a9ea admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:45.850100 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e2eb9-a94b-40a7-adb7-5fed1f1e6063 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:45.855576 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0fe18-5a97-4174-8848-e83634339915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:45.856415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0fe18-5a97-4174-8848-e83634339915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.856728 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0fe18-5a97-4174-8848-e83634339915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.857009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0fe18-5a97-4174-8848-e83634339915 admin admin] PATH_INFO: `/v3/projects/6ce600fc8e9c4b59bd8f96c0b6116500/users/20d33aeff8b04a03b9b28a529e76b0b1/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.857114 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581d107-7ff6-4f08-9292-dbb41015a9ea admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:45.859045 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0fe18-5a97-4174-8848-e83634339915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce600fc8e9c4b59bd8f96c0b6116500, user_id=20d33aeff8b04a03b9b28a529e76b0b1, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:45.861656 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf4814-f335-40fb-87b7-7bc817c6ef2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:45.861808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0fe18-5a97-4174-8848-e83634339915 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:45.862573 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf4814-f335-40fb-87b7-7bc817c6ef2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.862854 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf4814-f335-40fb-87b7-7bc817c6ef2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.863128 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf4814-f335-40fb-87b7-7bc817c6ef2e admin admin] PATH_INFO: `/v3/projects/c3895168c16449928423d4f1e83f34e5/users/ab94703709554a04971ee5209bb62db6/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.865230 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf4814-f335-40fb-87b7-7bc817c6ef2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3895168c16449928423d4f1e83f34e5, user_id=ab94703709554a04971ee5209bb62db6, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:45.868071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf4814-f335-40fb-87b7-7bc817c6ef2e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:45.873512 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1062/2117] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:45 2022] PUT /identity/v3/projects/6ce600fc8e9c4b59bd8f96c0b6116500/users/20d33aeff8b04a03b9b28a529e76b0b1/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:45.882393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1056/2118] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:45 2022] PUT /identity/v3/projects/c3895168c16449928423d4f1e83f34e5/users/ab94703709554a04971ee5209bb62db6/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:45.884393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3d054-7ffe-4615-8914-8904653f0e5c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.884789 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3d054-7ffe-4615-8914-8904653f0e5c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.885127 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3d054-7ffe-4615-8914-8904653f0e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.892752 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7b68b-9fa4-4fcb-bac4-fea35ff87161 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:45.893053 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7b68b-9fa4-4fcb-bac4-fea35ff87161 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:45.893336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7b68b-9fa4-4fcb-bac4-fea35ff87161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:45.913135 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3bd3d054-7ffe-4615-8914-8904653f0e5c None None] MFA Rules not processed for user `20d33aeff8b04a03b9b28a529e76b0b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:45.914389 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3bd3d054-7ffe-4615-8914-8904653f0e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:45.922159 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2ad7b68b-9fa4-4fcb-bac4-fea35ff87161 None None] MFA Rules not processed for user `ab94703709554a04971ee5209bb62db6`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:45.923429 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2ad7b68b-9fa4-4fcb-bac4-fea35ff87161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:45.985744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1063/2119] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:45.998013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3d054-7ffe-4615-8914-8904653f0e5c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:45.999409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:45.999563 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3bd3d054-7ffe-4615-8914-8904653f0e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:46.011198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1057/2120] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:46.042636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7b68b-9fa4-4fcb-bac4-fea35ff87161 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:46.044127 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2ad7b68b-9fa4-4fcb-bac4-fea35ff87161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:46.075940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3d054-7ffe-4615-8914-8904653f0e5c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:46.082165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdfd1c-d0f5-49eb-b05d-19a1a3b6ab9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:46.082950 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdfd1c-d0f5-49eb-b05d-19a1a3b6ab9d service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:46.083994 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdfd1c-d0f5-49eb-b05d-19a1a3b6ab9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:46.084208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdfd1c-d0f5-49eb-b05d-19a1a3b6ab9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:46.097275 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdfd1c-d0f5-49eb-b05d-19a1a3b6ab9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:46.099135 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdfd1c-d0f5-49eb-b05d-19a1a3b6ab9d service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:46.109976 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1064/2121] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:09:46.110542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7b68b-9fa4-4fcb-bac4-fea35ff87161 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:46.115054 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc2613-502e-49fd-9249-449c606873f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:46.115765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc2613-502e-49fd-9249-449c606873f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:46.116000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc2613-502e-49fd-9249-449c606873f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:46.116282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc2613-502e-49fd-9249-449c606873f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:46.127316 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc2613-502e-49fd-9249-449c606873f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:46.128790 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc2613-502e-49fd-9249-449c606873f9 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:46.140068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1058/2122] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:09:46.224630 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdfd1c-d0f5-49eb-b05d-19a1a3b6ab9d service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:46.234260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdfd1c-d0f5-49eb-b05d-19a1a3b6ab9d service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:46.238006 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec037a3-cd8f-4f60-81fe-73f9a2d5da17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:46.238856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec037a3-cd8f-4f60-81fe-73f9a2d5da17 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:46.239146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec037a3-cd8f-4f60-81fe-73f9a2d5da17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:46.239462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec037a3-cd8f-4f60-81fe-73f9a2d5da17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:46.251871 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc2613-502e-49fd-9249-449c606873f9 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:46.304412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:46.321152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec037a3-cd8f-4f60-81fe-73f9a2d5da17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:46.323110 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec037a3-cd8f-4f60-81fe-73f9a2d5da17 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:46.334906 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1065/2123] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:46.335114 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc2613-502e-49fd-9249-449c606873f9 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:46.340722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92401be-211e-4ef7-93cf-101d8d37746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:46.341631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92401be-211e-4ef7-93cf-101d8d37746f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:46.342144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92401be-211e-4ef7-93cf-101d8d37746f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:46.342309 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92401be-211e-4ef7-93cf-101d8d37746f admin admin] PATH_INFO: `/v3/users/4f191723de0440e8af6ac0fe5903f74b` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:46.343564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92401be-211e-4ef7-93cf-101d8d37746f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f191723de0440e8af6ac0fe5903f74b)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:46.345548 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92401be-211e-4ef7-93cf-101d8d37746f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:46.415101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b92401be-211e-4ef7-93cf-101d8d37746f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f191723de0440e8af6ac0fe5903f74b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:46.415810 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b92401be-211e-4ef7-93cf-101d8d37746f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f191723de0440e8af6ac0fe5903f74b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:46.424470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b92401be-211e-4ef7-93cf-101d8d37746f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f191723de0440e8af6ac0fe5903f74b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:46.439335 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b92401be-211e-4ef7-93cf-101d8d37746f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f191723de0440e8af6ac0fe5903f74b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:46.453870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b92401be-211e-4ef7-93cf-101d8d37746f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f191723de0440e8af6ac0fe5903f74b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:46.466806 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1059/2124] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:46 2022] DELETE /identity/v3/users/4f191723de0440e8af6ac0fe5903f74b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:46.471416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059df9a-b129-4a52-a361-3bcf83c63567 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:46.471821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059df9a-b129-4a52-a361-3bcf83c63567 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:46.472109 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059df9a-b129-4a52-a361-3bcf83c63567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:46.489578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6059df9a-b129-4a52-a361-3bcf83c63567 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:46.490880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6059df9a-b129-4a52-a361-3bcf83c63567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:46.558426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1066/2125] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:46.568473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92401be-211e-4ef7-93cf-101d8d37746f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:46.570097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b92401be-211e-4ef7-93cf-101d8d37746f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:46.600770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:46.627128 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059df9a-b129-4a52-a361-3bcf83c63567 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:46.629532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6059df9a-b129-4a52-a361-3bcf83c63567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:46.647031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92401be-211e-4ef7-93cf-101d8d37746f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:46.647948 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059df9a-b129-4a52-a361-3bcf83c63567 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:46.651934 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c1437-cea9-48ba-9be9-1e5d520156b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:46.652621 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c1437-cea9-48ba-9be9-1e5d520156b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:46.652902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c1437-cea9-48ba-9be9-1e5d520156b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:46.653199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c1437-cea9-48ba-9be9-1e5d520156b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:46.654529 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441df69f-66db-4e62-9c9b-57ce1f3364ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:46.655579 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441df69f-66db-4e62-9c9b-57ce1f3364ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:46.655862 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441df69f-66db-4e62-9c9b-57ce1f3364ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:46.656135 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441df69f-66db-4e62-9c9b-57ce1f3364ba admin admin] PATH_INFO: `/v3/users/47e3dfe54aad4bdf81b502044d534edd` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:46.657376 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441df69f-66db-4e62-9c9b-57ce1f3364ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e3dfe54aad4bdf81b502044d534edd)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:46.659366 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441df69f-66db-4e62-9c9b-57ce1f3364ba admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:46.665179 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c1437-cea9-48ba-9be9-1e5d520156b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:46.666782 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c1437-cea9-48ba-9be9-1e5d520156b8 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:46.679326 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1060/2126] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:46.729453 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-441df69f-66db-4e62-9c9b-57ce1f3364ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e3dfe54aad4bdf81b502044d534edd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:46.747982 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-441df69f-66db-4e62-9c9b-57ce1f3364ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e3dfe54aad4bdf81b502044d534edd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:46.748750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-441df69f-66db-4e62-9c9b-57ce1f3364ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e3dfe54aad4bdf81b502044d534edd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:46.757751 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-441df69f-66db-4e62-9c9b-57ce1f3364ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e3dfe54aad4bdf81b502044d534edd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:46.776569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-441df69f-66db-4e62-9c9b-57ce1f3364ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e3dfe54aad4bdf81b502044d534edd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:46.784128 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1067/2127] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:46 2022] DELETE /identity/v3/users/47e3dfe54aad4bdf81b502044d534edd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:46.791828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b799a2e-f1f2-4337-92d3-955b88d0a1aa None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:46.792171 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b799a2e-f1f2-4337-92d3-955b88d0a1aa None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:46.792454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b799a2e-f1f2-4337-92d3-955b88d0a1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:46.818655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5b799a2e-f1f2-4337-92d3-955b88d0a1aa None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:46.820488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5b799a2e-f1f2-4337-92d3-955b88d0a1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:46.899122 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1061/2128] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:46.908683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441df69f-66db-4e62-9c9b-57ce1f3364ba admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:46.910428 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-441df69f-66db-4e62-9c9b-57ce1f3364ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:46.977769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441df69f-66db-4e62-9c9b-57ce1f3364ba admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:46.982451 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ca7e0-a972-4487-aa3b-7e8e0cfe804a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:46.982942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ca7e0-a972-4487-aa3b-7e8e0cfe804a service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:46.983247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ca7e0-a972-4487-aa3b-7e8e0cfe804a service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:46.983521 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ca7e0-a972-4487-aa3b-7e8e0cfe804a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:46.995455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ca7e0-a972-4487-aa3b-7e8e0cfe804a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:46.997019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ca7e0-a972-4487-aa3b-7e8e0cfe804a service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:47.012396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1068/2129] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:47.028636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b799a2e-f1f2-4337-92d3-955b88d0a1aa None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:47.030979 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5b799a2e-f1f2-4337-92d3-955b88d0a1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:47.048469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b799a2e-f1f2-4337-92d3-955b88d0a1aa None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:47.054197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f376e-f848-4061-811a-d5d00df1ba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:47.055262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f376e-f848-4061-811a-d5d00df1ba51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:47.055728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f376e-f848-4061-811a-d5d00df1ba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:47.056600 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f376e-f848-4061-811a-d5d00df1ba51 admin admin] PATH_INFO: `/v3/projects/6e8478aacfe74f35bbbada0de546d85d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:47.057484 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f376e-f848-4061-811a-d5d00df1ba51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e8478aacfe74f35bbbada0de546d85d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:47.060156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f376e-f848-4061-811a-d5d00df1ba51 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:47.125260 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a44f376e-f848-4061-811a-d5d00df1ba51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e8478aacfe74f35bbbada0de546d85d', 'request_id': 'req-a44f376e-f848-4061-811a-d5d00df1ba51'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.129767 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ca7e0-a972-4487-aa3b-7e8e0cfe804a service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:47.132298 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-507ca7e0-a972-4487-aa3b-7e8e0cfe804a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:47.137469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a44f376e-f848-4061-811a-d5d00df1ba51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e8478aacfe74f35bbbada0de546d85d', 'request_id': 'req-a44f376e-f848-4061-811a-d5d00df1ba51'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.142908 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:47.147285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a44f376e-f848-4061-811a-d5d00df1ba51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e8478aacfe74f35bbbada0de546d85d', 'request_id': 'req-a44f376e-f848-4061-811a-d5d00df1ba51'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.149078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ca7e0-a972-4487-aa3b-7e8e0cfe804a service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:47.164536 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a44f376e-f848-4061-811a-d5d00df1ba51 admin admin] The token cache is being invalidate because project 6e8478aacfe74f35bbbada0de546d85d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:47.165159 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a44f376e-f848-4061-811a-d5d00df1ba51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.166088 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a44f376e-f848-4061-811a-d5d00df1ba51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.170521 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1062/2130] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:47 2022] DELETE /identity/v3/projects/6e8478aacfe74f35bbbada0de546d85d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:47.179278 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f376e-f848-4061-811a-d5d00df1ba51 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:47.181535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a44f376e-f848-4061-811a-d5d00df1ba51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:47.241304 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07789d39-9759-425f-89e2-20126f33dab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:47.242626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07789d39-9759-425f-89e2-20126f33dab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:47.243591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07789d39-9759-425f-89e2-20126f33dab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:47.244727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07789d39-9759-425f-89e2-20126f33dab5 admin admin] PATH_INFO: `/v3/users/3c54b67181ed455ea3c5feb6fb63d7bf` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:47.247548 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:47.247692 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07789d39-9759-425f-89e2-20126f33dab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c54b67181ed455ea3c5feb6fb63d7bf)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:47.250407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07789d39-9759-425f-89e2-20126f33dab5 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:47.267086 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f376e-f848-4061-811a-d5d00df1ba51 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:47.273042 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f2eeb-3a46-4720-a2a6-668fb12982c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:47.274417 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2eeb-3a46-4720-a2a6-668fb12982c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:47.274417 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2eeb-3a46-4720-a2a6-668fb12982c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:47.274972 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2eeb-3a46-4720-a2a6-668fb12982c9 admin admin] PATH_INFO: `/v3/users/20d33aeff8b04a03b9b28a529e76b0b1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:47.276916 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f2eeb-3a46-4720-a2a6-668fb12982c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d33aeff8b04a03b9b28a529e76b0b1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:47.278989 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f2eeb-3a46-4720-a2a6-668fb12982c9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:47.338648 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-07789d39-9759-425f-89e2-20126f33dab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c54b67181ed455ea3c5feb6fb63d7bf'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.343146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6e0f2eeb-3a46-4720-a2a6-668fb12982c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d33aeff8b04a03b9b28a529e76b0b1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.344439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6e0f2eeb-3a46-4720-a2a6-668fb12982c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d33aeff8b04a03b9b28a529e76b0b1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.355569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-07789d39-9759-425f-89e2-20126f33dab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c54b67181ed455ea3c5feb6fb63d7bf'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.356460 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-07789d39-9759-425f-89e2-20126f33dab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c54b67181ed455ea3c5feb6fb63d7bf'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.356961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6e0f2eeb-3a46-4720-a2a6-668fb12982c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d33aeff8b04a03b9b28a529e76b0b1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.369271 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-07789d39-9759-425f-89e2-20126f33dab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c54b67181ed455ea3c5feb6fb63d7bf'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.377041 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6e0f2eeb-3a46-4720-a2a6-668fb12982c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d33aeff8b04a03b9b28a529e76b0b1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.393779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-07789d39-9759-425f-89e2-20126f33dab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c54b67181ed455ea3c5feb6fb63d7bf'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.397707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6e0f2eeb-3a46-4720-a2a6-668fb12982c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d33aeff8b04a03b9b28a529e76b0b1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.410633 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1063/2131] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:47 2022] DELETE /identity/v3/users/20d33aeff8b04a03b9b28a529e76b0b1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:47.412672 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f2eeb-3a46-4720-a2a6-668fb12982c9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:47.413070 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1069/2132] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:47 2022] DELETE /identity/v3/users/3c54b67181ed455ea3c5feb6fb63d7bf => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:47.417011 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6e0f2eeb-3a46-4720-a2a6-668fb12982c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:47.417480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaef1a0-8cab-4fe5-9b8b-ca6ae5696d0e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:47.418577 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaef1a0-8cab-4fe5-9b8b-ca6ae5696d0e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:47.419686 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaef1a0-8cab-4fe5-9b8b-ca6ae5696d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:47.458868 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-4eaef1a0-8cab-4fe5-9b8b-ca6ae5696d0e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:47.463473 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-4eaef1a0-8cab-4fe5-9b8b-ca6ae5696d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:47.551020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f2eeb-3a46-4720-a2a6-668fb12982c9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:47.558051 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaca22d-a13c-4233-87b2-97e3559133e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:47.559154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaca22d-a13c-4233-87b2-97e3559133e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:47.559445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaca22d-a13c-4233-87b2-97e3559133e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:47.559726 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaca22d-a13c-4233-87b2-97e3559133e9 admin admin] PATH_INFO: `/v3/projects/0c3483568e1c4f6c828b8b2b57dd76c5` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:47.562194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaca22d-a13c-4233-87b2-97e3559133e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c3483568e1c4f6c828b8b2b57dd76c5)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:47.564221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaca22d-a13c-4233-87b2-97e3559133e9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:47.600261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1070/2133] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:47.613438 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaef1a0-8cab-4fe5-9b8b-ca6ae5696d0e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:47.615829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-4eaef1a0-8cab-4fe5-9b8b-ca6ae5696d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:47.651143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:47.655215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aaaca22d-a13c-4233-87b2-97e3559133e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c3483568e1c4f6c828b8b2b57dd76c5', 'request_id': 'req-aaaca22d-a13c-4233-87b2-97e3559133e9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.673437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aaaca22d-a13c-4233-87b2-97e3559133e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c3483568e1c4f6c828b8b2b57dd76c5', 'request_id': 'req-aaaca22d-a13c-4233-87b2-97e3559133e9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.683295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aaaca22d-a13c-4233-87b2-97e3559133e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c3483568e1c4f6c828b8b2b57dd76c5', 'request_id': 'req-aaaca22d-a13c-4233-87b2-97e3559133e9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.691378 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaef1a0-8cab-4fe5-9b8b-ca6ae5696d0e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:47.694455 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:47.707104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aaaca22d-a13c-4233-87b2-97e3559133e9 admin admin] The token cache is being invalidate because project 0c3483568e1c4f6c828b8b2b57dd76c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:47.707780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aaaca22d-a13c-4233-87b2-97e3559133e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.708359 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aaaca22d-a13c-4233-87b2-97e3559133e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.710221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1064/2134] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:47 2022] DELETE /identity/v3/projects/0c3483568e1c4f6c828b8b2b57dd76c5 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:47.714713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaca22d-a13c-4233-87b2-97e3559133e9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:47.716431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aaaca22d-a13c-4233-87b2-97e3559133e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:47.756630 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d79b62-44d8-474e-a82b-67b637288e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:47.757191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d79b62-44d8-474e-a82b-67b637288e94 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:47.757482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d79b62-44d8-474e-a82b-67b637288e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:47.757762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d79b62-44d8-474e-a82b-67b637288e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:47.760045 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-65d79b62-44d8-474e-a82b-67b637288e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:47.795087 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaca22d-a13c-4233-87b2-97e3559133e9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:47.800181 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46259479-8098-4bfd-8833-588bbc18abd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:47.801392 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46259479-8098-4bfd-8833-588bbc18abd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:47.801673 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46259479-8098-4bfd-8833-588bbc18abd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:47.801983 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46259479-8098-4bfd-8833-588bbc18abd7 admin admin] PATH_INFO: `/v3/users/ab94703709554a04971ee5209bb62db6` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:47.803208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46259479-8098-4bfd-8833-588bbc18abd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab94703709554a04971ee5209bb62db6)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:47.805137 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46259479-8098-4bfd-8833-588bbc18abd7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:47.840354 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d79b62-44d8-474e-a82b-67b637288e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:47.842023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d79b62-44d8-474e-a82b-67b637288e94 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:47.853312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1071/2135] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:09:47.854250 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d79b62-44d8-474e-a82b-67b637288e94 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:47.855702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-65d79b62-44d8-474e-a82b-67b637288e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:47.871134 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-46259479-8098-4bfd-8833-588bbc18abd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab94703709554a04971ee5209bb62db6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.871832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-46259479-8098-4bfd-8833-588bbc18abd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab94703709554a04971ee5209bb62db6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.873426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d79b62-44d8-474e-a82b-67b637288e94 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:47.881035 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b497944-61b1-49ea-98f4-d78f32a721b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:47.882421 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b497944-61b1-49ea-98f4-d78f32a721b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:47.882756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b497944-61b1-49ea-98f4-d78f32a721b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:47.883037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b497944-61b1-49ea-98f4-d78f32a721b0 admin admin] PATH_INFO: `/v3/projects/6ce600fc8e9c4b59bd8f96c0b6116500` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:47.884904 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b497944-61b1-49ea-98f4-d78f32a721b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce600fc8e9c4b59bd8f96c0b6116500)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:47.887143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b497944-61b1-49ea-98f4-d78f32a721b0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:47.889281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-46259479-8098-4bfd-8833-588bbc18abd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab94703709554a04971ee5209bb62db6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.913936 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-46259479-8098-4bfd-8833-588bbc18abd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab94703709554a04971ee5209bb62db6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.924582 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-46259479-8098-4bfd-8833-588bbc18abd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab94703709554a04971ee5209bb62db6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.933592 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1065/2136] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:47 2022] DELETE /identity/v3/users/ab94703709554a04971ee5209bb62db6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:47.972685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6b497944-61b1-49ea-98f4-d78f32a721b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce600fc8e9c4b59bd8f96c0b6116500', 'request_id': 'req-6b497944-61b1-49ea-98f4-d78f32a721b0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.982022 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6b497944-61b1-49ea-98f4-d78f32a721b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce600fc8e9c4b59bd8f96c0b6116500', 'request_id': 'req-6b497944-61b1-49ea-98f4-d78f32a721b0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:47.991769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6b497944-61b1-49ea-98f4-d78f32a721b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce600fc8e9c4b59bd8f96c0b6116500', 'request_id': 'req-6b497944-61b1-49ea-98f4-d78f32a721b0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.010201 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6b497944-61b1-49ea-98f4-d78f32a721b0 admin admin] The token cache is being invalidate because project 6ce600fc8e9c4b59bd8f96c0b6116500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:48.010392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6b497944-61b1-49ea-98f4-d78f32a721b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.010993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6b497944-61b1-49ea-98f4-d78f32a721b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.016436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1072/2137] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:47 2022] DELETE /identity/v3/projects/6ce600fc8e9c4b59bd8f96c0b6116500 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:48.018561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fda3d-24fe-4b90-b311-cfdaad504ec5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:48.019018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fda3d-24fe-4b90-b311-cfdaad504ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:48.019448 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fda3d-24fe-4b90-b311-cfdaad504ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:48.042683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-426fda3d-24fe-4b90-b311-cfdaad504ec5 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:48.044417 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-426fda3d-24fe-4b90-b311-cfdaad504ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:48.157305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1066/2138] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:48.161511 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b1b37-ed3e-4fbd-bf72-9fa27d37b963 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:48.161814 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b1b37-ed3e-4fbd-bf72-9fa27d37b963 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:48.162107 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b1b37-ed3e-4fbd-bf72-9fa27d37b963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:48.183779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0e1b1b37-ed3e-4fbd-bf72-9fa27d37b963 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:48.185076 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0e1b1b37-ed3e-4fbd-bf72-9fa27d37b963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:48.194245 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1073/2139] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:48.198855 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fda3d-24fe-4b90-b311-cfdaad504ec5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:48.210123 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fda3d-24fe-4b90-b311-cfdaad504ec5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:48.215299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2a9c1-a0ef-44f9-a7dd-b14371dfc423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:48.215984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2a9c1-a0ef-44f9-a7dd-b14371dfc423 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:48.216285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2a9c1-a0ef-44f9-a7dd-b14371dfc423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:48.216556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2a9c1-a0ef-44f9-a7dd-b14371dfc423 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:48.217288 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2a9c1-a0ef-44f9-a7dd-b14371dfc423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:48.217595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2a9c1-a0ef-44f9-a7dd-b14371dfc423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:48.219393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2a9c1-a0ef-44f9-a7dd-b14371dfc423 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:48.233371 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1067/2140] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:48.237749 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b1b37-ed3e-4fbd-bf72-9fa27d37b963 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:48.247974 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b1b37-ed3e-4fbd-bf72-9fa27d37b963 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:48.252701 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdfe8a-b1a7-41f5-abee-a7a079e92488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:48.253373 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdfe8a-b1a7-41f5-abee-a7a079e92488 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:48.253652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdfe8a-b1a7-41f5-abee-a7a079e92488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:48.254058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbdfe8a-b1a7-41f5-abee-a7a079e92488 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:48.254769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdfe8a-b1a7-41f5-abee-a7a079e92488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:48.256734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbdfe8a-b1a7-41f5-abee-a7a079e92488 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:48.260636 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:48.286215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1074/2141] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:48 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:48.290841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2a9c1-a0ef-44f9-a7dd-b14371dfc423 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:48.297285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:48.301995 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2a9c1-a0ef-44f9-a7dd-b14371dfc423 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:48.364584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdfe8a-b1a7-41f5-abee-a7a079e92488 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:48.367058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6cbdfe8a-b1a7-41f5-abee-a7a079e92488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:48.395555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197db2bb-fed0-4a43-a6fd-eba8fe26c1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:48.396262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db2bb-fed0-4a43-a6fd-eba8fe26c1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:48.396546 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db2bb-fed0-4a43-a6fd-eba8fe26c1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:48.396825 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db2bb-fed0-4a43-a6fd-eba8fe26c1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:48.397764 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197db2bb-fed0-4a43-a6fd-eba8fe26c1c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:48.400407 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197db2bb-fed0-4a43-a6fd-eba8fe26c1c5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:48.424972 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1068/2142] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:48 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:48.425904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197db2bb-fed0-4a43-a6fd-eba8fe26c1c5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:48.427453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-197db2bb-fed0-4a43-a6fd-eba8fe26c1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:48.439578 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197db2bb-fed0-4a43-a6fd-eba8fe26c1c5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:48.444415 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bda946-6408-456f-a390-1376f020008f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:48.445391 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bda946-6408-456f-a390-1376f020008f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:48.445683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bda946-6408-456f-a390-1376f020008f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:48.446090 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bda946-6408-456f-a390-1376f020008f admin admin] PATH_INFO: `/v3/projects/c3895168c16449928423d4f1e83f34e5` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:48.447512 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bda946-6408-456f-a390-1376f020008f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3895168c16449928423d4f1e83f34e5)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:48.449530 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bda946-6408-456f-a390-1376f020008f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:48.467730 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbdfe8a-b1a7-41f5-abee-a7a079e92488 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:48.472935 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d0ef6-d1bf-4f85-a688-24a3ad734a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:48.474625 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d0ef6-d1bf-4f85-a688-24a3ad734a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:48.474625 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d0ef6-d1bf-4f85-a688-24a3ad734a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:48.474951 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d0ef6-d1bf-4f85-a688-24a3ad734a92 admin admin] PATH_INFO: `/v3/projects/8a806e34c70b4b558b8ce423eb1a7e3f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:48.476419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d0ef6-d1bf-4f85-a688-24a3ad734a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a806e34c70b4b558b8ce423eb1a7e3f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:48.478988 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d0ef6-d1bf-4f85-a688-24a3ad734a92 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:48.503319 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d3bda946-6408-456f-a390-1376f020008f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3895168c16449928423d4f1e83f34e5', 'request_id': 'req-d3bda946-6408-456f-a390-1376f020008f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.512723 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d3bda946-6408-456f-a390-1376f020008f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3895168c16449928423d4f1e83f34e5', 'request_id': 'req-d3bda946-6408-456f-a390-1376f020008f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.520097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d3bda946-6408-456f-a390-1376f020008f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3895168c16449928423d4f1e83f34e5', 'request_id': 'req-d3bda946-6408-456f-a390-1376f020008f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.528869 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ea6d0ef6-d1bf-4f85-a688-24a3ad734a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a806e34c70b4b558b8ce423eb1a7e3f', 'request_id': 'req-ea6d0ef6-d1bf-4f85-a688-24a3ad734a92'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.532183 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d3bda946-6408-456f-a390-1376f020008f admin admin] The token cache is being invalidate because project c3895168c16449928423d4f1e83f34e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:48.532466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d3bda946-6408-456f-a390-1376f020008f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.533130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d3bda946-6408-456f-a390-1376f020008f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.534691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ea6d0ef6-d1bf-4f85-a688-24a3ad734a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a806e34c70b4b558b8ce423eb1a7e3f', 'request_id': 'req-ea6d0ef6-d1bf-4f85-a688-24a3ad734a92'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.535179 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1069/2143] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:48 2022] DELETE /identity/v3/projects/c3895168c16449928423d4f1e83f34e5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:48.536125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bda946-6408-456f-a390-1376f020008f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:48.537458 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d3bda946-6408-456f-a390-1376f020008f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:48.543040 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ea6d0ef6-d1bf-4f85-a688-24a3ad734a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a806e34c70b4b558b8ce423eb1a7e3f', 'request_id': 'req-ea6d0ef6-d1bf-4f85-a688-24a3ad734a92'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.557682 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ea6d0ef6-d1bf-4f85-a688-24a3ad734a92 admin admin] The token cache is being invalidate because project 8a806e34c70b4b558b8ce423eb1a7e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:48.558001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ea6d0ef6-d1bf-4f85-a688-24a3ad734a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.558689 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ea6d0ef6-d1bf-4f85-a688-24a3ad734a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.560359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1075/2144] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:48 2022] DELETE /identity/v3/projects/8a806e34c70b4b558b8ce423eb1a7e3f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:48.561992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55fbd2-3583-4088-b379-e1f2cd54ed42 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:48.562423 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55fbd2-3583-4088-b379-e1f2cd54ed42 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:48.562841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55fbd2-3583-4088-b379-e1f2cd54ed42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:48.582964 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-8b55fbd2-3583-4088-b379-e1f2cd54ed42 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:48.584528 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8b55fbd2-3583-4088-b379-e1f2cd54ed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:48.617470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bda946-6408-456f-a390-1376f020008f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:48.655500 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:48.666214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1076/2145] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:48.666214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55fbd2-3583-4088-b379-e1f2cd54ed42 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:48.666214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8b55fbd2-3583-4088-b379-e1f2cd54ed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:48.677111 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55fbd2-3583-4088-b379-e1f2cd54ed42 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:48.685081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77813fd-8172-428f-a5af-ee1a2a386642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:48.686449 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77813fd-8172-428f-a5af-ee1a2a386642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:48.686449 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77813fd-8172-428f-a5af-ee1a2a386642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:48.686847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77813fd-8172-428f-a5af-ee1a2a386642 admin admin] PATH_INFO: `/v3/users/4bb3d78839c74d7193aaa02a02fb83f1` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:48.688415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77813fd-8172-428f-a5af-ee1a2a386642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb3d78839c74d7193aaa02a02fb83f1)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:48.690741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77813fd-8172-428f-a5af-ee1a2a386642 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:48.703617 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:48.729860 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f5ac9-beb8-4214-bd42-fddde94aaa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:48.730812 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f5ac9-beb8-4214-bd42-fddde94aaa65 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:48.731167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f5ac9-beb8-4214-bd42-fddde94aaa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:48.731552 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f5ac9-beb8-4214-bd42-fddde94aaa65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:48.732743 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f5ac9-beb8-4214-bd42-fddde94aaa65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:48.734998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f5ac9-beb8-4214-bd42-fddde94aaa65 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:48.750782 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1070/2146] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:48.752932 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97302c-0443-48ab-940d-7bd0669bdbfb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:48.753420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97302c-0443-48ab-940d-7bd0669bdbfb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:48.754059 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97302c-0443-48ab-940d-7bd0669bdbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:48.760195 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e77813fd-8172-428f-a5af-ee1a2a386642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb3d78839c74d7193aaa02a02fb83f1'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.783743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e77813fd-8172-428f-a5af-ee1a2a386642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb3d78839c74d7193aaa02a02fb83f1'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.784573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e77813fd-8172-428f-a5af-ee1a2a386642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb3d78839c74d7193aaa02a02fb83f1'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.792203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-db97302c-0443-48ab-940d-7bd0669bdbfb None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:48.793836 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-db97302c-0443-48ab-940d-7bd0669bdbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:48.799091 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e77813fd-8172-428f-a5af-ee1a2a386642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb3d78839c74d7193aaa02a02fb83f1'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.811565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1071/2147] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:48.812480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e77813fd-8172-428f-a5af-ee1a2a386642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb3d78839c74d7193aaa02a02fb83f1'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:48.815694 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97302c-0443-48ab-940d-7bd0669bdbfb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:48.817354 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-db97302c-0443-48ab-940d-7bd0669bdbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:48.822878 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1077/2148] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:48 2022] DELETE /identity/v3/users/4bb3d78839c74d7193aaa02a02fb83f1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:48.824008 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77813fd-8172-428f-a5af-ee1a2a386642 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:48.832589 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97302c-0443-48ab-940d-7bd0669bdbfb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:48.920584 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a5347-8de0-4a8d-8342-00e4a3a29146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:48.921894 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a5347-8de0-4a8d-8342-00e4a3a29146 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:48.922388 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a5347-8de0-4a8d-8342-00e4a3a29146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:48.923444 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a5347-8de0-4a8d-8342-00e4a3a29146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:48.923966 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a5347-8de0-4a8d-8342-00e4a3a29146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:48.925681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a5347-8de0-4a8d-8342-00e4a3a29146 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:48.936963 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77813fd-8172-428f-a5af-ee1a2a386642 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:48.942443 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1072/2149] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:48.943450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacf1cb-4738-45b5-b5e4-5c3f67bddd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:48.943745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a5347-8de0-4a8d-8342-00e4a3a29146 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:48.944173 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacf1cb-4738-45b5-b5e4-5c3f67bddd49 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:48.944467 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacf1cb-4738-45b5-b5e4-5c3f67bddd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:48.944768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacf1cb-4738-45b5-b5e4-5c3f67bddd49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:48.945759 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacf1cb-4738-45b5-b5e4-5c3f67bddd49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:48.945945 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacf1cb-4738-45b5-b5e4-5c3f67bddd49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:48.947721 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacf1cb-4738-45b5-b5e4-5c3f67bddd49 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:48.960933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a5347-8de0-4a8d-8342-00e4a3a29146 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:48.966096 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1078/2150] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:48.966942 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f257f7-f118-4703-a160-c18a2b7a69dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:48.967221 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacf1cb-4738-45b5-b5e4-5c3f67bddd49 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:48.967883 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f257f7-f118-4703-a160-c18a2b7a69dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:48.968288 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f257f7-f118-4703-a160-c18a2b7a69dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:48.968593 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f257f7-f118-4703-a160-c18a2b7a69dd admin admin] PATH_INFO: `/v3/projects/c16c596e124c4a2489760832721e8c3b/users/d9977d0a558c453aadecd24b6440badc/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:48.979693 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacf1cb-4738-45b5-b5e4-5c3f67bddd49 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:48.986403 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de86ab-6120-4fdc-be29-0445a5a325a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:48.987268 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de86ab-6120-4fdc-be29-0445a5a325a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:48.988112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de86ab-6120-4fdc-be29-0445a5a325a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:48.988708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de86ab-6120-4fdc-be29-0445a5a325a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:48.990146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de86ab-6120-4fdc-be29-0445a5a325a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:48.993539 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de86ab-6120-4fdc-be29-0445a5a325a9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.007641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f257f7-f118-4703-a160-c18a2b7a69dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16c596e124c4a2489760832721e8c3b, user_id=d9977d0a558c453aadecd24b6440badc, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:49.016886 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f257f7-f118-4703-a160-c18a2b7a69dd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.047691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1079/2151] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:48 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:09:49.052116 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de86ab-6120-4fdc-be29-0445a5a325a9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:49.058989 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1073/2152] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:48 2022] PUT /identity/v3/projects/c16c596e124c4a2489760832721e8c3b/users/d9977d0a558c453aadecd24b6440badc/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:49.076762 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6255530-a796-4e8f-8fcd-224f83671234 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.076980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6255530-a796-4e8f-8fcd-224f83671234 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.077263 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6255530-a796-4e8f-8fcd-224f83671234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.107868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f6255530-a796-4e8f-8fcd-224f83671234 None None] MFA Rules not processed for user `d9977d0a558c453aadecd24b6440badc`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:49.109106 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f6255530-a796-4e8f-8fcd-224f83671234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:49.135068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de86ab-6120-4fdc-be29-0445a5a325a9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:49.140259 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445889b-a314-4aea-95ce-c57acacb4ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:49.141095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445889b-a314-4aea-95ce-c57acacb4ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.141384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445889b-a314-4aea-95ce-c57acacb4ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.141710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445889b-a314-4aea-95ce-c57acacb4ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.142477 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445889b-a314-4aea-95ce-c57acacb4ee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:49.144485 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445889b-a314-4aea-95ce-c57acacb4ee7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.152527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:49.185416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1080/2153] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:49 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:49.189785 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445889b-a314-4aea-95ce-c57acacb4ee7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:49.202173 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445889b-a314-4aea-95ce-c57acacb4ee7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:49.207512 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb22dd-86a9-41eb-a1cb-9fdfb0894631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:49.208007 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1074/2154] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:49.211937 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb22dd-86a9-41eb-a1cb-9fdfb0894631 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.212706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb22dd-86a9-41eb-a1cb-9fdfb0894631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.212706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb22dd-86a9-41eb-a1cb-9fdfb0894631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.214335 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb22dd-86a9-41eb-a1cb-9fdfb0894631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:49.214861 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6255530-a796-4e8f-8fcd-224f83671234 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:49.216817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb22dd-86a9-41eb-a1cb-9fdfb0894631 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.238426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6255530-a796-4e8f-8fcd-224f83671234 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:49.239036 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1081/2155] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:49.240239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb22dd-86a9-41eb-a1cb-9fdfb0894631 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:49.243132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-79fb22dd-86a9-41eb-a1cb-9fdfb0894631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:49.243502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250b327-7d27-41a0-9cfd-e6d7d3a1bbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:49.244737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250b327-7d27-41a0-9cfd-e6d7d3a1bbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.245113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250b327-7d27-41a0-9cfd-e6d7d3a1bbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.245482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250b327-7d27-41a0-9cfd-e6d7d3a1bbc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.247447 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250b327-7d27-41a0-9cfd-e6d7d3a1bbc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:49.249686 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250b327-7d27-41a0-9cfd-e6d7d3a1bbc5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.266666 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:49.274244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb22dd-86a9-41eb-a1cb-9fdfb0894631 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:49.281444 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:49.282481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.282961 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.283243 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903 admin admin] PATH_INFO: `/v3/projects/285012167b54438e91d15b769b27eec0` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.284014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1075/2156] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:49 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:09:49.284843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250b327-7d27-41a0-9cfd-e6d7d3a1bbc5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:49.286565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=285012167b54438e91d15b769b27eec0)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:49.290782 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.349964 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285012167b54438e91d15b769b27eec0', 'request_id': 'req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:49.355720 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250b327-7d27-41a0-9cfd-e6d7d3a1bbc5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:49.356510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285012167b54438e91d15b769b27eec0', 'request_id': 'req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:49.364307 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285012167b54438e91d15b769b27eec0', 'request_id': 'req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:49.379706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903 admin admin] The token cache is being invalidate because project 285012167b54438e91d15b769b27eec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:49.380089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:49.380823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:49.382915 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1082/2157] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:49 2022] DELETE /identity/v3/projects/285012167b54438e91d15b769b27eec0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:49.383456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:49.385052 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:49.440194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd38fc-a930-4fd8-89cc-a6c1da86f155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:49.440884 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd38fc-a930-4fd8-89cc-a6c1da86f155 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.441167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd38fc-a930-4fd8-89cc-a6c1da86f155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.441442 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd38fc-a930-4fd8-89cc-a6c1da86f155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.442318 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd38fc-a930-4fd8-89cc-a6c1da86f155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:49.443979 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd38fc-a930-4fd8-89cc-a6c1da86f155 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.453439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce969a8-ab1b-443a-b7ed-3f16c9ce4903 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:49.454775 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1076/2158] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:49.456086 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c1c6e-086f-4fd8-b065-ec63d55aa1fe None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.456553 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c1c6e-086f-4fd8-b065-ec63d55aa1fe None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.456778 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c1c6e-086f-4fd8-b065-ec63d55aa1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.458892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33afd6f-c9b6-4be1-aa60-5cfd4242b07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:49.459578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33afd6f-c9b6-4be1-aa60-5cfd4242b07f admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.459861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33afd6f-c9b6-4be1-aa60-5cfd4242b07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.460136 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33afd6f-c9b6-4be1-aa60-5cfd4242b07f admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.460827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33afd6f-c9b6-4be1-aa60-5cfd4242b07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:49.463238 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33afd6f-c9b6-4be1-aa60-5cfd4242b07f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.475492 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5e0c1c6e-086f-4fd8-b065-ec63d55aa1fe None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:49.476717 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5e0c1c6e-086f-4fd8-b065-ec63d55aa1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:49.485288 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1077/2159] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:49.486180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c1c6e-086f-4fd8-b065-ec63d55aa1fe None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:49.487491 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5e0c1c6e-086f-4fd8-b065-ec63d55aa1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:49.493361 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1083/2160] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:49 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:49.494852 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798f8c-db53-44cb-be85-87dbc0897ef6 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.495151 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798f8c-db53-44cb-be85-87dbc0897ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.495436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798f8c-db53-44cb-be85-87dbc0897ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.502742 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c1c6e-086f-4fd8-b065-ec63d55aa1fe None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:49.508194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f0cd6-b778-4737-9d34-02bd0ae91475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:49.509474 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f0cd6-b778-4737-9d34-02bd0ae91475 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.509854 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f0cd6-b778-4737-9d34-02bd0ae91475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.510062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f0cd6-b778-4737-9d34-02bd0ae91475 admin admin] PATH_INFO: `/v3/projects/c07f155152d844118a22d603c3757f82/users/375f6bd2fa914ff68203199b9ee95caa/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.513774 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d5798f8c-db53-44cb-be85-87dbc0897ef6 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:49.515020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d5798f8c-db53-44cb-be85-87dbc0897ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:49.523104 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1084/2161] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:49.524207 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5798f8c-db53-44cb-be85-87dbc0897ef6 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:49.528929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f0cd6-b778-4737-9d34-02bd0ae91475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c07f155152d844118a22d603c3757f82, user_id=375f6bd2fa914ff68203199b9ee95caa, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:49.531903 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f0cd6-b778-4737-9d34-02bd0ae91475 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.534504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5798f8c-db53-44cb-be85-87dbc0897ef6 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:49.539800 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd46aa-59a3-46bb-a743-e699728af477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:49.540564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd46aa-59a3-46bb-a743-e699728af477 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.540942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd46aa-59a3-46bb-a743-e699728af477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.541229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd46aa-59a3-46bb-a743-e699728af477 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.542038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd46aa-59a3-46bb-a743-e699728af477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:49.543657 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd46aa-59a3-46bb-a743-e699728af477 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.546848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1078/2162] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:49 2022] PUT /identity/v3/projects/c07f155152d844118a22d603c3757f82/users/375f6bd2fa914ff68203199b9ee95caa/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:49.547671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f0cd6-b778-4737-9d34-02bd0ae91475 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:49.558190 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1085/2163] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:49.559771 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e03a7-731b-416d-a35b-92e9f1014b5f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.560067 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e03a7-731b-416d-a35b-92e9f1014b5f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.560350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e03a7-731b-416d-a35b-92e9f1014b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.588268 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-952e03a7-731b-416d-a35b-92e9f1014b5f None None] MFA Rules not processed for user `375f6bd2fa914ff68203199b9ee95caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:49.589694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-952e03a7-731b-416d-a35b-92e9f1014b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:49.609770 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:INSERT=7,keystone:SELECT=86,keystone:DELETE=7 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:49.619909 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f0cd6-b778-4737-9d34-02bd0ae91475 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:49.625815 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116da71c-41c2-40dd-b264-e0be19c08176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:49.626520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116da71c-41c2-40dd-b264-e0be19c08176 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.626808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116da71c-41c2-40dd-b264-e0be19c08176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.627107 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116da71c-41c2-40dd-b264-e0be19c08176 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.627837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116da71c-41c2-40dd-b264-e0be19c08176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:49.628792 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116da71c-41c2-40dd-b264-e0be19c08176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:49.630460 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116da71c-41c2-40dd-b264-e0be19c08176 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.641336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:49.645008 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1079/2164] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:49.649848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116da71c-41c2-40dd-b264-e0be19c08176 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:49.660960 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116da71c-41c2-40dd-b264-e0be19c08176 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:49.663159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1086/2165] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:49.663993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e03a7-731b-416d-a35b-92e9f1014b5f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:49.666297 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0d9f6-6d47-409a-aa5e-1005ebce0fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:49.667504 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0d9f6-6d47-409a-aa5e-1005ebce0fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.667797 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0d9f6-6d47-409a-aa5e-1005ebce0fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.668077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0d9f6-6d47-409a-aa5e-1005ebce0fa5 admin admin] PATH_INFO: `/v3/projects/164ccfae7dae469f816491b01d04df6c/users/0ce065f618db4ed197138cd41d596b5f/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.676904 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e03a7-731b-416d-a35b-92e9f1014b5f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:49.681761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67d2d9-a94b-472e-bc29-03fc58de20d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:49.682626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67d2d9-a94b-472e-bc29-03fc58de20d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.682913 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67d2d9-a94b-472e-bc29-03fc58de20d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.683186 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67d2d9-a94b-472e-bc29-03fc58de20d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.683877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67d2d9-a94b-472e-bc29-03fc58de20d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:49.684988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0d9f6-6d47-409a-aa5e-1005ebce0fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=164ccfae7dae469f816491b01d04df6c, user_id=0ce065f618db4ed197138cd41d596b5f, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:49.685942 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67d2d9-a94b-472e-bc29-03fc58de20d8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.687835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0d9f6-6d47-409a-aa5e-1005ebce0fa5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.703755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1080/2166] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:49 2022] PUT /identity/v3/projects/164ccfae7dae469f816491b01d04df6c/users/0ce065f618db4ed197138cd41d596b5f/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:49.705228 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0d9f6-6d47-409a-aa5e-1005ebce0fa5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:49.706875 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0fc0d9f6-6d47-409a-aa5e-1005ebce0fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:49.716170 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1087/2167] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:49 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:49.717214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67d2d9-a94b-472e-bc29-03fc58de20d8 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:49.779508 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0d9f6-6d47-409a-aa5e-1005ebce0fa5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:49.785114 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67d2d9-a94b-472e-bc29-03fc58de20d8 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:49.791011 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b2074-09cb-4bec-bc7f-f9a5581c547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:49.792001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b2074-09cb-4bec-bc7f-f9a5581c547d admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.792379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b2074-09cb-4bec-bc7f-f9a5581c547d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.792691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b2074-09cb-4bec-bc7f-f9a5581c547d admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.793712 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b2074-09cb-4bec-bc7f-f9a5581c547d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:49.795511 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b2074-09cb-4bec-bc7f-f9a5581c547d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.806136 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1088/2168] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:49.806941 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b2074-09cb-4bec-bc7f-f9a5581c547d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:49.816945 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b2074-09cb-4bec-bc7f-f9a5581c547d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:49.822415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb686da-0637-4f27-9212-bc4b0bce532b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:49.823072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb686da-0637-4f27-9212-bc4b0bce532b admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.823354 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb686da-0637-4f27-9212-bc4b0bce532b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.823626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb686da-0637-4f27-9212-bc4b0bce532b admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.824316 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb686da-0637-4f27-9212-bc4b0bce532b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:49.826875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb686da-0637-4f27-9212-bc4b0bce532b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.833695 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46621f3-e0c1-44b3-87a2-b4220a8d6cc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:49.834402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46621f3-e0c1-44b3-87a2-b4220a8d6cc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.834684 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46621f3-e0c1-44b3-87a2-b4220a8d6cc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.834966 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46621f3-e0c1-44b3-87a2-b4220a8d6cc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.849307 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1089/2169] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:49 2022] POST /identity/v3/users => generated 291 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:49.850140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb686da-0637-4f27-9212-bc4b0bce532b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:49.859559 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb686da-0637-4f27-9212-bc4b0bce532b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:49.864103 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27525185-7f71-4f02-9507-f1c58dd6d8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:49.865214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27525185-7f71-4f02-9507-f1c58dd6d8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.865371 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27525185-7f71-4f02-9507-f1c58dd6d8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.865575 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27525185-7f71-4f02-9507-f1c58dd6d8ec admin admin] PATH_INFO: `/v3/projects/164ccfae7dae469f816491b01d04df6c/users/0ce065f618db4ed197138cd41d596b5f/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.867570 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27525185-7f71-4f02-9507-f1c58dd6d8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=164ccfae7dae469f816491b01d04df6c, user_id=0ce065f618db4ed197138cd41d596b5f, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:49.870444 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27525185-7f71-4f02-9507-f1c58dd6d8ec admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.885614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1090/2170] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:49 2022] PUT /identity/v3/projects/164ccfae7dae469f816491b01d04df6c/users/0ce065f618db4ed197138cd41d596b5f/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:49.886497 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27525185-7f71-4f02-9507-f1c58dd6d8ec admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:49.902093 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46621f3-e0c1-44b3-87a2-b4220a8d6cc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:49.903733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46621f3-e0c1-44b3-87a2-b4220a8d6cc0 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.913890 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1081/2171] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:49.915166 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935fae1-50a7-4a5e-9f57-2b3a8b4f0926 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.915465 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935fae1-50a7-4a5e-9f57-2b3a8b4f0926 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.915776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935fae1-50a7-4a5e-9f57-2b3a8b4f0926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.952917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a935fae1-50a7-4a5e-9f57-2b3a8b4f0926 None None] MFA Rules not processed for user `0ce065f618db4ed197138cd41d596b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:49.954819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a935fae1-50a7-4a5e-9f57-2b3a8b4f0926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:49.966646 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27525185-7f71-4f02-9507-f1c58dd6d8ec admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:49.974351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224dae6a-0e64-482a-9af3-222337907b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:49.975132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dae6a-0e64-482a-9af3-222337907b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:49.975426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dae6a-0e64-482a-9af3-222337907b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:49.975799 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dae6a-0e64-482a-9af3-222337907b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:49.976616 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224dae6a-0e64-482a-9af3-222337907b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:49.978752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224dae6a-0e64-482a-9af3-222337907b63 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:49.994583 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1091/2172] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:49.994583 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224dae6a-0e64-482a-9af3-222337907b63 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:49.994891 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:49.999236 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:50.006405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224dae6a-0e64-482a-9af3-222337907b63 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:50.014768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009eea04-c061-421f-aaa5-04e14e74ecdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:50.015991 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eea04-c061-421f-aaa5-04e14e74ecdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:50.016455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eea04-c061-421f-aaa5-04e14e74ecdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:50.016574 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eea04-c061-421f-aaa5-04e14e74ecdf admin admin] PATH_INFO: `/v3/users/375f6bd2fa914ff68203199b9ee95caa` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:50.017861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009eea04-c061-421f-aaa5-04e14e74ecdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=375f6bd2fa914ff68203199b9ee95caa)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:50.019852 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009eea04-c061-421f-aaa5-04e14e74ecdf admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:50.034095 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1082/2173] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:50.035227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935fae1-50a7-4a5e-9f57-2b3a8b4f0926 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:50.050387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935fae1-50a7-4a5e-9f57-2b3a8b4f0926 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:50.055905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d84da-9ad5-45ca-a119-d2520c0b1650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:50.056925 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d84da-9ad5-45ca-a119-d2520c0b1650 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:50.057225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d84da-9ad5-45ca-a119-d2520c0b1650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:50.057713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d84da-9ad5-45ca-a119-d2520c0b1650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:50.058536 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d84da-9ad5-45ca-a119-d2520c0b1650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:50.060293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d84da-9ad5-45ca-a119-d2520c0b1650 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:50.076009 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1083/2174] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:50.077998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d84da-9ad5-45ca-a119-d2520c0b1650 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:50.081984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-593d84da-9ad5-45ca-a119-d2520c0b1650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:50.083426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-009eea04-c061-421f-aaa5-04e14e74ecdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '375f6bd2fa914ff68203199b9ee95caa'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:50.098258 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-009eea04-c061-421f-aaa5-04e14e74ecdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '375f6bd2fa914ff68203199b9ee95caa'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:50.103089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-009eea04-c061-421f-aaa5-04e14e74ecdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '375f6bd2fa914ff68203199b9ee95caa'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:50.113060 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-009eea04-c061-421f-aaa5-04e14e74ecdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '375f6bd2fa914ff68203199b9ee95caa'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:50.121568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-009eea04-c061-421f-aaa5-04e14e74ecdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '375f6bd2fa914ff68203199b9ee95caa'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:50.129521 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1092/2175] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:49 2022] DELETE /identity/v3/users/375f6bd2fa914ff68203199b9ee95caa => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:50.133506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009eea04-c061-421f-aaa5-04e14e74ecdf admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:50.136512 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-009eea04-c061-421f-aaa5-04e14e74ecdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:50.157565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d84da-9ad5-45ca-a119-d2520c0b1650 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:50.219653 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b8f7e-a4ea-4558-b679-0f0a8a9560b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:50.220625 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b8f7e-a4ea-4558-b679-0f0a8a9560b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:50.220625 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b8f7e-a4ea-4558-b679-0f0a8a9560b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:50.220798 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b8f7e-a4ea-4558-b679-0f0a8a9560b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:50.222861 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0c5b8f7e-a4ea-4558-b679-0f0a8a9560b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:50.224447 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009eea04-c061-421f-aaa5-04e14e74ecdf admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:50.230429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d94b6-3d03-4c68-8722-203ae64b6fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:50.231345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d94b6-3d03-4c68-8722-203ae64b6fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:50.231632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d94b6-3d03-4c68-8722-203ae64b6fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:50.231909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d94b6-3d03-4c68-8722-203ae64b6fbe admin admin] PATH_INFO: `/v3/projects/25b8a6e334f24318a19e3ddcefe1a070/users/2e440e3de6a14082a23821142c00d98a/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:50.249407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d94b6-3d03-4c68-8722-203ae64b6fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b8a6e334f24318a19e3ddcefe1a070, user_id=2e440e3de6a14082a23821142c00d98a, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:50.252261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d94b6-3d03-4c68-8722-203ae64b6fbe admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:50.280422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1093/2176] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:50 2022] PUT /identity/v3/projects/25b8a6e334f24318a19e3ddcefe1a070/users/2e440e3de6a14082a23821142c00d98a/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:50.280422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb2361-3f18-40e1-a1f2-a945975153bc None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:50.280422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb2361-3f18-40e1-a1f2-a945975153bc None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:50.280422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb2361-3f18-40e1-a1f2-a945975153bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:50.295322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b8f7e-a4ea-4558-b679-0f0a8a9560b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:50.297000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b8f7e-a4ea-4558-b679-0f0a8a9560b7 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:50.299483 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3acb2361-3f18-40e1-a1f2-a945975153bc None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:50.300744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3acb2361-3f18-40e1-a1f2-a945975153bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:50.314596 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1084/2177] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:50.314596 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ce255-a8ce-4383-804b-fc3da85257cf None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:50.314596 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ce255-a8ce-4383-804b-fc3da85257cf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:50.314596 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ce255-a8ce-4383-804b-fc3da85257cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:50.342337 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a99ce255-a8ce-4383-804b-fc3da85257cf None None] MFA Rules not processed for user `2e440e3de6a14082a23821142c00d98a`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:50.343869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a99ce255-a8ce-4383-804b-fc3da85257cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:50.366174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:50.375693 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:50.393973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1094/2178] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:50.396228 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb2361-3f18-40e1-a1f2-a945975153bc None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:50.397784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3acb2361-3f18-40e1-a1f2-a945975153bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:50.440992 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1085/2179] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:50.446345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ce255-a8ce-4383-804b-fc3da85257cf None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:50.462649 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ce255-a8ce-4383-804b-fc3da85257cf None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:50.469470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb2361-3f18-40e1-a1f2-a945975153bc None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:50.470395 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645965e-9b71-4c67-9258-55425f591b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:50.471476 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645965e-9b71-4c67-9258-55425f591b04 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:50.472163 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645965e-9b71-4c67-9258-55425f591b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:50.472620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645965e-9b71-4c67-9258-55425f591b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:50.473921 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645965e-9b71-4c67-9258-55425f591b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:50.474088 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ad606-b1a9-4046-bb0b-2b44a04141b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:50.474678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ad606-b1a9-4046-bb0b-2b44a04141b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:50.475026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ad606-b1a9-4046-bb0b-2b44a04141b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:50.475311 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ad606-b1a9-4046-bb0b-2b44a04141b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:50.476927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645965e-9b71-4c67-9258-55425f591b04 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:50.488350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ad606-b1a9-4046-bb0b-2b44a04141b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:50.490675 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ad606-b1a9-4046-bb0b-2b44a04141b0 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:50.505384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1095/2180] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:50.518143 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1086/2181] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:50 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:50.524830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ad606-b1a9-4046-bb0b-2b44a04141b0 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:50.541450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ad606-b1a9-4046-bb0b-2b44a04141b0 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:50.599048 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645965e-9b71-4c67-9258-55425f591b04 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:50.601148 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f645965e-9b71-4c67-9258-55425f591b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:50.655196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50658716-b965-4166-aae3-21212a897948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:50.656039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50658716-b965-4166-aae3-21212a897948 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:50.656377 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50658716-b965-4166-aae3-21212a897948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:50.656806 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50658716-b965-4166-aae3-21212a897948 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:50.657611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50658716-b965-4166-aae3-21212a897948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:50.660037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50658716-b965-4166-aae3-21212a897948 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:50.686309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1096/2182] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:50 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:50.691253 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50658716-b965-4166-aae3-21212a897948 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:50.706816 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50658716-b965-4166-aae3-21212a897948 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:50.707097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645965e-9b71-4c67-9258-55425f591b04 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:50.717926 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e189a-80c0-4447-a55d-ecbaefe0cbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:50.719337 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e189a-80c0-4447-a55d-ecbaefe0cbb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:50.719623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e189a-80c0-4447-a55d-ecbaefe0cbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:50.719962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e189a-80c0-4447-a55d-ecbaefe0cbb7 admin admin] PATH_INFO: `/v3/users/c569bc65d9e64034a0b65de3de8d5a3c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:50.721481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e189a-80c0-4447-a55d-ecbaefe0cbb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c569bc65d9e64034a0b65de3de8d5a3c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:50.723664 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e189a-80c0-4447-a55d-ecbaefe0cbb7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:50.730680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb27309-da1e-4177-8c93-e0666fbba101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:50.731695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb27309-da1e-4177-8c93-e0666fbba101 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:50.732296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb27309-da1e-4177-8c93-e0666fbba101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:50.732714 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb27309-da1e-4177-8c93-e0666fbba101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:50.733830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb27309-da1e-4177-8c93-e0666fbba101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:50.736375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb27309-da1e-4177-8c93-e0666fbba101 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:50.750071 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1097/2183] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:50.763929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb27309-da1e-4177-8c93-e0666fbba101 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:50.786323 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb27309-da1e-4177-8c93-e0666fbba101 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:50.792064 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df8346-40fb-45c8-9129-7a8787424b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:50.792989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df8346-40fb-45c8-9129-7a8787424b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:50.793494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df8346-40fb-45c8-9129-7a8787424b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:50.793710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df8346-40fb-45c8-9129-7a8787424b60 admin admin] PATH_INFO: `/v3/projects/569ffff2aa464c4489173f31a79ca1e4/users/e380ad7886e747c3a75368495aff17ed/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:50.812226 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df8346-40fb-45c8-9129-7a8787424b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=569ffff2aa464c4489173f31a79ca1e4, user_id=e380ad7886e747c3a75368495aff17ed, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:50.817281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4a0e189a-80c0-4447-a55d-ecbaefe0cbb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c569bc65d9e64034a0b65de3de8d5a3c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:50.817454 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df8346-40fb-45c8-9129-7a8787424b60 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:50.817883 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4a0e189a-80c0-4447-a55d-ecbaefe0cbb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c569bc65d9e64034a0b65de3de8d5a3c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:50.834912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1098/2184] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:50 2022] PUT /identity/v3/projects/569ffff2aa464c4489173f31a79ca1e4/users/e380ad7886e747c3a75368495aff17ed/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:50.841153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4a0e189a-80c0-4447-a55d-ecbaefe0cbb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c569bc65d9e64034a0b65de3de8d5a3c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:50.841349 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df8346-40fb-45c8-9129-7a8787424b60 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:50.857648 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4a0e189a-80c0-4447-a55d-ecbaefe0cbb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c569bc65d9e64034a0b65de3de8d5a3c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:50.870882 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4a0e189a-80c0-4447-a55d-ecbaefe0cbb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c569bc65d9e64034a0b65de3de8d5a3c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:50.878869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1087/2185] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:50 2022] DELETE /identity/v3/users/c569bc65d9e64034a0b65de3de8d5a3c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:50.884034 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c69da-5c9d-4681-86be-637ee9b95515 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:50.884506 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c69da-5c9d-4681-86be-637ee9b95515 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:50.884795 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c69da-5c9d-4681-86be-637ee9b95515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:50.908413 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-750c69da-5c9d-4681-86be-637ee9b95515 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:50.909627 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-750c69da-5c9d-4681-86be-637ee9b95515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:50.923120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:50.939870 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:50.947003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df8346-40fb-45c8-9129-7a8787424b60 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:50.982350 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1088/2186] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:50.982350 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c69da-5c9d-4681-86be-637ee9b95515 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:50.982350 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-750c69da-5c9d-4681-86be-637ee9b95515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:50.995342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c69da-5c9d-4681-86be-637ee9b95515 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:51.000093 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:51.000973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.001415 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.001689 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870 admin admin] PATH_INFO: `/v3/projects/c07f155152d844118a22d603c3757f82` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.002932 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c07f155152d844118a22d603c3757f82)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:51.004860 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:51.017219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530074ef-11dc-4540-b1fb-09bab3183ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:51.017940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530074ef-11dc-4540-b1fb-09bab3183ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.018252 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530074ef-11dc-4540-b1fb-09bab3183ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.018529 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530074ef-11dc-4540-b1fb-09bab3183ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.019290 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530074ef-11dc-4540-b1fb-09bab3183ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:51.020952 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530074ef-11dc-4540-b1fb-09bab3183ec4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:51.031239 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1099/2187] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:09:51.032252 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530074ef-11dc-4540-b1fb-09bab3183ec4 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:51.034112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-530074ef-11dc-4540-b1fb-09bab3183ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:51.054803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c07f155152d844118a22d603c3757f82', 'request_id': 'req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:51.064584 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c07f155152d844118a22d603c3757f82', 'request_id': 'req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:51.071513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c07f155152d844118a22d603c3757f82', 'request_id': 'req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:51.084387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870 admin admin] The token cache is being invalidate because project c07f155152d844118a22d603c3757f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:51.084671 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:51.085342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:51.087106 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1089/2188] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:50 2022] DELETE /identity/v3/projects/c07f155152d844118a22d603c3757f82 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:51.087859 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:51.089317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:51.099993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530074ef-11dc-4540-b1fb-09bab3183ec4 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:51.155712 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7234c02-eed1-4080-9056-2cac95b382a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:51.156378 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234c02-eed1-4080-9056-2cac95b382a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.156661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234c02-eed1-4080-9056-2cac95b382a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.156935 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234c02-eed1-4080-9056-2cac95b382a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.158861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e7234c02-eed1-4080-9056-2cac95b382a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:51.169920 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9f355-6fa7-42d2-b8cd-b9354cb5d870 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:51.171664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7234c02-eed1-4080-9056-2cac95b382a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:51.173120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7234c02-eed1-4080-9056-2cac95b382a1 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:51.175147 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52405dc5-b41e-4432-a486-e47fd629bc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:51.176065 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52405dc5-b41e-4432-a486-e47fd629bc11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.176350 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52405dc5-b41e-4432-a486-e47fd629bc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.176624 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52405dc5-b41e-4432-a486-e47fd629bc11 admin admin] PATH_INFO: `/v3/projects/569ffff2aa464c4489173f31a79ca1e4/users/e380ad7886e747c3a75368495aff17ed/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.179490 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52405dc5-b41e-4432-a486-e47fd629bc11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=569ffff2aa464c4489173f31a79ca1e4, user_id=e380ad7886e747c3a75368495aff17ed, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:51.182723 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52405dc5-b41e-4432-a486-e47fd629bc11 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:51.183783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1100/2189] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:51.184866 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83155f0a-902c-43df-93bc-06f002cc0d83 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.185151 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83155f0a-902c-43df-93bc-06f002cc0d83 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.185427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83155f0a-902c-43df-93bc-06f002cc0d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.198365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1090/2190] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:51 2022] PUT /identity/v3/projects/569ffff2aa464c4489173f31a79ca1e4/users/e380ad7886e747c3a75368495aff17ed/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:51.207704 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-83155f0a-902c-43df-93bc-06f002cc0d83 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:51.207704 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-83155f0a-902c-43df-93bc-06f002cc0d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:51.210417 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf4afb-9164-4008-a4e3-1eff63e612d1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.210713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf4afb-9164-4008-a4e3-1eff63e612d1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.211009 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf4afb-9164-4008-a4e3-1eff63e612d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.245224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-29cf4afb-9164-4008-a4e3-1eff63e612d1 None None] MFA Rules not processed for user `e380ad7886e747c3a75368495aff17ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:51.246543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-29cf4afb-9164-4008-a4e3-1eff63e612d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:51.272305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:51.280144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:51.284526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1101/2191] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:51.294315 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff32e7-2a48-4a18-b625-582d1f7c1293 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.294699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff32e7-2a48-4a18-b625-582d1f7c1293 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.295878 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff32e7-2a48-4a18-b625-582d1f7c1293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.318800 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-88ff32e7-2a48-4a18-b625-582d1f7c1293 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:51.320111 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-88ff32e7-2a48-4a18-b625-582d1f7c1293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:51.332573 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1102/2192] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:51.337752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff32e7-2a48-4a18-b625-582d1f7c1293 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:51.347844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff32e7-2a48-4a18-b625-582d1f7c1293 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:51.360379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679f571-f00e-468b-bc6e-a5df48c7758d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:51.360379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679f571-f00e-468b-bc6e-a5df48c7758d admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.360379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679f571-f00e-468b-bc6e-a5df48c7758d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.361341 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1091/2193] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:51.361450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679f571-f00e-468b-bc6e-a5df48c7758d admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.361450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679f571-f00e-468b-bc6e-a5df48c7758d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:51.361450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679f571-f00e-468b-bc6e-a5df48c7758d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:51.361450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679f571-f00e-468b-bc6e-a5df48c7758d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:51.371394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf4afb-9164-4008-a4e3-1eff63e612d1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:51.372899 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-29cf4afb-9164-4008-a4e3-1eff63e612d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:51.381179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1103/2194] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:51.382289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679f571-f00e-468b-bc6e-a5df48c7758d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:51.400134 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679f571-f00e-468b-bc6e-a5df48c7758d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:51.407921 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb68cc-0283-4e6a-bcc1-9473ff53003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:51.408663 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb68cc-0283-4e6a-bcc1-9473ff53003e admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.408947 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb68cc-0283-4e6a-bcc1-9473ff53003e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.409221 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb68cc-0283-4e6a-bcc1-9473ff53003e admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.410106 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb68cc-0283-4e6a-bcc1-9473ff53003e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:51.412040 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb68cc-0283-4e6a-bcc1-9473ff53003e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:51.460890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1104/2195] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:51 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:51.465508 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb68cc-0283-4e6a-bcc1-9473ff53003e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:51.472964 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf4afb-9164-4008-a4e3-1eff63e612d1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:51.536218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee506d84-b7b5-4db3-8f90-d6b3d6341c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:51.537080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee506d84-b7b5-4db3-8f90-d6b3d6341c94 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.537568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee506d84-b7b5-4db3-8f90-d6b3d6341c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.538247 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee506d84-b7b5-4db3-8f90-d6b3d6341c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.543402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb68cc-0283-4e6a-bcc1-9473ff53003e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:51.548640 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54334da-66e2-49ed-b1ea-6a837b9ba361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:51.549336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54334da-66e2-49ed-b1ea-6a837b9ba361 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.549625 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54334da-66e2-49ed-b1ea-6a837b9ba361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.550055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54334da-66e2-49ed-b1ea-6a837b9ba361 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.551475 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54334da-66e2-49ed-b1ea-6a837b9ba361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:51.553130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54334da-66e2-49ed-b1ea-6a837b9ba361 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:51.582724 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1105/2196] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:51 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:09:51.586901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54334da-66e2-49ed-b1ea-6a837b9ba361 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:51.600568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54334da-66e2-49ed-b1ea-6a837b9ba361 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:51.605780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915cbc4-bf85-4dd1-9f0c-fd49947290e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:51.606514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915cbc4-bf85-4dd1-9f0c-fd49947290e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.606844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915cbc4-bf85-4dd1-9f0c-fd49947290e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.607132 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915cbc4-bf85-4dd1-9f0c-fd49947290e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.607884 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915cbc4-bf85-4dd1-9f0c-fd49947290e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:51.609660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915cbc4-bf85-4dd1-9f0c-fd49947290e4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:51.619034 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee506d84-b7b5-4db3-8f90-d6b3d6341c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:51.620612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee506d84-b7b5-4db3-8f90-d6b3d6341c94 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:51.623000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1106/2197] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:51.623926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915cbc4-bf85-4dd1-9f0c-fd49947290e4 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:51.625929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b915cbc4-bf85-4dd1-9f0c-fd49947290e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:51.638218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1092/2198] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:51.639174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee506d84-b7b5-4db3-8f90-d6b3d6341c94 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:51.646802 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915cbc4-bf85-4dd1-9f0c-fd49947290e4 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:51.652320 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2923cf-fefc-44c5-b969-43f6c64880cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:51.653205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2923cf-fefc-44c5-b969-43f6c64880cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.653488 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2923cf-fefc-44c5-b969-43f6c64880cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.653761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2923cf-fefc-44c5-b969-43f6c64880cf admin admin] PATH_INFO: `/v3/projects/815b55b162c84d04bd759869d5247501` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.654568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee506d84-b7b5-4db3-8f90-d6b3d6341c94 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:51.655519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2923cf-fefc-44c5-b969-43f6c64880cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=815b55b162c84d04bd759869d5247501)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:51.657724 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2923cf-fefc-44c5-b969-43f6c64880cf admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:51.661534 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b985e22-539a-4903-aa27-991488e84fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:51.662383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b985e22-539a-4903-aa27-991488e84fad admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.662749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b985e22-539a-4903-aa27-991488e84fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.662992 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b985e22-539a-4903-aa27-991488e84fad admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.663733 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b985e22-539a-4903-aa27-991488e84fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:51.665869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b985e22-539a-4903-aa27-991488e84fad admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:51.686325 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1093/2199] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:51.690390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b985e22-539a-4903-aa27-991488e84fad admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:51.704847 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b985e22-539a-4903-aa27-991488e84fad admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:51.711783 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279a0c0-333e-4f2e-80fd-3e09f37be758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:51.712889 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279a0c0-333e-4f2e-80fd-3e09f37be758 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.713048 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279a0c0-333e-4f2e-80fd-3e09f37be758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.713341 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279a0c0-333e-4f2e-80fd-3e09f37be758 admin admin] PATH_INFO: `/v3/projects/1830a4db0686456cb45b39b204b6b2b3/users/d958437ab6884fcab6a21a90de5b001f/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.724080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6b2923cf-fefc-44c5-b969-43f6c64880cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '815b55b162c84d04bd759869d5247501', 'request_id': 'req-6b2923cf-fefc-44c5-b969-43f6c64880cf'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:51.731009 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:51.734272 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279a0c0-333e-4f2e-80fd-3e09f37be758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1830a4db0686456cb45b39b204b6b2b3, user_id=d958437ab6884fcab6a21a90de5b001f, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:51.735265 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6b2923cf-fefc-44c5-b969-43f6c64880cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '815b55b162c84d04bd759869d5247501', 'request_id': 'req-6b2923cf-fefc-44c5-b969-43f6c64880cf'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:51.737974 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279a0c0-333e-4f2e-80fd-3e09f37be758 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:51.746884 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6b2923cf-fefc-44c5-b969-43f6c64880cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '815b55b162c84d04bd759869d5247501', 'request_id': 'req-6b2923cf-fefc-44c5-b969-43f6c64880cf'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:51.754993 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1094/2200] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:51 2022] PUT /identity/v3/projects/1830a4db0686456cb45b39b204b6b2b3/users/d958437ab6884fcab6a21a90de5b001f/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:51.767177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18182a-970e-4521-9427-026aafadab51 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.767473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18182a-970e-4521-9427-026aafadab51 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.767729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6b2923cf-fefc-44c5-b969-43f6c64880cf admin admin] The token cache is being invalidate because project 815b55b162c84d04bd759869d5247501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:51.767838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18182a-970e-4521-9427-026aafadab51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.768199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6b2923cf-fefc-44c5-b969-43f6c64880cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:51.768920 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6b2923cf-fefc-44c5-b969-43f6c64880cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:51.770718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1107/2201] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:51 2022] DELETE /identity/v3/projects/815b55b162c84d04bd759869d5247501 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:51.775990 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c486d-b46e-48ab-a939-cb4cb3c9b2cd None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.776288 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c486d-b46e-48ab-a939-cb4cb3c9b2cd None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.781203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c486d-b46e-48ab-a939-cb4cb3c9b2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.799623 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a53c486d-b46e-48ab-a939-cb4cb3c9b2cd None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:51.799802 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9d18182a-970e-4521-9427-026aafadab51 None None] MFA Rules not processed for user `d958437ab6884fcab6a21a90de5b001f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:51.800933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9d18182a-970e-4521-9427-026aafadab51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:51.802080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a53c486d-b46e-48ab-a939-cb4cb3c9b2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:51.822284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:51.890068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1108/2202] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:51.898502 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af30b7-9591-4ed3-9d7f-00dfe870551c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.900256 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af30b7-9591-4ed3-9d7f-00dfe870551c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.900549 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af30b7-9591-4ed3-9d7f-00dfe870551c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.909118 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1095/2203] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:51.920422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a5af30b7-9591-4ed3-9d7f-00dfe870551c None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:51.921731 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a5af30b7-9591-4ed3-9d7f-00dfe870551c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:51.923259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18182a-970e-4521-9427-026aafadab51 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:51.925027 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9d18182a-970e-4521-9427-026aafadab51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:51.935460 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1109/2204] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:51.942790 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af30b7-9591-4ed3-9d7f-00dfe870551c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:51.953297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af30b7-9591-4ed3-9d7f-00dfe870551c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:51.958636 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373fea1-73f2-4b36-8d40-033648d246dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:51.959316 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373fea1-73f2-4b36-8d40-033648d246dd admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:51.959601 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373fea1-73f2-4b36-8d40-033648d246dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:51.959877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373fea1-73f2-4b36-8d40-033648d246dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:51.960609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373fea1-73f2-4b36-8d40-033648d246dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:51.960914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373fea1-73f2-4b36-8d40-033648d246dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:51.963517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373fea1-73f2-4b36-8d40-033648d246dd admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:51.982815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1110/2205] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:51.984567 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373fea1-73f2-4b36-8d40-033648d246dd admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:51.996090 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373fea1-73f2-4b36-8d40-033648d246dd admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:51.996950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18182a-970e-4521-9427-026aafadab51 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:52.004992 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de63fa-008c-4a5f-a6f4-0e51cc89776e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:52.005665 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de63fa-008c-4a5f-a6f4-0e51cc89776e service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:52.005972 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de63fa-008c-4a5f-a6f4-0e51cc89776e service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:52.006084 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe0709-107c-499a-8959-e25156e558f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:52.006243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de63fa-008c-4a5f-a6f4-0e51cc89776e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:52.006629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe0709-107c-499a-8959-e25156e558f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:52.006912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe0709-107c-499a-8959-e25156e558f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:52.007184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe0709-107c-499a-8959-e25156e558f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:52.007876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe0709-107c-499a-8959-e25156e558f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:52.010532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe0709-107c-499a-8959-e25156e558f9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:52.016595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de63fa-008c-4a5f-a6f4-0e51cc89776e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:52.018093 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de63fa-008c-4a5f-a6f4-0e51cc89776e service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:52.029380 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1096/2206] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:52.040551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1111/2207] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:51 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:52.044894 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de63fa-008c-4a5f-a6f4-0e51cc89776e service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:52.057330 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de63fa-008c-4a5f-a6f4-0e51cc89776e service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:52.124686 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642377f-8315-4b06-bdfb-fb4403539dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:52.126128 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642377f-8315-4b06-bdfb-fb4403539dee admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:52.126413 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642377f-8315-4b06-bdfb-fb4403539dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:52.126693 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642377f-8315-4b06-bdfb-fb4403539dee admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:52.127560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642377f-8315-4b06-bdfb-fb4403539dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:52.129339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642377f-8315-4b06-bdfb-fb4403539dee admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:52.156594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1097/2208] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:52 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:09:52.161031 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe0709-107c-499a-8959-e25156e558f9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:52.172502 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe0709-107c-499a-8959-e25156e558f9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:52.177912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342f1a6-35cf-4b8c-9ab5-e23f71b35a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:52.178636 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342f1a6-35cf-4b8c-9ab5-e23f71b35a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:52.178906 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342f1a6-35cf-4b8c-9ab5-e23f71b35a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:52.179178 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342f1a6-35cf-4b8c-9ab5-e23f71b35a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:52.179916 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342f1a6-35cf-4b8c-9ab5-e23f71b35a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:52.181708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342f1a6-35cf-4b8c-9ab5-e23f71b35a98 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:52.192249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1112/2209] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:52.197212 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642377f-8315-4b06-bdfb-fb4403539dee admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:52.208759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642377f-8315-4b06-bdfb-fb4403539dee admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:52.215529 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52939916-39b0-43e4-a287-231b6c66d557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:52.216779 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52939916-39b0-43e4-a287-231b6c66d557 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:52.217620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52939916-39b0-43e4-a287-231b6c66d557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:52.217967 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52939916-39b0-43e4-a287-231b6c66d557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:52.219204 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52939916-39b0-43e4-a287-231b6c66d557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:52.221477 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52939916-39b0-43e4-a287-231b6c66d557 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:52.236605 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1098/2210] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:52.238033 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342f1a6-35cf-4b8c-9ab5-e23f71b35a98 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:52.249459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342f1a6-35cf-4b8c-9ab5-e23f71b35a98 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:52.255244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead8f5b-ed0c-4f40-be01-b466e9bc3d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:52.256570 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead8f5b-ed0c-4f40-be01-b466e9bc3d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:52.257125 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead8f5b-ed0c-4f40-be01-b466e9bc3d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:52.257215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead8f5b-ed0c-4f40-be01-b466e9bc3d1e admin admin] PATH_INFO: `/v3/projects/d41ad5392ce34465bd63d0d787970e73/users/e5a1795d55ce4523aa344d7dd9c0892c/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:52.286018 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead8f5b-ed0c-4f40-be01-b466e9bc3d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41ad5392ce34465bd63d0d787970e73, user_id=e5a1795d55ce4523aa344d7dd9c0892c, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:52.288927 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead8f5b-ed0c-4f40-be01-b466e9bc3d1e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:52.310059 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1113/2211] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:52 2022] PUT /identity/v3/projects/d41ad5392ce34465bd63d0d787970e73/users/e5a1795d55ce4523aa344d7dd9c0892c/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:52.328263 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2d6d9-2a80-4d02-8fc5-9d83985f5284 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:52.329025 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2d6d9-2a80-4d02-8fc5-9d83985f5284 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:52.330308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2d6d9-2a80-4d02-8fc5-9d83985f5284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:52.345080 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:52.388271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c3d2d6d9-2a80-4d02-8fc5-9d83985f5284 None None] MFA Rules not processed for user `e5a1795d55ce4523aa344d7dd9c0892c`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:52.391984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c3d2d6d9-2a80-4d02-8fc5-9d83985f5284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:52.422907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead8f5b-ed0c-4f40-be01-b466e9bc3d1e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:52.425333 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-dead8f5b-ed0c-4f40-be01-b466e9bc3d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:52.499993 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1099/2212] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:52.513331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2d6d9-2a80-4d02-8fc5-9d83985f5284 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:52.531874 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead8f5b-ed0c-4f40-be01-b466e9bc3d1e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:52.545472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bab79-0823-4b63-ba91-70ce7f89fc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:52.546501 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bab79-0823-4b63-ba91-70ce7f89fc46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:52.546753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bab79-0823-4b63-ba91-70ce7f89fc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:52.547114 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bab79-0823-4b63-ba91-70ce7f89fc46 admin admin] PATH_INFO: `/v3/users/2e440e3de6a14082a23821142c00d98a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:52.548648 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bab79-0823-4b63-ba91-70ce7f89fc46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e440e3de6a14082a23821142c00d98a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:52.551785 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bab79-0823-4b63-ba91-70ce7f89fc46 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:52.601773 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2d6d9-2a80-4d02-8fc5-9d83985f5284 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:52.606159 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0ce09-199a-481e-88d9-3c77608639a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:52.606975 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0ce09-199a-481e-88d9-3c77608639a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:52.607716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0ce09-199a-481e-88d9-3c77608639a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:52.607716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0ce09-199a-481e-88d9-3c77608639a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:52.615622 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:52.618455 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0ce09-199a-481e-88d9-3c77608639a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:52.620123 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0ce09-199a-481e-88d9-3c77608639a2 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:52.620543 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d45bab79-0823-4b63-ba91-70ce7f89fc46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e440e3de6a14082a23821142c00d98a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:52.631913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1100/2213] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:52.636784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d45bab79-0823-4b63-ba91-70ce7f89fc46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e440e3de6a14082a23821142c00d98a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:52.637762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d45bab79-0823-4b63-ba91-70ce7f89fc46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e440e3de6a14082a23821142c00d98a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:52.650062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d45bab79-0823-4b63-ba91-70ce7f89fc46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e440e3de6a14082a23821142c00d98a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:52.658652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d45bab79-0823-4b63-ba91-70ce7f89fc46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e440e3de6a14082a23821142c00d98a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:52.666436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1114/2214] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:52 2022] DELETE /identity/v3/users/2e440e3de6a14082a23821142c00d98a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:52.670998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5e87a-ff2a-414f-92b8-426cb1b7595e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:52.671364 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5e87a-ff2a-414f-92b8-426cb1b7595e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:52.671736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5e87a-ff2a-414f-92b8-426cb1b7595e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:52.693141 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e7b5e87a-ff2a-414f-92b8-426cb1b7595e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:52.694482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e7b5e87a-ff2a-414f-92b8-426cb1b7595e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:52.760213 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1101/2215] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:52.770095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bab79-0823-4b63-ba91-70ce7f89fc46 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:52.771780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d45bab79-0823-4b63-ba91-70ce7f89fc46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:52.834335 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bab79-0823-4b63-ba91-70ce7f89fc46 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:52.838724 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9ed99-d88e-4cc0-8b73-2e4c6868d913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:52.839460 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9ed99-d88e-4cc0-8b73-2e4c6868d913 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:52.839744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9ed99-d88e-4cc0-8b73-2e4c6868d913 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:52.840026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9ed99-d88e-4cc0-8b73-2e4c6868d913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:52.849679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9ed99-d88e-4cc0-8b73-2e4c6868d913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:52.851188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9ed99-d88e-4cc0-8b73-2e4c6868d913 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:52.863197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1115/2216] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:53.162972 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5e87a-ff2a-414f-92b8-426cb1b7595e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:53.164502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e7b5e87a-ff2a-414f-92b8-426cb1b7595e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:53.179674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5e87a-ff2a-414f-92b8-426cb1b7595e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:53.185487 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5beec-36c7-49be-9d0d-91081a13f1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:53.186420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5beec-36c7-49be-9d0d-91081a13f1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:53.186809 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5beec-36c7-49be-9d0d-91081a13f1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:53.186973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5beec-36c7-49be-9d0d-91081a13f1f3 admin admin] PATH_INFO: `/v3/projects/25b8a6e334f24318a19e3ddcefe1a070` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:53.188231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5beec-36c7-49be-9d0d-91081a13f1f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b8a6e334f24318a19e3ddcefe1a070)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:53.190218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5beec-36c7-49be-9d0d-91081a13f1f3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:53.226002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:53.240946 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-53c5beec-36c7-49be-9d0d-91081a13f1f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b8a6e334f24318a19e3ddcefe1a070', 'request_id': 'req-53c5beec-36c7-49be-9d0d-91081a13f1f3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:53.250662 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-53c5beec-36c7-49be-9d0d-91081a13f1f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b8a6e334f24318a19e3ddcefe1a070', 'request_id': 'req-53c5beec-36c7-49be-9d0d-91081a13f1f3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:53.259999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-53c5beec-36c7-49be-9d0d-91081a13f1f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b8a6e334f24318a19e3ddcefe1a070', 'request_id': 'req-53c5beec-36c7-49be-9d0d-91081a13f1f3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:53.275178 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-53c5beec-36c7-49be-9d0d-91081a13f1f3 admin admin] The token cache is being invalidate because project 25b8a6e334f24318a19e3ddcefe1a070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:53.275397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-53c5beec-36c7-49be-9d0d-91081a13f1f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:53.276076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-53c5beec-36c7-49be-9d0d-91081a13f1f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:53.277870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1102/2217] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:53 2022] DELETE /identity/v3/projects/25b8a6e334f24318a19e3ddcefe1a070 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:53.282019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9ed99-d88e-4cc0-8b73-2e4c6868d913 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:53.292696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9ed99-d88e-4cc0-8b73-2e4c6868d913 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:53.352308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6a08b-9f23-46b1-8b13-a04931282c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:53.353202 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6a08b-9f23-46b1-8b13-a04931282c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:53.353485 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6a08b-9f23-46b1-8b13-a04931282c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:53.353764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6a08b-9f23-46b1-8b13-a04931282c46 admin admin] PATH_INFO: `/v3/users/e380ad7886e747c3a75368495aff17ed` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:53.354990 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6a08b-9f23-46b1-8b13-a04931282c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e380ad7886e747c3a75368495aff17ed)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:53.356930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6a08b-9f23-46b1-8b13-a04931282c46 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:53.406094 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e9f6a08b-9f23-46b1-8b13-a04931282c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e380ad7886e747c3a75368495aff17ed'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:53.420742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e9f6a08b-9f23-46b1-8b13-a04931282c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e380ad7886e747c3a75368495aff17ed'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:53.422909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e9f6a08b-9f23-46b1-8b13-a04931282c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e380ad7886e747c3a75368495aff17ed'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:53.425894 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:53.433755 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e9f6a08b-9f23-46b1-8b13-a04931282c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e380ad7886e747c3a75368495aff17ed'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:53.445600 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e9f6a08b-9f23-46b1-8b13-a04931282c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e380ad7886e747c3a75368495aff17ed'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:53.454545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1116/2218] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:53 2022] DELETE /identity/v3/users/e380ad7886e747c3a75368495aff17ed => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:53.880463 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5beec-36c7-49be-9d0d-91081a13f1f3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:53.882017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-53c5beec-36c7-49be-9d0d-91081a13f1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:53.895894 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5beec-36c7-49be-9d0d-91081a13f1f3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:53.964437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68498796-96d9-438d-becb-4a296cb125de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:53.966037 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68498796-96d9-438d-becb-4a296cb125de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:53.966317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68498796-96d9-438d-becb-4a296cb125de admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:53.966593 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68498796-96d9-438d-becb-4a296cb125de admin admin] PATH_INFO: `/v3/projects/569ffff2aa464c4489173f31a79ca1e4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:53.967816 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68498796-96d9-438d-becb-4a296cb125de admin admin] RBAC: Authorizing `identity:delete_project(project_id=569ffff2aa464c4489173f31a79ca1e4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:53.969755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68498796-96d9-438d-becb-4a296cb125de admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:54.019537 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-68498796-96d9-438d-becb-4a296cb125de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569ffff2aa464c4489173f31a79ca1e4', 'request_id': 'req-68498796-96d9-438d-becb-4a296cb125de'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:54.028779 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-68498796-96d9-438d-becb-4a296cb125de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569ffff2aa464c4489173f31a79ca1e4', 'request_id': 'req-68498796-96d9-438d-becb-4a296cb125de'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:54.035693 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-68498796-96d9-438d-becb-4a296cb125de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569ffff2aa464c4489173f31a79ca1e4', 'request_id': 'req-68498796-96d9-438d-becb-4a296cb125de'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:54.047326 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-68498796-96d9-438d-becb-4a296cb125de admin admin] The token cache is being invalidate because project 569ffff2aa464c4489173f31a79ca1e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:54.047545 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-68498796-96d9-438d-becb-4a296cb125de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:54.048202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-68498796-96d9-438d-becb-4a296cb125de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:54.049776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1103/2219] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:53 2022] DELETE /identity/v3/projects/569ffff2aa464c4489173f31a79ca1e4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:54.055939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb86af-8c4c-4c73-87d2-e3bb4b448e17 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:54.056406 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb86af-8c4c-4c73-87d2-e3bb4b448e17 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:54.056660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb86af-8c4c-4c73-87d2-e3bb4b448e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:54.079178 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2ebb86af-8c4c-4c73-87d2-e3bb4b448e17 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:54.080699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2ebb86af-8c4c-4c73-87d2-e3bb4b448e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:54.144790 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1117/2220] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:54.155102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef14c0-8915-4219-b610-f90ed3dfe9c6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:54.155393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef14c0-8915-4219-b610-f90ed3dfe9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:54.155676 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef14c0-8915-4219-b610-f90ed3dfe9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:54.175071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b2ef14c0-8915-4219-b610-f90ed3dfe9c6 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:54.176284 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b2ef14c0-8915-4219-b610-f90ed3dfe9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:54.184809 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1104/2221] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:54.189208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb86af-8c4c-4c73-87d2-e3bb4b448e17 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:54.199596 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb86af-8c4c-4c73-87d2-e3bb4b448e17 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:54.204918 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702ec16-1706-4b05-891f-ec18967527ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:54.205595 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702ec16-1706-4b05-891f-ec18967527ed admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:54.205921 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702ec16-1706-4b05-891f-ec18967527ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:54.206202 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702ec16-1706-4b05-891f-ec18967527ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:54.206943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702ec16-1706-4b05-891f-ec18967527ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:54.207314 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702ec16-1706-4b05-891f-ec18967527ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:54.208894 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702ec16-1706-4b05-891f-ec18967527ed admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:54.221514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1118/2222] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:54.227766 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef14c0-8915-4219-b610-f90ed3dfe9c6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:54.241291 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef14c0-8915-4219-b610-f90ed3dfe9c6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:54.247269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3f0e1-4aeb-4c47-b2a9-c3e2caf5487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:54.247930 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3f0e1-4aeb-4c47-b2a9-c3e2caf5487f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:54.248212 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3f0e1-4aeb-4c47-b2a9-c3e2caf5487f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:54.248485 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3f0e1-4aeb-4c47-b2a9-c3e2caf5487f admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:54.249178 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3f0e1-4aeb-4c47-b2a9-c3e2caf5487f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:54.251119 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3f0e1-4aeb-4c47-b2a9-c3e2caf5487f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:54.281607 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1105/2223] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:54 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:54.286253 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702ec16-1706-4b05-891f-ec18967527ed admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:54.297465 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702ec16-1706-4b05-891f-ec18967527ed admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:54.361881 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe21684-44a1-49ef-9783-6652b1fc8383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:54.362564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe21684-44a1-49ef-9783-6652b1fc8383 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:54.362845 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe21684-44a1-49ef-9783-6652b1fc8383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:54.363191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe21684-44a1-49ef-9783-6652b1fc8383 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:54.364171 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe21684-44a1-49ef-9783-6652b1fc8383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:54.366357 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe21684-44a1-49ef-9783-6652b1fc8383 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:54.389195 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1119/2224] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:54 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:54.394031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3f0e1-4aeb-4c47-b2a9-c3e2caf5487f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:54.406179 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3f0e1-4aeb-4c47-b2a9-c3e2caf5487f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:54.412133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10413613-41e2-46cd-ae1b-f59a2c7a2cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:54.412820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413613-41e2-46cd-ae1b-f59a2c7a2cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:54.413100 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413613-41e2-46cd-ae1b-f59a2c7a2cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:54.413375 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413613-41e2-46cd-ae1b-f59a2c7a2cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:54.414146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10413613-41e2-46cd-ae1b-f59a2c7a2cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:54.416576 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10413613-41e2-46cd-ae1b-f59a2c7a2cf4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:54.429048 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1106/2225] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:09:54.433943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe21684-44a1-49ef-9783-6652b1fc8383 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:54.447578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe21684-44a1-49ef-9783-6652b1fc8383 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:54.452367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342df24e-e639-429c-a802-5d2bb9d9016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:54.453036 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342df24e-e639-429c-a802-5d2bb9d9016d admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:54.453317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342df24e-e639-429c-a802-5d2bb9d9016d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:54.453585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342df24e-e639-429c-a802-5d2bb9d9016d admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:54.454702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342df24e-e639-429c-a802-5d2bb9d9016d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:54.456322 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342df24e-e639-429c-a802-5d2bb9d9016d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:54.466776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1120/2226] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:54.471242 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10413613-41e2-46cd-ae1b-f59a2c7a2cf4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:54.482542 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10413613-41e2-46cd-ae1b-f59a2c7a2cf4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:54.488796 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b75e9-5697-41af-9029-3090629384bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:54.489758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b75e9-5697-41af-9029-3090629384bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:54.490020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b75e9-5697-41af-9029-3090629384bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:54.490298 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b75e9-5697-41af-9029-3090629384bd admin admin] PATH_INFO: `/v3/projects/7f51d5b23cac46d99d08ec5b57916c42/users/5811a8cd91c3467485516a3e7e61fe61/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:54.494776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:54.509362 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b75e9-5697-41af-9029-3090629384bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f51d5b23cac46d99d08ec5b57916c42, user_id=5811a8cd91c3467485516a3e7e61fe61, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:54.512651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b75e9-5697-41af-9029-3090629384bd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:54.536525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1107/2227] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:54 2022] PUT /identity/v3/projects/7f51d5b23cac46d99d08ec5b57916c42/users/5811a8cd91c3467485516a3e7e61fe61/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:54.545058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf0e79-ca84-4078-a2b7-5699dc617e34 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:54.545514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf0e79-ca84-4078-a2b7-5699dc617e34 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:54.545948 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf0e79-ca84-4078-a2b7-5699dc617e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:54.547954 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdb632-9fbf-4a49-9bdc-64e8876e10e5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:54.548088 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdb632-9fbf-4a49-9bdc-64e8876e10e5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:54.548386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdb632-9fbf-4a49-9bdc-64e8876e10e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:54.568703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7bfdb632-9fbf-4a49-9bdc-64e8876e10e5 None None] MFA Rules not processed for user `d958437ab6884fcab6a21a90de5b001f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:54.570055 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7bfdb632-9fbf-4a49-9bdc-64e8876e10e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:54.576425 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-cebf0e79-ca84-4078-a2b7-5699dc617e34 None None] MFA Rules not processed for user `5811a8cd91c3467485516a3e7e61fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:54.577647 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cebf0e79-ca84-4078-a2b7-5699dc617e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:54.620760 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:54.634858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1108/2228] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:54.653227 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1121/2229] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:54.657993 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdb632-9fbf-4a49-9bdc-64e8876e10e5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:54.749651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdb632-9fbf-4a49-9bdc-64e8876e10e5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:54.754352 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ef7f5-a04c-433a-a412-30d7cb36262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:54.755086 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ef7f5-a04c-433a-a412-30d7cb36262e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:54.755333 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ef7f5-a04c-433a-a412-30d7cb36262e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:54.755729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ef7f5-a04c-433a-a412-30d7cb36262e admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:54.772695 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ef7f5-a04c-433a-a412-30d7cb36262e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:54.774719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ef7f5-a04c-433a-a412-30d7cb36262e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:54.810543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1109/2230] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:54 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:09:54.814772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf0e79-ca84-4078-a2b7-5699dc617e34 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:54.830329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf0e79-ca84-4078-a2b7-5699dc617e34 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:54.934811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc36d72-4a8e-4bf6-ae13-dba631b1190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:54.937311 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc36d72-4a8e-4bf6-ae13-dba631b1190c admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:54.937600 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc36d72-4a8e-4bf6-ae13-dba631b1190c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:54.938478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc36d72-4a8e-4bf6-ae13-dba631b1190c admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:54.938911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc36d72-4a8e-4bf6-ae13-dba631b1190c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:54.941533 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc36d72-4a8e-4bf6-ae13-dba631b1190c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:54.970775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1122/2231] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:54 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:54.974816 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ef7f5-a04c-433a-a412-30d7cb36262e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:54.979599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc36d72-4a8e-4bf6-ae13-dba631b1190c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:54.983260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6fc36d72-4a8e-4bf6-ae13-dba631b1190c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:54.986402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ef7f5-a04c-433a-a412-30d7cb36262e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:54.995531 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8d12d-a6ab-4acf-acb6-f5bbc2fb19bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:54.996383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8d12d-a6ab-4acf-acb6-f5bbc2fb19bd admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:54.996673 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8d12d-a6ab-4acf-acb6-f5bbc2fb19bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:54.996956 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8d12d-a6ab-4acf-acb6-f5bbc2fb19bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:54.998884 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8d12d-a6ab-4acf-acb6-f5bbc2fb19bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:55.000621 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8d12d-a6ab-4acf-acb6-f5bbc2fb19bd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:55.017190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1110/2232] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:55.021936 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8d12d-a6ab-4acf-acb6-f5bbc2fb19bd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:55.036304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8d12d-a6ab-4acf-acb6-f5bbc2fb19bd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:55.043800 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3335f-497c-4668-b5f7-39a645ec3701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:55.044506 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3335f-497c-4668-b5f7-39a645ec3701 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:55.044961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3335f-497c-4668-b5f7-39a645ec3701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:55.045213 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3335f-497c-4668-b5f7-39a645ec3701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:55.046035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3335f-497c-4668-b5f7-39a645ec3701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:55.047935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3335f-497c-4668-b5f7-39a645ec3701 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:55.062228 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1111/2233] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:55.067243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3335f-497c-4668-b5f7-39a645ec3701 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:55.082023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc36d72-4a8e-4bf6-ae13-dba631b1190c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:55.083255 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3335f-497c-4668-b5f7-39a645ec3701 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:55.087546 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2c39a-45fc-4942-8542-dd00f25c5c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:55.088542 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2c39a-45fc-4942-8542-dd00f25c5c8e service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:55.088889 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2c39a-45fc-4942-8542-dd00f25c5c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:55.089406 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2c39a-45fc-4942-8542-dd00f25c5c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:55.090159 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf094b2-0b4b-4a8d-8ca8-b1ab53fd46fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:55.091375 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf094b2-0b4b-4a8d-8ca8-b1ab53fd46fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:55.091811 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf094b2-0b4b-4a8d-8ca8-b1ab53fd46fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:55.092072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-daa2c39a-45fc-4942-8542-dd00f25c5c8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:55.092438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf094b2-0b4b-4a8d-8ca8-b1ab53fd46fa admin admin] PATH_INFO: `/v3/projects/d23813ceb1f74131abfe72385e3b0764/users/8c320ac62e7345a995ff63f65ca7a164/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:55.110789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf094b2-0b4b-4a8d-8ca8-b1ab53fd46fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23813ceb1f74131abfe72385e3b0764, user_id=8c320ac62e7345a995ff63f65ca7a164, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:55.113738 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf094b2-0b4b-4a8d-8ca8-b1ab53fd46fa admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:55.134484 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1112/2234] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:55 2022] PUT /identity/v3/projects/d23813ceb1f74131abfe72385e3b0764/users/8c320ac62e7345a995ff63f65ca7a164/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:55.150444 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20cb7b-5b5d-40bf-a180-6f23683286da None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:55.150693 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20cb7b-5b5d-40bf-a180-6f23683286da None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:55.150949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20cb7b-5b5d-40bf-a180-6f23683286da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:55.188969 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2f20cb7b-5b5d-40bf-a180-6f23683286da None None] MFA Rules not processed for user `8c320ac62e7345a995ff63f65ca7a164`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:55.191991 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2f20cb7b-5b5d-40bf-a180-6f23683286da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:55.216129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:55.220578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2c39a-45fc-4942-8542-dd00f25c5c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:55.222466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2c39a-45fc-4942-8542-dd00f25c5c8e service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:55.235341 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1123/2235] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:55.236244 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2c39a-45fc-4942-8542-dd00f25c5c8e service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:55.237629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-daa2c39a-45fc-4942-8542-dd00f25c5c8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:55.255351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2c39a-45fc-4942-8542-dd00f25c5c8e service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:55.274192 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:55.290015 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1113/2236] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:55.295456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20cb7b-5b5d-40bf-a180-6f23683286da None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:55.352817 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d80933-e88c-49b2-b29e-58af49976c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:55.355376 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d80933-e88c-49b2-b29e-58af49976c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:55.355663 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d80933-e88c-49b2-b29e-58af49976c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:55.355969 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d80933-e88c-49b2-b29e-58af49976c6e admin admin] PATH_INFO: `/v3/users/e5a1795d55ce4523aa344d7dd9c0892c` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:55.358444 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d80933-e88c-49b2-b29e-58af49976c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a1795d55ce4523aa344d7dd9c0892c)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:55.360869 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d80933-e88c-49b2-b29e-58af49976c6e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:55.383956 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20cb7b-5b5d-40bf-a180-6f23683286da None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:55.389426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d5dd9-2010-42b7-bef9-19341494e1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:55.390249 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d5dd9-2010-42b7-bef9-19341494e1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:55.390571 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d5dd9-2010-42b7-bef9-19341494e1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:55.390799 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d5dd9-2010-42b7-bef9-19341494e1a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:55.391501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d5dd9-2010-42b7-bef9-19341494e1a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:55.393822 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d5dd9-2010-42b7-bef9-19341494e1a4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:55.429973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1114/2237] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:55 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:09:55.435052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d5dd9-2010-42b7-bef9-19341494e1a4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:55.447276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f0d80933-e88c-49b2-b29e-58af49976c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a1795d55ce4523aa344d7dd9c0892c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:55.473886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f0d80933-e88c-49b2-b29e-58af49976c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a1795d55ce4523aa344d7dd9c0892c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:55.474867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f0d80933-e88c-49b2-b29e-58af49976c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a1795d55ce4523aa344d7dd9c0892c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:55.486859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f0d80933-e88c-49b2-b29e-58af49976c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a1795d55ce4523aa344d7dd9c0892c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:55.499733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f0d80933-e88c-49b2-b29e-58af49976c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a1795d55ce4523aa344d7dd9c0892c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:55.507497 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1124/2238] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:55 2022] DELETE /identity/v3/users/e5a1795d55ce4523aa344d7dd9c0892c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:55.511977 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a874c6-0cf6-4042-869e-f2d742d69fbd None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:55.512380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a874c6-0cf6-4042-869e-f2d742d69fbd None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:55.512747 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a874c6-0cf6-4042-869e-f2d742d69fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:55.529724 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d5dd9-2010-42b7-bef9-19341494e1a4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:55.539828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-64a874c6-0cf6-4042-869e-f2d742d69fbd None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:55.541169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-64a874c6-0cf6-4042-869e-f2d742d69fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:55.623577 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1125/2239] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:55.632103 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:55.642424 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a874c6-0cf6-4042-869e-f2d742d69fbd None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:55.654054 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-64a874c6-0cf6-4042-869e-f2d742d69fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:55.654367 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04053cae-7947-48a7-8631-4404ca2c3653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:55.654367 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04053cae-7947-48a7-8631-4404ca2c3653 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:55.654367 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04053cae-7947-48a7-8631-4404ca2c3653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:55.654367 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04053cae-7947-48a7-8631-4404ca2c3653 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:55.654717 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04053cae-7947-48a7-8631-4404ca2c3653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:55.661169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04053cae-7947-48a7-8631-4404ca2c3653 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:55.702736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1115/2240] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:55 2022] POST /identity/v3/users => generated 295 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:09:55.707513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04053cae-7947-48a7-8631-4404ca2c3653 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:55.710829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-04053cae-7947-48a7-8631-4404ca2c3653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:55.719527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:55.731439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04053cae-7947-48a7-8631-4404ca2c3653 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:55.738262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fbf00-8ccc-49c0-a999-681ee8e9f259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:55.739848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fbf00-8ccc-49c0-a999-681ee8e9f259 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:55.740390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fbf00-8ccc-49c0-a999-681ee8e9f259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:55.740990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fbf00-8ccc-49c0-a999-681ee8e9f259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:55.741857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fbf00-8ccc-49c0-a999-681ee8e9f259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:55.743638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fbf00-8ccc-49c0-a999-681ee8e9f259 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:55.754361 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a874c6-0cf6-4042-869e-f2d742d69fbd None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:55.758417 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1116/2241] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:09:55.762352 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fbf00-8ccc-49c0-a999-681ee8e9f259 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:55.765240 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c3bd6-624c-4f70-ab75-cd2457bc2508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:55.772493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c3bd6-624c-4f70-ab75-cd2457bc2508 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:55.772493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c3bd6-624c-4f70-ab75-cd2457bc2508 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:55.772493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c3bd6-624c-4f70-ab75-cd2457bc2508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:55.781059 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fbf00-8ccc-49c0-a999-681ee8e9f259 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:55.782004 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c3bd6-624c-4f70-ab75-cd2457bc2508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:55.783982 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c3bd6-624c-4f70-ab75-cd2457bc2508 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:55.787540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a076253-01cc-4b87-b07d-ad0658f50f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:55.788743 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a076253-01cc-4b87-b07d-ad0658f50f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:55.788921 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a076253-01cc-4b87-b07d-ad0658f50f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:55.789256 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a076253-01cc-4b87-b07d-ad0658f50f2f admin admin] PATH_INFO: `/v3/projects/aaf933741eda41b4b91fbebc819f8b6b/users/a86e6b21a4fa4b24a4ae9152eb457e6a/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:55.797904 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1126/2242] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:55.816222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a076253-01cc-4b87-b07d-ad0658f50f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf933741eda41b4b91fbebc819f8b6b, user_id=a86e6b21a4fa4b24a4ae9152eb457e6a, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:55.820448 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a076253-01cc-4b87-b07d-ad0658f50f2f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:55.842670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1117/2243] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:55 2022] PUT /identity/v3/projects/aaf933741eda41b4b91fbebc819f8b6b/users/a86e6b21a4fa4b24a4ae9152eb457e6a/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:55.846931 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c3bd6-624c-4f70-ab75-cd2457bc2508 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:55.873307 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c3bd6-624c-4f70-ab75-cd2457bc2508 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:55.955195 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fa6f8-a0f4-4ed4-8363-4213826e8640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:55.956625 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fa6f8-a0f4-4ed4-8363-4213826e8640 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:55.960248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fa6f8-a0f4-4ed4-8363-4213826e8640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:55.960248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fa6f8-a0f4-4ed4-8363-4213826e8640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:55.960248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fa6f8-a0f4-4ed4-8363-4213826e8640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:55.962034 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a076253-01cc-4b87-b07d-ad0658f50f2f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:55.964237 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8a076253-01cc-4b87-b07d-ad0658f50f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:55.967578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fa6f8-a0f4-4ed4-8363-4213826e8640 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:55.983536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1127/2244] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:55.987497 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fa6f8-a0f4-4ed4-8363-4213826e8640 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:55.999354 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a076253-01cc-4b87-b07d-ad0658f50f2f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:56.001743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fa6f8-a0f4-4ed4-8363-4213826e8640 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:56.009858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a8204-00a2-43c3-9e0e-d39767b7709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:56.011702 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a8204-00a2-43c3-9e0e-d39767b7709a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:56.012082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a8204-00a2-43c3-9e0e-d39767b7709a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:56.012409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a8204-00a2-43c3-9e0e-d39767b7709a admin admin] PATH_INFO: `/v3/users/b46d6273b1b641fb947a124fc8ea4ae4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:56.012773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c814a-0ae7-4466-b9c1-fd5a077d6865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:56.013861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c814a-0ae7-4466-b9c1-fd5a077d6865 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:56.014251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c814a-0ae7-4466-b9c1-fd5a077d6865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:56.014370 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a8204-00a2-43c3-9e0e-d39767b7709a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46d6273b1b641fb947a124fc8ea4ae4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:56.014756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c814a-0ae7-4466-b9c1-fd5a077d6865 admin admin] PATH_INFO: `/v3/projects/aaf933741eda41b4b91fbebc819f8b6b/users/a86e6b21a4fa4b24a4ae9152eb457e6a/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:56.016728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a8204-00a2-43c3-9e0e-d39767b7709a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:56.016859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c814a-0ae7-4466-b9c1-fd5a077d6865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf933741eda41b4b91fbebc819f8b6b, user_id=a86e6b21a4fa4b24a4ae9152eb457e6a, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:56.019859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c814a-0ae7-4466-b9c1-fd5a077d6865 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:56.033262 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1128/2245] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:55 2022] PUT /identity/v3/projects/aaf933741eda41b4b91fbebc819f8b6b/users/a86e6b21a4fa4b24a4ae9152eb457e6a/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:56.045964 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f7b2f-8b35-4d21-903f-1f418aa5a351 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:56.046313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f7b2f-8b35-4d21-903f-1f418aa5a351 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:56.046653 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f7b2f-8b35-4d21-903f-1f418aa5a351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:56.081010 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-514f7b2f-8b35-4d21-903f-1f418aa5a351 None None] MFA Rules not processed for user `a86e6b21a4fa4b24a4ae9152eb457e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:56.082885 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-514f7b2f-8b35-4d21-903f-1f418aa5a351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:56.091046 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a67a8204-00a2-43c3-9e0e-d39767b7709a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46d6273b1b641fb947a124fc8ea4ae4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:56.091994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a67a8204-00a2-43c3-9e0e-d39767b7709a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46d6273b1b641fb947a124fc8ea4ae4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:56.107309 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a67a8204-00a2-43c3-9e0e-d39767b7709a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46d6273b1b641fb947a124fc8ea4ae4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:56.123893 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a67a8204-00a2-43c3-9e0e-d39767b7709a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46d6273b1b641fb947a124fc8ea4ae4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:56.131784 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a67a8204-00a2-43c3-9e0e-d39767b7709a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46d6273b1b641fb947a124fc8ea4ae4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:56.142632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1118/2246] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:09:55 2022] DELETE /identity/v3/users/b46d6273b1b641fb947a124fc8ea4ae4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:09:56.144364 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804893-59b5-4472-8615-c2a3354e2c8a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:56.144767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804893-59b5-4472-8615-c2a3354e2c8a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:56.145149 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804893-59b5-4472-8615-c2a3354e2c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:56.166703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-75804893-59b5-4472-8615-c2a3354e2c8a None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:56.168336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-75804893-59b5-4472-8615-c2a3354e2c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:56.192696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1129/2247] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:56.193075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f7b2f-8b35-4d21-903f-1f418aa5a351 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:56.196437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-514f7b2f-8b35-4d21-903f-1f418aa5a351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:56.240697 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1119/2248] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:56.240697 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75804893-59b5-4472-8615-c2a3354e2c8a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:56.240975 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-75804893-59b5-4472-8615-c2a3354e2c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:56.269181 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:56.300344 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:56.320279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f7b2f-8b35-4d21-903f-1f418aa5a351 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:56.322557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75804893-59b5-4472-8615-c2a3354e2c8a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:56.325251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02666d-18e5-4212-8497-3f980c0ab162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:56.326233 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02666d-18e5-4212-8497-3f980c0ab162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:56.326352 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d5a26-5a7c-452a-a05c-bba945654a5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:56.326511 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02666d-18e5-4212-8497-3f980c0ab162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:56.326805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02666d-18e5-4212-8497-3f980c0ab162 admin admin] PATH_INFO: `/v3/projects/d41ad5392ce34465bd63d0d787970e73` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:56.326993 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d5a26-5a7c-452a-a05c-bba945654a5e service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:56.327283 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d5a26-5a7c-452a-a05c-bba945654a5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:56.327564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d5a26-5a7c-452a-a05c-bba945654a5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:56.328146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02666d-18e5-4212-8497-3f980c0ab162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41ad5392ce34465bd63d0d787970e73)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:56.329719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-774d5a26-5a7c-452a-a05c-bba945654a5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:56.330491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02666d-18e5-4212-8497-3f980c0ab162 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:56.389226 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4d02666d-18e5-4212-8497-3f980c0ab162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41ad5392ce34465bd63d0d787970e73', 'request_id': 'req-4d02666d-18e5-4212-8497-3f980c0ab162'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:56.395810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4d02666d-18e5-4212-8497-3f980c0ab162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41ad5392ce34465bd63d0d787970e73', 'request_id': 'req-4d02666d-18e5-4212-8497-3f980c0ab162'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:56.404861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4d02666d-18e5-4212-8497-3f980c0ab162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41ad5392ce34465bd63d0d787970e73', 'request_id': 'req-4d02666d-18e5-4212-8497-3f980c0ab162'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:56.416590 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d5a26-5a7c-452a-a05c-bba945654a5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:56.418242 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d5a26-5a7c-452a-a05c-bba945654a5e service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:56.419173 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4d02666d-18e5-4212-8497-3f980c0ab162 admin admin] The token cache is being invalidate because project d41ad5392ce34465bd63d0d787970e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:56.419460 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4d02666d-18e5-4212-8497-3f980c0ab162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:56.420119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4d02666d-18e5-4212-8497-3f980c0ab162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:56.421751 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1130/2249] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:56 2022] DELETE /identity/v3/projects/d41ad5392ce34465bd63d0d787970e73 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:56.422609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02666d-18e5-4212-8497-3f980c0ab162 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:56.424110 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-4d02666d-18e5-4212-8497-3f980c0ab162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:56.434451 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1120/2250] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:56.435957 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8f400-d32c-4fad-8a71-69d527d58dd6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:56.436316 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8f400-d32c-4fad-8a71-69d527d58dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:56.436603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8f400-d32c-4fad-8a71-69d527d58dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:56.459748 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a5c8f400-d32c-4fad-8a71-69d527d58dd6 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:56.460975 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a5c8f400-d32c-4fad-8a71-69d527d58dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:56.507969 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02666d-18e5-4212-8497-3f980c0ab162 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:56.512919 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8ea88-28e8-46b7-bb86-290705f58e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:56.513607 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8ea88-28e8-46b7-bb86-290705f58e76 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:56.513919 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8ea88-28e8-46b7-bb86-290705f58e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:56.514212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8ea88-28e8-46b7-bb86-290705f58e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:56.516359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c5a8ea88-28e8-46b7-bb86-290705f58e76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:56.540541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1121/2251] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:56.542049 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51afef-d17b-4831-8c72-19b2e3972c1e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:56.542356 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51afef-d17b-4831-8c72-19b2e3972c1e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:56.542621 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51afef-d17b-4831-8c72-19b2e3972c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:56.562217 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ee51afef-d17b-4831-8c72-19b2e3972c1e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:56.563422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ee51afef-d17b-4831-8c72-19b2e3972c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:56.572650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1122/2252] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:09:56.578786 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51afef-d17b-4831-8c72-19b2e3972c1e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:56.590353 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51afef-d17b-4831-8c72-19b2e3972c1e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:56.596020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ecab3-0e6c-4b44-88a8-4d53eb1eae3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:56.597495 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ecab3-0e6c-4b44-88a8-4d53eb1eae3a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:56.597817 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ecab3-0e6c-4b44-88a8-4d53eb1eae3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:56.598106 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ecab3-0e6c-4b44-88a8-4d53eb1eae3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:56.599140 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ecab3-0e6c-4b44-88a8-4d53eb1eae3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:09:56.599566 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ecab3-0e6c-4b44-88a8-4d53eb1eae3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:56.601691 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ecab3-0e6c-4b44-88a8-4d53eb1eae3a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:56.601999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8ea88-28e8-46b7-bb86-290705f58e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:56.604303 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8ea88-28e8-46b7-bb86-290705f58e76 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:56.615169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1131/2253] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:56.616699 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1123/2254] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:09:56.622917 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8ea88-28e8-46b7-bb86-290705f58e76 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:56.641478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8ea88-28e8-46b7-bb86-290705f58e76 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:56.649016 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da19e03-37d8-4a5d-a7c5-5512593b8764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:56.650043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da19e03-37d8-4a5d-a7c5-5512593b8764 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:56.652758 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da19e03-37d8-4a5d-a7c5-5512593b8764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:56.652758 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da19e03-37d8-4a5d-a7c5-5512593b8764 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:56.652758 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da19e03-37d8-4a5d-a7c5-5512593b8764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:56.654376 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da19e03-37d8-4a5d-a7c5-5512593b8764 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:56.700200 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1132/2255] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:09:56 2022] POST /identity/v3/projects => generated 369 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:56.705052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ecab3-0e6c-4b44-88a8-4d53eb1eae3a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:56.719992 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ecab3-0e6c-4b44-88a8-4d53eb1eae3a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:56.812622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:56.836257 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5638fb-93bb-4ada-a119-4d551b3dcde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:56.836257 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5638fb-93bb-4ada-a119-4d551b3dcde9 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:56.836257 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5638fb-93bb-4ada-a119-4d551b3dcde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:56.836257 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5638fb-93bb-4ada-a119-4d551b3dcde9 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:56.836576 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5638fb-93bb-4ada-a119-4d551b3dcde9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:56.836576 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5638fb-93bb-4ada-a119-4d551b3dcde9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:56.866257 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1124/2256] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:09:56 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:09:56.868682 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da19e03-37d8-4a5d-a7c5-5512593b8764 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:56.896952 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da19e03-37d8-4a5d-a7c5-5512593b8764 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:56.911637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470e625-b754-40c4-9867-46319f910f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:56.912580 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470e625-b754-40c4-9867-46319f910f48 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:56.913383 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470e625-b754-40c4-9867-46319f910f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:56.914834 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470e625-b754-40c4-9867-46319f910f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:56.917036 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470e625-b754-40c4-9867-46319f910f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:56.921565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470e625-b754-40c4-9867-46319f910f48 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:56.925755 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:56.978120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1133/2257] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:56.981405 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5638fb-93bb-4ada-a119-4d551b3dcde9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:56.997487 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5638fb-93bb-4ada-a119-4d551b3dcde9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:57.012840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee4f7e-b8eb-4ee0-a7fa-c197d4788a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:57.013638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee4f7e-b8eb-4ee0-a7fa-c197d4788a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:57.013909 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee4f7e-b8eb-4ee0-a7fa-c197d4788a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:57.014115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee4f7e-b8eb-4ee0-a7fa-c197d4788a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:57.016181 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee4f7e-b8eb-4ee0-a7fa-c197d4788a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:57.017831 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee4f7e-b8eb-4ee0-a7fa-c197d4788a12 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:57.029864 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1125/2258] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:09:57.034561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470e625-b754-40c4-9867-46319f910f48 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:57.052162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470e625-b754-40c4-9867-46319f910f48 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:57.058535 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418232c4-0f90-4caf-9a53-b2298da11158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:57.060464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418232c4-0f90-4caf-9a53-b2298da11158 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:57.060761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418232c4-0f90-4caf-9a53-b2298da11158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:57.061047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418232c4-0f90-4caf-9a53-b2298da11158 admin admin] PATH_INFO: `/v3/projects/a58e814962c9491487d3b721fb394c95/users/eb9d449ec40c4e089bc7ae8b64750f7b/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:57.078503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418232c4-0f90-4caf-9a53-b2298da11158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58e814962c9491487d3b721fb394c95, user_id=eb9d449ec40c4e089bc7ae8b64750f7b, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:57.082061 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418232c4-0f90-4caf-9a53-b2298da11158 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:57.106800 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1134/2259] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:09:57 2022] PUT /identity/v3/projects/a58e814962c9491487d3b721fb394c95/users/eb9d449ec40c4e089bc7ae8b64750f7b/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:57.118231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a2c43-6593-4024-90a0-8b8a040802a1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:57.118936 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a2c43-6593-4024-90a0-8b8a040802a1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:57.119902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a2c43-6593-4024-90a0-8b8a040802a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:57.166789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5e3a2c43-6593-4024-90a0-8b8a040802a1 None None] MFA Rules not processed for user `eb9d449ec40c4e089bc7ae8b64750f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:09:57.168338 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5e3a2c43-6593-4024-90a0-8b8a040802a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:57.202981 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418232c4-0f90-4caf-9a53-b2298da11158 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:57.205480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-418232c4-0f90-4caf-9a53-b2298da11158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:57.266522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1126/2260] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:09:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:09:57.280926 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a2c43-6593-4024-90a0-8b8a040802a1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:57.283396 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5e3a2c43-6593-4024-90a0-8b8a040802a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:57.294474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418232c4-0f90-4caf-9a53-b2298da11158 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:57.299321 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107a25b-5044-4202-bdf8-f34ead92b0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:57.300232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107a25b-5044-4202-bdf8-f34ead92b0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:57.300512 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107a25b-5044-4202-bdf8-f34ead92b0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:57.300786 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107a25b-5044-4202-bdf8-f34ead92b0fe admin admin] PATH_INFO: `/v3/projects/b9a1ca7156e94eebb9ff03f9b43ab256` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:57.302004 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107a25b-5044-4202-bdf8-f34ead92b0fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a1ca7156e94eebb9ff03f9b43ab256)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:57.303932 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107a25b-5044-4202-bdf8-f34ead92b0fe admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:57.370966 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a2c43-6593-4024-90a0-8b8a040802a1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:57.380452 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4107a25b-5044-4202-bdf8-f34ead92b0fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a1ca7156e94eebb9ff03f9b43ab256', 'request_id': 'req-4107a25b-5044-4202-bdf8-f34ead92b0fe'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:57.387808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4107a25b-5044-4202-bdf8-f34ead92b0fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a1ca7156e94eebb9ff03f9b43ab256', 'request_id': 'req-4107a25b-5044-4202-bdf8-f34ead92b0fe'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:57.394734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4107a25b-5044-4202-bdf8-f34ead92b0fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a1ca7156e94eebb9ff03f9b43ab256', 'request_id': 'req-4107a25b-5044-4202-bdf8-f34ead92b0fe'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:57.415102 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4107a25b-5044-4202-bdf8-f34ead92b0fe admin admin] The token cache is being invalidate because project b9a1ca7156e94eebb9ff03f9b43ab256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:09:57.415416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4107a25b-5044-4202-bdf8-f34ead92b0fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:57.416151 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4107a25b-5044-4202-bdf8-f34ead92b0fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:09:57.418216 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1135/2261] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:09:57 2022] DELETE /identity/v3/projects/b9a1ca7156e94eebb9ff03f9b43ab256 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:09:57.450867 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f585a8-83a5-4d34-9f81-7bd659914366 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7e1c8c42cd4f6dab8b27829e5fc5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:57.451656 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f585a8-83a5-4d34-9f81-7bd659914366 service glance] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:57.452015 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f585a8-83a5-4d34-9f81-7bd659914366 service glance] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:57.452613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f585a8-83a5-4d34-9f81-7bd659914366 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:57.456010 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c3f585a8-83a5-4d34-9f81-7bd659914366 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:57.504216 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:57.557436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f585a8-83a5-4d34-9f81-7bd659914366 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:57.559321 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f585a8-83a5-4d34-9f81-7bd659914366 service glance] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:57.584418 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1127/2262] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:58.250113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107a25b-5044-4202-bdf8-f34ead92b0fe admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:58.252093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-4107a25b-5044-4202-bdf8-f34ead92b0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:58.336924 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107a25b-5044-4202-bdf8-f34ead92b0fe admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:58.341548 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6246726-6d4f-438b-8f6f-2cc6ac7c8dfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:58.342704 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6246726-6d4f-438b-8f6f-2cc6ac7c8dfd service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:58.343321 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6246726-6d4f-438b-8f6f-2cc6ac7c8dfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:58.343806 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6246726-6d4f-438b-8f6f-2cc6ac7c8dfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:58.346869 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b6246726-6d4f-438b-8f6f-2cc6ac7c8dfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:58.371528 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:09:58.439715 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6246726-6d4f-438b-8f6f-2cc6ac7c8dfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:58.439953 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6246726-6d4f-438b-8f6f-2cc6ac7c8dfd service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:58.451968 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1136/2263] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:09:59.190936 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f585a8-83a5-4d34-9f81-7bd659914366 service glance] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:09:59.200933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f585a8-83a5-4d34-9f81-7bd659914366 service glance] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:09:59.205121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb30d83-c29b-4c40-a97d-d1855cf63e6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:09:59.205776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb30d83-c29b-4c40-a97d-d1855cf63e6f service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:09:59.206094 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb30d83-c29b-4c40-a97d-d1855cf63e6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:09:59.206362 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb30d83-c29b-4c40-a97d-d1855cf63e6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:09:59.208135 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4bb30d83-c29b-4c40-a97d-d1855cf63e6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:09:59.281158 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb30d83-c29b-4c40-a97d-d1855cf63e6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:09:59.282598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb30d83-c29b-4c40-a97d-d1855cf63e6f service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:09:59.294169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1128/2264] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:09:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:00.535911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6246726-6d4f-438b-8f6f-2cc6ac7c8dfd service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:00.538429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b6246726-6d4f-438b-8f6f-2cc6ac7c8dfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:00.630830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6246726-6d4f-438b-8f6f-2cc6ac7c8dfd service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:00.636496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d465cc7-bcc1-4895-bb84-156bfe4b62ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:00.637530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d465cc7-bcc1-4895-bb84-156bfe4b62ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:00.637832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d465cc7-bcc1-4895-bb84-156bfe4b62ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:00.638116 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d465cc7-bcc1-4895-bb84-156bfe4b62ff admin admin] PATH_INFO: `/v3/users/d9977d0a558c453aadecd24b6440badc` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:00.639580 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d465cc7-bcc1-4895-bb84-156bfe4b62ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9977d0a558c453aadecd24b6440badc)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:00.641955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d465cc7-bcc1-4895-bb84-156bfe4b62ff admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:00.712887 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2d465cc7-bcc1-4895-bb84-156bfe4b62ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9977d0a558c453aadecd24b6440badc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:00.728955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2d465cc7-bcc1-4895-bb84-156bfe4b62ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9977d0a558c453aadecd24b6440badc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:00.729823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2d465cc7-bcc1-4895-bb84-156bfe4b62ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9977d0a558c453aadecd24b6440badc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:00.745910 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2d465cc7-bcc1-4895-bb84-156bfe4b62ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9977d0a558c453aadecd24b6440badc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:00.760764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2d465cc7-bcc1-4895-bb84-156bfe4b62ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9977d0a558c453aadecd24b6440badc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:00.768078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1137/2265] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:10:00 2022] DELETE /identity/v3/users/d9977d0a558c453aadecd24b6440badc => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:00.772607 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ca7cc-d6e8-4781-a0bc-ccfcfe2bddaf None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:00.773108 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ca7cc-d6e8-4781-a0bc-ccfcfe2bddaf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:00.773206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ca7cc-d6e8-4781-a0bc-ccfcfe2bddaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:00.794685 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-974ca7cc-d6e8-4781-a0bc-ccfcfe2bddaf None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:00.796205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-974ca7cc-d6e8-4781-a0bc-ccfcfe2bddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:00.870996 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1129/2266] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:10:00.880916 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d465cc7-bcc1-4895-bb84-156bfe4b62ff admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:00.882370 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2d465cc7-bcc1-4895-bb84-156bfe4b62ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:00.922685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:00.941609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d465cc7-bcc1-4895-bb84-156bfe4b62ff admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:00.946241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41626903-463b-49b0-aac2-2bfe61322e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:00.946931 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626903-463b-49b0-aac2-2bfe61322e1b service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:00.947231 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626903-463b-49b0-aac2-2bfe61322e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:00.947504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626903-463b-49b0-aac2-2bfe61322e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:00.958214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41626903-463b-49b0-aac2-2bfe61322e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:00.959611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41626903-463b-49b0-aac2-2bfe61322e1b service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:00.970284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1138/2267] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:01.261958 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ca7cc-d6e8-4781-a0bc-ccfcfe2bddaf None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:01.263704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-974ca7cc-d6e8-4781-a0bc-ccfcfe2bddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:01.293015 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ca7cc-d6e8-4781-a0bc-ccfcfe2bddaf None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:01.299027 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:01.300088 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:01.300982 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:01.301386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7 admin admin] PATH_INFO: `/v3/projects/c16c596e124c4a2489760832721e8c3b` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:01.302979 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c16c596e124c4a2489760832721e8c3b)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:01.305194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:01.371139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c16c596e124c4a2489760832721e8c3b', 'request_id': 'req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:01.385903 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c16c596e124c4a2489760832721e8c3b', 'request_id': 'req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:01.392913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c16c596e124c4a2489760832721e8c3b', 'request_id': 'req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:01.394487 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:01.408217 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7 admin admin] The token cache is being invalidate because project c16c596e124c4a2489760832721e8c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:10:01.409197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:01.418138 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:01.420272 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1130/2268] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:10:01 2022] DELETE /identity/v3/projects/c16c596e124c4a2489760832721e8c3b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:01.424204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41626903-463b-49b0-aac2-2bfe61322e1b service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:01.440102 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41626903-463b-49b0-aac2-2bfe61322e1b service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:01.507300 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6f471-6dff-491a-9951-7fd3b3a07a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:01.508541 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6f471-6dff-491a-9951-7fd3b3a07a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:01.508880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6f471-6dff-491a-9951-7fd3b3a07a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:01.509157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6f471-6dff-491a-9951-7fd3b3a07a59 admin admin] PATH_INFO: `/v3/users/0ce065f618db4ed197138cd41d596b5f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:01.510662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6f471-6dff-491a-9951-7fd3b3a07a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ce065f618db4ed197138cd41d596b5f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:01.513709 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6f471-6dff-491a-9951-7fd3b3a07a59 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:01.577197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-13b6f471-6dff-491a-9951-7fd3b3a07a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ce065f618db4ed197138cd41d596b5f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:01.593779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-13b6f471-6dff-491a-9951-7fd3b3a07a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ce065f618db4ed197138cd41d596b5f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:01.594562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-13b6f471-6dff-491a-9951-7fd3b3a07a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ce065f618db4ed197138cd41d596b5f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:01.604487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-13b6f471-6dff-491a-9951-7fd3b3a07a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ce065f618db4ed197138cd41d596b5f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:01.613374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-13b6f471-6dff-491a-9951-7fd3b3a07a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ce065f618db4ed197138cd41d596b5f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:01.620723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1139/2269] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:10:01 2022] DELETE /identity/v3/users/0ce065f618db4ed197138cd41d596b5f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:01.922626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:01.924126 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:01.939210 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb262dd8-ac12-483c-ad32-fdaab39f8ef7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:02.020161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74b6c0-e86a-4b0a-b790-681073adf466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:02.021000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74b6c0-e86a-4b0a-b790-681073adf466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:02.021288 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74b6c0-e86a-4b0a-b790-681073adf466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:02.021563 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74b6c0-e86a-4b0a-b790-681073adf466 admin admin] PATH_INFO: `/v3/projects/164ccfae7dae469f816491b01d04df6c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:02.025403 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74b6c0-e86a-4b0a-b790-681073adf466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=164ccfae7dae469f816491b01d04df6c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:02.027668 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74b6c0-e86a-4b0a-b790-681073adf466 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:02.087950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5f74b6c0-e86a-4b0a-b790-681073adf466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '164ccfae7dae469f816491b01d04df6c', 'request_id': 'req-5f74b6c0-e86a-4b0a-b790-681073adf466'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:02.097703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5f74b6c0-e86a-4b0a-b790-681073adf466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '164ccfae7dae469f816491b01d04df6c', 'request_id': 'req-5f74b6c0-e86a-4b0a-b790-681073adf466'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:02.105943 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5f74b6c0-e86a-4b0a-b790-681073adf466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '164ccfae7dae469f816491b01d04df6c', 'request_id': 'req-5f74b6c0-e86a-4b0a-b790-681073adf466'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:02.123882 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5f74b6c0-e86a-4b0a-b790-681073adf466 admin admin] The token cache is being invalidate because project 164ccfae7dae469f816491b01d04df6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:10:02.124224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5f74b6c0-e86a-4b0a-b790-681073adf466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:02.125015 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5f74b6c0-e86a-4b0a-b790-681073adf466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:02.127028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1131/2270] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:10:01 2022] DELETE /identity/v3/projects/164ccfae7dae469f816491b01d04df6c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:02.134217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0de50b-51dc-4643-a7a3-b77ec334fb9b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:02.134217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0de50b-51dc-4643-a7a3-b77ec334fb9b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:02.134886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0de50b-51dc-4643-a7a3-b77ec334fb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:02.155618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-9a0de50b-51dc-4643-a7a3-b77ec334fb9b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:02.157081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9a0de50b-51dc-4643-a7a3-b77ec334fb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:02.214540 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:02.229985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1140/2271] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:02.235551 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a5ece-c06d-4fa5-a77a-ff17f5de6428 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:02.235841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a5ece-c06d-4fa5-a77a-ff17f5de6428 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:02.236255 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a5ece-c06d-4fa5-a77a-ff17f5de6428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:02.255308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6f4a5ece-c06d-4fa5-a77a-ff17f5de6428 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:02.256510 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6f4a5ece-c06d-4fa5-a77a-ff17f5de6428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:02.265097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1132/2272] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:02.269635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0de50b-51dc-4643-a7a3-b77ec334fb9b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:02.281043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0de50b-51dc-4643-a7a3-b77ec334fb9b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:02.286603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112135a-af0c-483b-8ea1-e888d6bd0943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:02.287377 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112135a-af0c-483b-8ea1-e888d6bd0943 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:02.287774 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112135a-af0c-483b-8ea1-e888d6bd0943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:02.288405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112135a-af0c-483b-8ea1-e888d6bd0943 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:02.288769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112135a-af0c-483b-8ea1-e888d6bd0943 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:10:02.289124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112135a-af0c-483b-8ea1-e888d6bd0943 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:02.290793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112135a-af0c-483b-8ea1-e888d6bd0943 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:02.303463 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1141/2273] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:10:02.308557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a5ece-c06d-4fa5-a77a-ff17f5de6428 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:02.319523 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a5ece-c06d-4fa5-a77a-ff17f5de6428 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:02.324751 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371513c-0a76-4491-9b93-dbe7930e270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:02.325424 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371513c-0a76-4491-9b93-dbe7930e270d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:02.325703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371513c-0a76-4491-9b93-dbe7930e270d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:02.326005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371513c-0a76-4491-9b93-dbe7930e270d admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:02.326716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371513c-0a76-4491-9b93-dbe7930e270d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:02.328840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371513c-0a76-4491-9b93-dbe7930e270d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:02.369017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1133/2274] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:10:02 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:10:02.370927 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112135a-af0c-483b-8ea1-e888d6bd0943 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:02.403631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112135a-af0c-483b-8ea1-e888d6bd0943 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:02.468177 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf4a82-021c-4017-bb92-66b5bd33b492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:02.468901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf4a82-021c-4017-bb92-66b5bd33b492 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:02.469185 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf4a82-021c-4017-bb92-66b5bd33b492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:02.469460 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf4a82-021c-4017-bb92-66b5bd33b492 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:02.470260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf4a82-021c-4017-bb92-66b5bd33b492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:02.472204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf4a82-021c-4017-bb92-66b5bd33b492 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:02.496923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1142/2275] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:10:02 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:10:02.501595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371513c-0a76-4491-9b93-dbe7930e270d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:02.512558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371513c-0a76-4491-9b93-dbe7930e270d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:02.518166 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d3dbb-3d16-4f5a-aebe-b8860c371112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:02.518854 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d3dbb-3d16-4f5a-aebe-b8860c371112 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:02.519139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d3dbb-3d16-4f5a-aebe-b8860c371112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:02.519414 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d3dbb-3d16-4f5a-aebe-b8860c371112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:02.520149 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d3dbb-3d16-4f5a-aebe-b8860c371112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:02.521786 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d3dbb-3d16-4f5a-aebe-b8860c371112 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:02.536627 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1134/2276] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:10:02.541060 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf4a82-021c-4017-bb92-66b5bd33b492 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:02.551941 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf4a82-021c-4017-bb92-66b5bd33b492 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:02.557506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552dffc-a67a-4e42-9c51-7c68441b0080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:02.558408 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552dffc-a67a-4e42-9c51-7c68441b0080 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:02.558908 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552dffc-a67a-4e42-9c51-7c68441b0080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:02.559242 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552dffc-a67a-4e42-9c51-7c68441b0080 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:02.560064 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552dffc-a67a-4e42-9c51-7c68441b0080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:02.561850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552dffc-a67a-4e42-9c51-7c68441b0080 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:02.573295 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1143/2277] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:10:02.577623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d3dbb-3d16-4f5a-aebe-b8860c371112 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:02.589720 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d3dbb-3d16-4f5a-aebe-b8860c371112 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:02.595591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fb97f-b81b-4d66-8ceb-1241ca9c3785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:02.596709 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb97f-b81b-4d66-8ceb-1241ca9c3785 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:02.597039 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb97f-b81b-4d66-8ceb-1241ca9c3785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:02.597464 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb97f-b81b-4d66-8ceb-1241ca9c3785 admin admin] PATH_INFO: `/v3/projects/b43a30dfc39f4d078a213209c0ee7acd/users/23c3a6eadaa94be6a6b04428d1055a9b/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:02.616392 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fb97f-b81b-4d66-8ceb-1241ca9c3785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43a30dfc39f4d078a213209c0ee7acd, user_id=23c3a6eadaa94be6a6b04428d1055a9b, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:02.619515 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fb97f-b81b-4d66-8ceb-1241ca9c3785 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:02.643745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1135/2278] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:10:02 2022] PUT /identity/v3/projects/b43a30dfc39f4d078a213209c0ee7acd/users/23c3a6eadaa94be6a6b04428d1055a9b/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:02.659583 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5381011-e217-4eaa-b9e6-c0119942bca3 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:02.660077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5381011-e217-4eaa-b9e6-c0119942bca3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:02.660077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5381011-e217-4eaa-b9e6-c0119942bca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:02.692362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b5381011-e217-4eaa-b9e6-c0119942bca3 None None] MFA Rules not processed for user `23c3a6eadaa94be6a6b04428d1055a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:02.693722 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b5381011-e217-4eaa-b9e6-c0119942bca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:02.771945 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1144/2279] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:10:02.784129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fb97f-b81b-4d66-8ceb-1241ca9c3785 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:02.785715 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ed2fb97f-b81b-4d66-8ceb-1241ca9c3785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:02.806285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:02.862189 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fb97f-b81b-4d66-8ceb-1241ca9c3785 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:02.866058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29285a46-335a-4ad7-9633-4ed6924ac492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:02.866725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29285a46-335a-4ad7-9633-4ed6924ac492 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:02.867066 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29285a46-335a-4ad7-9633-4ed6924ac492 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:02.867349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29285a46-335a-4ad7-9633-4ed6924ac492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:02.876704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29285a46-335a-4ad7-9633-4ed6924ac492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:02.878597 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29285a46-335a-4ad7-9633-4ed6924ac492 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:02.889266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1136/2280] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:03.299775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5381011-e217-4eaa-b9e6-c0119942bca3 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:03.301460 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b5381011-e217-4eaa-b9e6-c0119942bca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:03.357950 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:03.372026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5381011-e217-4eaa-b9e6-c0119942bca3 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:03.376691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b27923-0367-4c19-8ab9-79eba82de555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:03.377589 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b27923-0367-4c19-8ab9-79eba82de555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:03.377902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b27923-0367-4c19-8ab9-79eba82de555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:03.378187 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b27923-0367-4c19-8ab9-79eba82de555 admin admin] PATH_INFO: `/v3/users/5811a8cd91c3467485516a3e7e61fe61` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:03.379435 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b27923-0367-4c19-8ab9-79eba82de555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5811a8cd91c3467485516a3e7e61fe61)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:03.381399 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b27923-0367-4c19-8ab9-79eba82de555 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:03.433538 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-17b27923-0367-4c19-8ab9-79eba82de555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5811a8cd91c3467485516a3e7e61fe61'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:03.445590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-17b27923-0367-4c19-8ab9-79eba82de555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5811a8cd91c3467485516a3e7e61fe61'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:03.446379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-17b27923-0367-4c19-8ab9-79eba82de555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5811a8cd91c3467485516a3e7e61fe61'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:03.455487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-17b27923-0367-4c19-8ab9-79eba82de555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5811a8cd91c3467485516a3e7e61fe61'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:03.462549 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-17b27923-0367-4c19-8ab9-79eba82de555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5811a8cd91c3467485516a3e7e61fe61'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:03.468447 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1145/2281] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:10:03 2022] DELETE /identity/v3/users/5811a8cd91c3467485516a3e7e61fe61 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:03.473039 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab5996-0690-4fba-a90b-4d4142ba5081 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:03.473531 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab5996-0690-4fba-a90b-4d4142ba5081 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:03.473673 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab5996-0690-4fba-a90b-4d4142ba5081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:03.491591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3dab5996-0690-4fba-a90b-4d4142ba5081 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:03.492912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3dab5996-0690-4fba-a90b-4d4142ba5081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:03.558072 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1137/2282] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:03.568043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b27923-0367-4c19-8ab9-79eba82de555 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:03.569906 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-17b27923-0367-4c19-8ab9-79eba82de555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:03.632519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b27923-0367-4c19-8ab9-79eba82de555 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:03.637129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d82f3a-06e5-4ed0-a2ff-5d56ddbaf3e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:03.637789 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d82f3a-06e5-4ed0-a2ff-5d56ddbaf3e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:03.638331 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d82f3a-06e5-4ed0-a2ff-5d56ddbaf3e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:03.638331 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d82f3a-06e5-4ed0-a2ff-5d56ddbaf3e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:03.649257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d82f3a-06e5-4ed0-a2ff-5d56ddbaf3e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:03.650799 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d82f3a-06e5-4ed0-a2ff-5d56ddbaf3e3 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:03.660620 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1146/2283] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:04.033755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab5996-0690-4fba-a90b-4d4142ba5081 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:04.035360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3dab5996-0690-4fba-a90b-4d4142ba5081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:04.053716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab5996-0690-4fba-a90b-4d4142ba5081 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:04.060787 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168aa191-f0d8-4774-b433-f77a67d9f30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:04.061592 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168aa191-f0d8-4774-b433-f77a67d9f30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:04.061844 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168aa191-f0d8-4774-b433-f77a67d9f30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:04.062114 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168aa191-f0d8-4774-b433-f77a67d9f30c admin admin] PATH_INFO: `/v3/projects/7f51d5b23cac46d99d08ec5b57916c42` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:04.064888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168aa191-f0d8-4774-b433-f77a67d9f30c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f51d5b23cac46d99d08ec5b57916c42)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:04.066841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168aa191-f0d8-4774-b433-f77a67d9f30c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:04.121271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-168aa191-f0d8-4774-b433-f77a67d9f30c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f51d5b23cac46d99d08ec5b57916c42', 'request_id': 'req-168aa191-f0d8-4774-b433-f77a67d9f30c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:04.130186 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-168aa191-f0d8-4774-b433-f77a67d9f30c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f51d5b23cac46d99d08ec5b57916c42', 'request_id': 'req-168aa191-f0d8-4774-b433-f77a67d9f30c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:04.137357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-168aa191-f0d8-4774-b433-f77a67d9f30c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f51d5b23cac46d99d08ec5b57916c42', 'request_id': 'req-168aa191-f0d8-4774-b433-f77a67d9f30c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:04.152976 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-168aa191-f0d8-4774-b433-f77a67d9f30c admin admin] The token cache is being invalidate because project 7f51d5b23cac46d99d08ec5b57916c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:10:04.153409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-168aa191-f0d8-4774-b433-f77a67d9f30c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:04.154286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-168aa191-f0d8-4774-b433-f77a67d9f30c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:04.159290 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1138/2284] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:10:04 2022] DELETE /identity/v3/projects/7f51d5b23cac46d99d08ec5b57916c42 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:04.160895 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d82f3a-06e5-4ed0-a2ff-5d56ddbaf3e3 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:04.171686 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d82f3a-06e5-4ed0-a2ff-5d56ddbaf3e3 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:04.265550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7f66c-30fe-417b-8f05-ee0c7e609c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:04.266505 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7f66c-30fe-417b-8f05-ee0c7e609c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:04.266789 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7f66c-30fe-417b-8f05-ee0c7e609c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:04.267064 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7f66c-30fe-417b-8f05-ee0c7e609c04 admin admin] PATH_INFO: `/v3/users/8c320ac62e7345a995ff63f65ca7a164` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:04.268820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7f66c-30fe-417b-8f05-ee0c7e609c04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c320ac62e7345a995ff63f65ca7a164)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:04.271119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7f66c-30fe-417b-8f05-ee0c7e609c04 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:04.300213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:04.366948 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-95f7f66c-30fe-417b-8f05-ee0c7e609c04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c320ac62e7345a995ff63f65ca7a164'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:04.400438 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-95f7f66c-30fe-417b-8f05-ee0c7e609c04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c320ac62e7345a995ff63f65ca7a164'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:04.400915 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-95f7f66c-30fe-417b-8f05-ee0c7e609c04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c320ac62e7345a995ff63f65ca7a164'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:04.428152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-95f7f66c-30fe-417b-8f05-ee0c7e609c04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c320ac62e7345a995ff63f65ca7a164'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:04.457722 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-95f7f66c-30fe-417b-8f05-ee0c7e609c04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c320ac62e7345a995ff63f65ca7a164'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:04.468654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1147/2285] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:10:04 2022] DELETE /identity/v3/users/8c320ac62e7345a995ff63f65ca7a164 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:04.810218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168aa191-f0d8-4774-b433-f77a67d9f30c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:04.812272 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-168aa191-f0d8-4774-b433-f77a67d9f30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:04.826824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168aa191-f0d8-4774-b433-f77a67d9f30c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:04.889768 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:04.910947 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73638388-6e48-49e3-9753-f478c93322fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:04.912184 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73638388-6e48-49e3-9753-f478c93322fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:04.912530 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73638388-6e48-49e3-9753-f478c93322fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:04.912900 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73638388-6e48-49e3-9753-f478c93322fe admin admin] PATH_INFO: `/v3/projects/d23813ceb1f74131abfe72385e3b0764` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:04.929248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73638388-6e48-49e3-9753-f478c93322fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d23813ceb1f74131abfe72385e3b0764)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:04.931480 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73638388-6e48-49e3-9753-f478c93322fe admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:05.017151 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-73638388-6e48-49e3-9753-f478c93322fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd23813ceb1f74131abfe72385e3b0764', 'request_id': 'req-73638388-6e48-49e3-9753-f478c93322fe'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:05.028696 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-73638388-6e48-49e3-9753-f478c93322fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd23813ceb1f74131abfe72385e3b0764', 'request_id': 'req-73638388-6e48-49e3-9753-f478c93322fe'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:05.035569 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-73638388-6e48-49e3-9753-f478c93322fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd23813ceb1f74131abfe72385e3b0764', 'request_id': 'req-73638388-6e48-49e3-9753-f478c93322fe'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:05.047470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-73638388-6e48-49e3-9753-f478c93322fe admin admin] The token cache is being invalidate because project d23813ceb1f74131abfe72385e3b0764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:10:05.047743 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-73638388-6e48-49e3-9753-f478c93322fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:05.048397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-73638388-6e48-49e3-9753-f478c93322fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:05.050078 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1139/2286] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:10:04 2022] DELETE /identity/v3/projects/d23813ceb1f74131abfe72385e3b0764 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:05.054600 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7f66c-30fe-417b-8f05-ee0c7e609c04 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:05.055906 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-95f7f66c-30fe-417b-8f05-ee0c7e609c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:05.070624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7f66c-30fe-417b-8f05-ee0c7e609c04 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:05.136894 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ace5b1-8858-4832-a3aa-9d9b156b5d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:05.137844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ace5b1-8858-4832-a3aa-9d9b156b5d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:05.138136 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ace5b1-8858-4832-a3aa-9d9b156b5d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:05.138415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ace5b1-8858-4832-a3aa-9d9b156b5d4e admin admin] PATH_INFO: `/v3/users/a86e6b21a4fa4b24a4ae9152eb457e6a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:05.139668 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ace5b1-8858-4832-a3aa-9d9b156b5d4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86e6b21a4fa4b24a4ae9152eb457e6a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:05.141694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ace5b1-8858-4832-a3aa-9d9b156b5d4e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:05.206836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a8ace5b1-8858-4832-a3aa-9d9b156b5d4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86e6b21a4fa4b24a4ae9152eb457e6a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:05.220596 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a8ace5b1-8858-4832-a3aa-9d9b156b5d4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86e6b21a4fa4b24a4ae9152eb457e6a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:05.221312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a8ace5b1-8858-4832-a3aa-9d9b156b5d4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86e6b21a4fa4b24a4ae9152eb457e6a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:05.233001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a8ace5b1-8858-4832-a3aa-9d9b156b5d4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86e6b21a4fa4b24a4ae9152eb457e6a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:05.240647 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a8ace5b1-8858-4832-a3aa-9d9b156b5d4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86e6b21a4fa4b24a4ae9152eb457e6a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:05.247680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1148/2287] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:10:05 2022] DELETE /identity/v3/users/a86e6b21a4fa4b24a4ae9152eb457e6a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:05.556965 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73638388-6e48-49e3-9753-f478c93322fe admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:05.558641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-73638388-6e48-49e3-9753-f478c93322fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:05.581022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73638388-6e48-49e3-9753-f478c93322fe admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:05.672475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46105433-9d74-4b98-a452-6a25cf53d96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:05.673996 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46105433-9d74-4b98-a452-6a25cf53d96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:05.674454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46105433-9d74-4b98-a452-6a25cf53d96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:05.674805 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46105433-9d74-4b98-a452-6a25cf53d96e admin admin] PATH_INFO: `/v3/projects/aaf933741eda41b4b91fbebc819f8b6b` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:05.676329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46105433-9d74-4b98-a452-6a25cf53d96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaf933741eda41b4b91fbebc819f8b6b)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:05.678278 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46105433-9d74-4b98-a452-6a25cf53d96e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:05.733431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-46105433-9d74-4b98-a452-6a25cf53d96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaf933741eda41b4b91fbebc819f8b6b', 'request_id': 'req-46105433-9d74-4b98-a452-6a25cf53d96e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:05.746170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-46105433-9d74-4b98-a452-6a25cf53d96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaf933741eda41b4b91fbebc819f8b6b', 'request_id': 'req-46105433-9d74-4b98-a452-6a25cf53d96e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:05.753316 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-46105433-9d74-4b98-a452-6a25cf53d96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaf933741eda41b4b91fbebc819f8b6b', 'request_id': 'req-46105433-9d74-4b98-a452-6a25cf53d96e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:05.777275 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-46105433-9d74-4b98-a452-6a25cf53d96e admin admin] The token cache is being invalidate because project aaf933741eda41b4b91fbebc819f8b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:10:05.777829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-46105433-9d74-4b98-a452-6a25cf53d96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:05.778933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-46105433-9d74-4b98-a452-6a25cf53d96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:05.781202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1140/2288] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:10:05 2022] DELETE /identity/v3/projects/aaf933741eda41b4b91fbebc819f8b6b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:05.787299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32e4e8-5521-4c2e-ba4c-2538cd252189 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:05.787675 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32e4e8-5521-4c2e-ba4c-2538cd252189 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:05.788031 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32e4e8-5521-4c2e-ba4c-2538cd252189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:05.809000 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2d32e4e8-5521-4c2e-ba4c-2538cd252189 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:05.810261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2d32e4e8-5521-4c2e-ba4c-2538cd252189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:05.820015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:05.884619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1149/2289] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:05.892914 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17266be5-8716-4cc8-a23c-7f26f154fa44 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:05.893465 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17266be5-8716-4cc8-a23c-7f26f154fa44 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:05.893465 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17266be5-8716-4cc8-a23c-7f26f154fa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:05.900932 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:05.917505 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-17266be5-8716-4cc8-a23c-7f26f154fa44 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:05.918779 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-17266be5-8716-4cc8-a23c-7f26f154fa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:05.933199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1141/2290] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:05.937378 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32e4e8-5521-4c2e-ba4c-2538cd252189 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:05.947730 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32e4e8-5521-4c2e-ba4c-2538cd252189 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:05.953090 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be3697-c8c6-4a01-a83b-5dbd15044060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:05.953778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be3697-c8c6-4a01-a83b-5dbd15044060 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:05.954450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be3697-c8c6-4a01-a83b-5dbd15044060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:05.954717 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be3697-c8c6-4a01-a83b-5dbd15044060 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:05.955753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be3697-c8c6-4a01-a83b-5dbd15044060 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:10:05.956129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be3697-c8c6-4a01-a83b-5dbd15044060 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:05.957762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be3697-c8c6-4a01-a83b-5dbd15044060 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:05.974734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1150/2291] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:10:05.976404 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17266be5-8716-4cc8-a23c-7f26f154fa44 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:05.988566 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17266be5-8716-4cc8-a23c-7f26f154fa44 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:05.993365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe529959-df06-4a55-b149-353de5a74267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:05.994094 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe529959-df06-4a55-b149-353de5a74267 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:05.994380 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe529959-df06-4a55-b149-353de5a74267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:05.994693 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe529959-df06-4a55-b149-353de5a74267 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:05.995412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe529959-df06-4a55-b149-353de5a74267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:05.997381 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe529959-df06-4a55-b149-353de5a74267 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:06.031385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1142/2292] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:10:05 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:10:06.035996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be3697-c8c6-4a01-a83b-5dbd15044060 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:06.051055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be3697-c8c6-4a01-a83b-5dbd15044060 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:06.122454 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f403606-b733-4bd4-b99e-c730e22bd294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:06.123160 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f403606-b733-4bd4-b99e-c730e22bd294 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:06.123419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f403606-b733-4bd4-b99e-c730e22bd294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:06.123691 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f403606-b733-4bd4-b99e-c730e22bd294 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:06.124394 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f403606-b733-4bd4-b99e-c730e22bd294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:06.126609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f403606-b733-4bd4-b99e-c730e22bd294 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:06.155414 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1151/2293] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:10:06 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:10:06.160551 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe529959-df06-4a55-b149-353de5a74267 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:06.175057 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe529959-df06-4a55-b149-353de5a74267 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:06.180445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14bb38-bd18-4b55-9d1b-51ad4bbca2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:06.181141 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14bb38-bd18-4b55-9d1b-51ad4bbca2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:06.181430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14bb38-bd18-4b55-9d1b-51ad4bbca2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:06.181707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14bb38-bd18-4b55-9d1b-51ad4bbca2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:06.182649 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14bb38-bd18-4b55-9d1b-51ad4bbca2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:06.184289 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14bb38-bd18-4b55-9d1b-51ad4bbca2e3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:06.197514 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1143/2294] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:10:06.202544 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f403606-b733-4bd4-b99e-c730e22bd294 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:06.223205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f403606-b733-4bd4-b99e-c730e22bd294 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:06.230635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff0d51-1672-4495-94be-98a334b6cafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:06.231450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff0d51-1672-4495-94be-98a334b6cafe admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:06.231831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff0d51-1672-4495-94be-98a334b6cafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:06.232453 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff0d51-1672-4495-94be-98a334b6cafe admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:06.234492 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff0d51-1672-4495-94be-98a334b6cafe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:06.236356 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff0d51-1672-4495-94be-98a334b6cafe admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:06.249746 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1152/2295] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:10:06.253634 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14bb38-bd18-4b55-9d1b-51ad4bbca2e3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:06.267972 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14bb38-bd18-4b55-9d1b-51ad4bbca2e3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:06.274940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff26217-87c6-4465-b8ac-fc73a94cd13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:06.276400 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff26217-87c6-4465-b8ac-fc73a94cd13a admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:06.277037 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff26217-87c6-4465-b8ac-fc73a94cd13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:06.277440 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff26217-87c6-4465-b8ac-fc73a94cd13a admin admin] PATH_INFO: `/v3/projects/3086f8322ceb4fcea79f085d22b08327/users/def8dfcd87084f97b93bb263798a44b9/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:06.303869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff26217-87c6-4465-b8ac-fc73a94cd13a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3086f8322ceb4fcea79f085d22b08327, user_id=def8dfcd87084f97b93bb263798a44b9, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:06.307289 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff26217-87c6-4465-b8ac-fc73a94cd13a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:06.331048 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1144/2296] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:10:06 2022] PUT /identity/v3/projects/3086f8322ceb4fcea79f085d22b08327/users/def8dfcd87084f97b93bb263798a44b9/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:06.343871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22a208-4393-4a12-b997-148876830927 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:06.344187 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22a208-4393-4a12-b997-148876830927 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:06.344432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22a208-4393-4a12-b997-148876830927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:06.382245 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3d22a208-4393-4a12-b997-148876830927 None None] MFA Rules not processed for user `def8dfcd87084f97b93bb263798a44b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:06.384304 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3d22a208-4393-4a12-b997-148876830927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:06.466767 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1153/2297] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:06.471687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff26217-87c6-4465-b8ac-fc73a94cd13a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:06.550100 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff26217-87c6-4465-b8ac-fc73a94cd13a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:06.555330 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26686f6-bbec-46ca-8aec-b3cd20e5f94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:06.556006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26686f6-bbec-46ca-8aec-b3cd20e5f94d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:06.556286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26686f6-bbec-46ca-8aec-b3cd20e5f94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:06.556560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26686f6-bbec-46ca-8aec-b3cd20e5f94d admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:06.557248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26686f6-bbec-46ca-8aec-b3cd20e5f94d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:06.559186 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26686f6-bbec-46ca-8aec-b3cd20e5f94d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:06.596239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1145/2298] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:10:06 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:10:06.597663 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22a208-4393-4a12-b997-148876830927 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:06.609730 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22a208-4393-4a12-b997-148876830927 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:06.615307 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:06.689263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d392b-8ed4-4a09-84ac-eef4c1d214d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:06.690147 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d392b-8ed4-4a09-84ac-eef4c1d214d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:06.690595 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d392b-8ed4-4a09-84ac-eef4c1d214d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:06.690971 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d392b-8ed4-4a09-84ac-eef4c1d214d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:06.691922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d392b-8ed4-4a09-84ac-eef4c1d214d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:06.694127 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d392b-8ed4-4a09-84ac-eef4c1d214d0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:06.721834 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1154/2299] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:10:06 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:10:06.725513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26686f6-bbec-46ca-8aec-b3cd20e5f94d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:06.737275 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26686f6-bbec-46ca-8aec-b3cd20e5f94d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:06.743700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef72c9-c682-49be-a9b1-591220223033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:06.744391 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef72c9-c682-49be-a9b1-591220223033 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:06.744707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef72c9-c682-49be-a9b1-591220223033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:06.744951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef72c9-c682-49be-a9b1-591220223033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:06.745692 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef72c9-c682-49be-a9b1-591220223033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:06.747488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef72c9-c682-49be-a9b1-591220223033 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:06.759376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1146/2300] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:10:06.764174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d392b-8ed4-4a09-84ac-eef4c1d214d0 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:06.781862 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d392b-8ed4-4a09-84ac-eef4c1d214d0 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:06.787219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01619baf-caa3-44a0-82dd-34e2e0fbee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:06.787943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01619baf-caa3-44a0-82dd-34e2e0fbee6d admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:06.788283 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01619baf-caa3-44a0-82dd-34e2e0fbee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:06.788498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01619baf-caa3-44a0-82dd-34e2e0fbee6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:06.789264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01619baf-caa3-44a0-82dd-34e2e0fbee6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:06.791051 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01619baf-caa3-44a0-82dd-34e2e0fbee6d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:06.801745 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1155/2301] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:10:06.805970 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef72c9-c682-49be-a9b1-591220223033 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:06.816859 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef72c9-c682-49be-a9b1-591220223033 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:06.822837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a41be7-cbc7-4f7e-8aaa-7e789152f0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:06.823841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a41be7-cbc7-4f7e-8aaa-7e789152f0f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:06.824183 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a41be7-cbc7-4f7e-8aaa-7e789152f0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:06.825116 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a41be7-cbc7-4f7e-8aaa-7e789152f0f2 admin admin] PATH_INFO: `/v3/projects/0585c0905a06431a9fec2fcfbf1ae0b5/users/453fc8272f694c8b93b7e0b93c19bc73/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:06.841479 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a41be7-cbc7-4f7e-8aaa-7e789152f0f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0585c0905a06431a9fec2fcfbf1ae0b5, user_id=453fc8272f694c8b93b7e0b93c19bc73, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:06.844599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a41be7-cbc7-4f7e-8aaa-7e789152f0f2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:06.862112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1147/2302] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:10:06 2022] PUT /identity/v3/projects/0585c0905a06431a9fec2fcfbf1ae0b5/users/453fc8272f694c8b93b7e0b93c19bc73/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:06.874003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1f6a9-296f-482e-846d-e93862a156d0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:06.874326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1f6a9-296f-482e-846d-e93862a156d0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:06.874609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1f6a9-296f-482e-846d-e93862a156d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:06.904274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f6f1f6a9-296f-482e-846d-e93862a156d0 None None] MFA Rules not processed for user `453fc8272f694c8b93b7e0b93c19bc73`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:06.906212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f6f1f6a9-296f-482e-846d-e93862a156d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:06.984618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1156/2303] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:10:06.991215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a41be7-cbc7-4f7e-8aaa-7e789152f0f2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:07.052028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:07.068409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a41be7-cbc7-4f7e-8aaa-7e789152f0f2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:07.074082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e889527-2c21-4fcf-9fc4-59a7711521c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:07.074728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e889527-2c21-4fcf-9fc4-59a7711521c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:07.075011 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e889527-2c21-4fcf-9fc4-59a7711521c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:07.075286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e889527-2c21-4fcf-9fc4-59a7711521c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:07.075983 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e889527-2c21-4fcf-9fc4-59a7711521c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:07.077917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e889527-2c21-4fcf-9fc4-59a7711521c6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:07.107606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1148/2304] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:10:06 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:10:07.111943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1f6a9-296f-482e-846d-e93862a156d0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:07.123285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1f6a9-296f-482e-846d-e93862a156d0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:07.203072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d31783-3ec1-4e3c-8945-3e0ac3bbb5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:07.203773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d31783-3ec1-4e3c-8945-3e0ac3bbb5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:07.204380 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d31783-3ec1-4e3c-8945-3e0ac3bbb5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:07.204680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d31783-3ec1-4e3c-8945-3e0ac3bbb5c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:07.205393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d31783-3ec1-4e3c-8945-3e0ac3bbb5c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:07.207588 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d31783-3ec1-4e3c-8945-3e0ac3bbb5c7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:07.233011 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1157/2305] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:10:07 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:10:07.237053 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e889527-2c21-4fcf-9fc4-59a7711521c6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:07.247951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e889527-2c21-4fcf-9fc4-59a7711521c6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:07.252969 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd24d0-4173-4aac-a3ae-186ebd10e13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:07.253670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd24d0-4173-4aac-a3ae-186ebd10e13a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:07.253985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd24d0-4173-4aac-a3ae-186ebd10e13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:07.254295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd24d0-4173-4aac-a3ae-186ebd10e13a admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:07.255118 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd24d0-4173-4aac-a3ae-186ebd10e13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:07.256741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd24d0-4173-4aac-a3ae-186ebd10e13a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:07.268924 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1149/2306] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:10:07.273117 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d31783-3ec1-4e3c-8945-3e0ac3bbb5c7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:07.283947 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d31783-3ec1-4e3c-8945-3e0ac3bbb5c7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:07.289973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c8ba2-c61b-4c38-97d0-ca3af3773bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:07.290880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c8ba2-c61b-4c38-97d0-ca3af3773bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:07.291163 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c8ba2-c61b-4c38-97d0-ca3af3773bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:07.291443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c8ba2-c61b-4c38-97d0-ca3af3773bfa admin admin] PATH_INFO: `/v3/projects/390ab9b5f6e141958331d6283fffc878/users/a8b95281e48942ba846dec9f5d1b29ad/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:07.294976 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:07.312291 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c8ba2-c61b-4c38-97d0-ca3af3773bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=390ab9b5f6e141958331d6283fffc878, user_id=a8b95281e48942ba846dec9f5d1b29ad, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:07.316554 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c8ba2-c61b-4c38-97d0-ca3af3773bfa admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:07.334756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1158/2307] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:10:07 2022] PUT /identity/v3/projects/390ab9b5f6e141958331d6283fffc878/users/a8b95281e48942ba846dec9f5d1b29ad/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:07.339053 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd24d0-4173-4aac-a3ae-186ebd10e13a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:07.350707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd24d0-4173-4aac-a3ae-186ebd10e13a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:07.426933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065412dc-c81c-4351-bc9e-be245dfaeb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:07.428177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065412dc-c81c-4351-bc9e-be245dfaeb20 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:07.428539 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065412dc-c81c-4351-bc9e-be245dfaeb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:07.429137 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065412dc-c81c-4351-bc9e-be245dfaeb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:07.433169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065412dc-c81c-4351-bc9e-be245dfaeb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:07.433169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065412dc-c81c-4351-bc9e-be245dfaeb20 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:07.445882 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1150/2308] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:10:07.449404 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c8ba2-c61b-4c38-97d0-ca3af3773bfa admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:07.463752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c8ba2-c61b-4c38-97d0-ca3af3773bfa admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:07.471308 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6be128-a68c-496e-b1ca-6b8788034c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:07.472284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6be128-a68c-496e-b1ca-6b8788034c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:07.472578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6be128-a68c-496e-b1ca-6b8788034c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:07.472844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6be128-a68c-496e-b1ca-6b8788034c5a admin admin] PATH_INFO: `/v3/projects/390ab9b5f6e141958331d6283fffc878/users/a8b95281e48942ba846dec9f5d1b29ad/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:07.474874 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6be128-a68c-496e-b1ca-6b8788034c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=390ab9b5f6e141958331d6283fffc878, user_id=a8b95281e48942ba846dec9f5d1b29ad, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:07.477841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6be128-a68c-496e-b1ca-6b8788034c5a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:07.491039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1159/2309] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:10:07 2022] PUT /identity/v3/projects/390ab9b5f6e141958331d6283fffc878/users/a8b95281e48942ba846dec9f5d1b29ad/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:07.503039 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea466fa-02a3-46a0-b3ee-34e74874a781 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:07.503405 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea466fa-02a3-46a0-b3ee-34e74874a781 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:07.503812 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea466fa-02a3-46a0-b3ee-34e74874a781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:07.537200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4ea466fa-02a3-46a0-b3ee-34e74874a781 None None] MFA Rules not processed for user `a8b95281e48942ba846dec9f5d1b29ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:07.539142 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4ea466fa-02a3-46a0-b3ee-34e74874a781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:07.616428 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1151/2310] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:07.628279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6be128-a68c-496e-b1ca-6b8788034c5a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:07.630258 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6f6be128-a68c-496e-b1ca-6b8788034c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:07.699050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6be128-a68c-496e-b1ca-6b8788034c5a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:07.702957 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3895bf-50a5-4070-a0ea-45010b08d30c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:07.703616 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3895bf-50a5-4070-a0ea-45010b08d30c service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:07.703860 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3895bf-50a5-4070-a0ea-45010b08d30c service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:07.704482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3895bf-50a5-4070-a0ea-45010b08d30c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:07.767893 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3895bf-50a5-4070-a0ea-45010b08d30c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:07.769387 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3895bf-50a5-4070-a0ea-45010b08d30c service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:07.782744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1160/2311] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:08.608445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea466fa-02a3-46a0-b3ee-34e74874a781 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:08.609939 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4ea466fa-02a3-46a0-b3ee-34e74874a781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:08.670937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:08.698829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea466fa-02a3-46a0-b3ee-34e74874a781 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:08.703564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263471e-d9ab-4741-be03-b562e18e0f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:08.704841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263471e-d9ab-4741-be03-b562e18e0f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:08.705120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263471e-d9ab-4741-be03-b562e18e0f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:08.705390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263471e-d9ab-4741-be03-b562e18e0f68 admin admin] PATH_INFO: `/v3/users/23c3a6eadaa94be6a6b04428d1055a9b` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:08.706609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263471e-d9ab-4741-be03-b562e18e0f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c3a6eadaa94be6a6b04428d1055a9b)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:08.708545 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263471e-d9ab-4741-be03-b562e18e0f68 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:08.785405 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9263471e-d9ab-4741-be03-b562e18e0f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c3a6eadaa94be6a6b04428d1055a9b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:08.785405 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9263471e-d9ab-4741-be03-b562e18e0f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c3a6eadaa94be6a6b04428d1055a9b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:08.798481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9263471e-d9ab-4741-be03-b562e18e0f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c3a6eadaa94be6a6b04428d1055a9b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:08.813192 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9263471e-d9ab-4741-be03-b562e18e0f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c3a6eadaa94be6a6b04428d1055a9b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:08.820352 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9263471e-d9ab-4741-be03-b562e18e0f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c3a6eadaa94be6a6b04428d1055a9b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:08.826982 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1152/2312] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:10:08 2022] DELETE /identity/v3/users/23c3a6eadaa94be6a6b04428d1055a9b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:08.832962 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6878c5-b6ae-41f3-b2c7-326db25f2814 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:08.833443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6878c5-b6ae-41f3-b2c7-326db25f2814 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:08.833581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6878c5-b6ae-41f3-b2c7-326db25f2814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:08.851404 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ad6878c5-b6ae-41f3-b2c7-326db25f2814 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:08.852733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ad6878c5-b6ae-41f3-b2c7-326db25f2814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:08.922947 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1161/2313] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:08.932635 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263471e-d9ab-4741-be03-b562e18e0f68 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:08.934113 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9263471e-d9ab-4741-be03-b562e18e0f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:08.995965 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263471e-d9ab-4741-be03-b562e18e0f68 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:08.999822 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef425da-1fb9-4fd4-9c53-1175a3b9b52f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:09.000479 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef425da-1fb9-4fd4-9c53-1175a3b9b52f service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:09.000760 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef425da-1fb9-4fd4-9c53-1175a3b9b52f service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:09.001035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef425da-1fb9-4fd4-9c53-1175a3b9b52f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:09.011319 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef425da-1fb9-4fd4-9c53-1175a3b9b52f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:09.012755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef425da-1fb9-4fd4-9c53-1175a3b9b52f service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:09.024313 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1153/2314] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:09.366243 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6878c5-b6ae-41f3-b2c7-326db25f2814 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:09.368130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ad6878c5-b6ae-41f3-b2c7-326db25f2814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:09.384398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef425da-1fb9-4fd4-9c53-1175a3b9b52f service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:09.386017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aef425da-1fb9-4fd4-9c53-1175a3b9b52f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:09.400621 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef425da-1fb9-4fd4-9c53-1175a3b9b52f service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:09.405267 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83831a6-7344-447d-ba39-2ab11f6617e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:09.406244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83831a6-7344-447d-ba39-2ab11f6617e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:09.406618 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83831a6-7344-447d-ba39-2ab11f6617e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:09.406907 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83831a6-7344-447d-ba39-2ab11f6617e3 admin admin] PATH_INFO: `/v3/projects/b43a30dfc39f4d078a213209c0ee7acd` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:09.408096 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83831a6-7344-447d-ba39-2ab11f6617e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b43a30dfc39f4d078a213209c0ee7acd)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:09.410678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83831a6-7344-447d-ba39-2ab11f6617e3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:09.422551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:09.456790 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6878c5-b6ae-41f3-b2c7-326db25f2814 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:09.471285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e83831a6-7344-447d-ba39-2ab11f6617e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b43a30dfc39f4d078a213209c0ee7acd', 'request_id': 'req-e83831a6-7344-447d-ba39-2ab11f6617e3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:09.480310 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e83831a6-7344-447d-ba39-2ab11f6617e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b43a30dfc39f4d078a213209c0ee7acd', 'request_id': 'req-e83831a6-7344-447d-ba39-2ab11f6617e3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:09.487097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e83831a6-7344-447d-ba39-2ab11f6617e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b43a30dfc39f4d078a213209c0ee7acd', 'request_id': 'req-e83831a6-7344-447d-ba39-2ab11f6617e3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:09.488379 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:09.504025 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e83831a6-7344-447d-ba39-2ab11f6617e3 admin admin] The token cache is being invalidate because project b43a30dfc39f4d078a213209c0ee7acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:10:09.504574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e83831a6-7344-447d-ba39-2ab11f6617e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:09.505760 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e83831a6-7344-447d-ba39-2ab11f6617e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:09.509491 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1154/2315] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:10:09 2022] DELETE /identity/v3/projects/b43a30dfc39f4d078a213209c0ee7acd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:09.515495 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c3570-273b-440a-8870-2b15959506da None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:09.515787 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c3570-273b-440a-8870-2b15959506da None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:09.516071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c3570-273b-440a-8870-2b15959506da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:09.519104 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652a89d-e151-4e43-bf67-7245bc5e5b55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:09.519876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652a89d-e151-4e43-bf67-7245bc5e5b55 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:09.520162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652a89d-e151-4e43-bf67-7245bc5e5b55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:09.520437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652a89d-e151-4e43-bf67-7245bc5e5b55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:09.522456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b652a89d-e151-4e43-bf67-7245bc5e5b55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:09.544529 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-282c3570-273b-440a-8870-2b15959506da None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:09.545955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-282c3570-273b-440a-8870-2b15959506da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:09.592661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652a89d-e151-4e43-bf67-7245bc5e5b55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:09.594167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652a89d-e151-4e43-bf67-7245bc5e5b55 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:09.603755 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1162/2316] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:09.614022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1155/2317] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:10:09.624007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100446-85d1-4299-8654-87af0ab479fd None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:09.624353 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100446-85d1-4299-8654-87af0ab479fd None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:09.624715 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100446-85d1-4299-8654-87af0ab479fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:09.650002 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d2100446-85d1-4299-8654-87af0ab479fd None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:09.651396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d2100446-85d1-4299-8654-87af0ab479fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:09.660601 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1163/2318] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:09.667254 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c3570-273b-440a-8870-2b15959506da None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:09.679323 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c3570-273b-440a-8870-2b15959506da None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:09.684191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f494e76-6372-46c8-9075-be35507bd29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:09.684865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f494e76-6372-46c8-9075-be35507bd29f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:09.685144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f494e76-6372-46c8-9075-be35507bd29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:09.685415 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f494e76-6372-46c8-9075-be35507bd29f admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:09.686206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f494e76-6372-46c8-9075-be35507bd29f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:10:09.686511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f494e76-6372-46c8-9075-be35507bd29f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:09.688145 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f494e76-6372-46c8-9075-be35507bd29f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:09.700969 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1156/2319] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:10:09.705578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2100446-85d1-4299-8654-87af0ab479fd None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:09.716117 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2100446-85d1-4299-8654-87af0ab479fd None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:09.721856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f195276-f798-40ea-abee-1b8f5f925c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:09.722684 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f195276-f798-40ea-abee-1b8f5f925c3f admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:09.722830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f195276-f798-40ea-abee-1b8f5f925c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:09.723189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f195276-f798-40ea-abee-1b8f5f925c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:09.723882 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f195276-f798-40ea-abee-1b8f5f925c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:09.725866 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f195276-f798-40ea-abee-1b8f5f925c3f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:09.757837 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1164/2320] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:10:09 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:10:09.763288 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f494e76-6372-46c8-9075-be35507bd29f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:09.777061 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f494e76-6372-46c8-9075-be35507bd29f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:09.843008 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e6092-8ce4-4a5d-862d-7b5350a894cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:09.843842 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e6092-8ce4-4a5d-862d-7b5350a894cf admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:09.844161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e6092-8ce4-4a5d-862d-7b5350a894cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:09.844442 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e6092-8ce4-4a5d-862d-7b5350a894cf admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:09.845157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e6092-8ce4-4a5d-862d-7b5350a894cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:09.847118 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e6092-8ce4-4a5d-862d-7b5350a894cf admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:09.871847 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1157/2321] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:10:09 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:10:09.878374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f195276-f798-40ea-abee-1b8f5f925c3f admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:09.889894 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f195276-f798-40ea-abee-1b8f5f925c3f admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:09.894599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b8171-9301-4541-83e7-c37b134163b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:09.895283 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b8171-9301-4541-83e7-c37b134163b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:09.895569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b8171-9301-4541-83e7-c37b134163b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:09.895851 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b8171-9301-4541-83e7-c37b134163b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:09.896595 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b8171-9301-4541-83e7-c37b134163b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:09.898280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b8171-9301-4541-83e7-c37b134163b9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:09.912158 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1165/2322] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:10:09.913447 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e6092-8ce4-4a5d-862d-7b5350a894cf admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:09.923856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e6092-8ce4-4a5d-862d-7b5350a894cf admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:09.928660 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e7dff-e85c-4a8d-8ffb-4b5eef5f6203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:09.929351 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7dff-e85c-4a8d-8ffb-4b5eef5f6203 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:09.929606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7dff-e85c-4a8d-8ffb-4b5eef5f6203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:09.930082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7dff-e85c-4a8d-8ffb-4b5eef5f6203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:09.930783 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e7dff-e85c-4a8d-8ffb-4b5eef5f6203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:09.932413 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e7dff-e85c-4a8d-8ffb-4b5eef5f6203 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:09.942880 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1158/2323] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:10:09.947062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b8171-9301-4541-83e7-c37b134163b9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:09.957666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b8171-9301-4541-83e7-c37b134163b9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:09.962869 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4228b06-6740-4dc6-a0d4-9bdbbbd1af5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:09.963782 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4228b06-6740-4dc6-a0d4-9bdbbbd1af5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:09.964068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4228b06-6740-4dc6-a0d4-9bdbbbd1af5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:09.964346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4228b06-6740-4dc6-a0d4-9bdbbbd1af5f admin admin] PATH_INFO: `/v3/projects/41749fb199e348cb8579099d9be841ac/users/796103c08e1747e88d5ed270d2e8c70f/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:09.979853 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4228b06-6740-4dc6-a0d4-9bdbbbd1af5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=41749fb199e348cb8579099d9be841ac, user_id=796103c08e1747e88d5ed270d2e8c70f, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:09.982590 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4228b06-6740-4dc6-a0d4-9bdbbbd1af5f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:09.997104 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1166/2324] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:10:09 2022] PUT /identity/v3/projects/41749fb199e348cb8579099d9be841ac/users/796103c08e1747e88d5ed270d2e8c70f/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:10:10.002488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68fcfb-9040-4669-83cb-c6f218b3f6a8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:10.002942 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68fcfb-9040-4669-83cb-c6f218b3f6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:10.003255 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68fcfb-9040-4669-83cb-c6f218b3f6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:10.022760 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1c68fcfb-9040-4669-83cb-c6f218b3f6a8 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:10.024155 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1c68fcfb-9040-4669-83cb-c6f218b3f6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:10.085409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:10.104247 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1159/2325] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:10.116093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4228b06-6740-4dc6-a0d4-9bdbbbd1af5f admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:10.118119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d4228b06-6740-4dc6-a0d4-9bdbbbd1af5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:10.166177 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:10.207994 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4228b06-6740-4dc6-a0d4-9bdbbbd1af5f admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:10.212521 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6be8b-edbf-4baf-9a4a-13270cb2ab8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:10.213360 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6be8b-edbf-4baf-9a4a-13270cb2ab8f service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:10.213746 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6be8b-edbf-4baf-9a4a-13270cb2ab8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:10.214153 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6be8b-edbf-4baf-9a4a-13270cb2ab8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:10.224519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6be8b-edbf-4baf-9a4a-13270cb2ab8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:10.226384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6be8b-edbf-4baf-9a4a-13270cb2ab8f service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:10.248632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1167/2326] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:10.273063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68fcfb-9040-4669-83cb-c6f218b3f6a8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:10.274619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1c68fcfb-9040-4669-83cb-c6f218b3f6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:10.343523 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68fcfb-9040-4669-83cb-c6f218b3f6a8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:10.347844 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0f4c7-d8b3-4666-a6b5-4c7755529d65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:10.348663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0f4c7-d8b3-4666-a6b5-4c7755529d65 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:10.348996 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0f4c7-d8b3-4666-a6b5-4c7755529d65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:10.349249 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0f4c7-d8b3-4666-a6b5-4c7755529d65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:10.352357 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-42c0f4c7-d8b3-4666-a6b5-4c7755529d65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:10.436267 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0f4c7-d8b3-4666-a6b5-4c7755529d65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:10.437994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0f4c7-d8b3-4666-a6b5-4c7755529d65 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:10.453180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1160/2327] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:10:14.003512 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d6869-8a7e-439e-8158-53d1ae7bb4b0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:14.003979 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d6869-8a7e-439e-8158-53d1ae7bb4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:14.004298 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d6869-8a7e-439e-8158-53d1ae7bb4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:14.036104 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3e5d6869-8a7e-439e-8158-53d1ae7bb4b0 None None] MFA Rules not processed for user `3953b14656774edb92da1ecdb4bbbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:14.037595 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3e5d6869-8a7e-439e-8158-53d1ae7bb4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:14.161407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1168/2328] 10.222.0.61 () {58 vars in 1009 bytes} [Thu May 26 21:10:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:14.235364 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0f4c7-d8b3-4666-a6b5-4c7755529d65 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:14.238158 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-42c0f4c7-d8b3-4666-a6b5-4c7755529d65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:14.380339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0f4c7-d8b3-4666-a6b5-4c7755529d65 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:14.390523 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37befe3c-36aa-49f3-8637-2ac89f7e6852 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a63879ec1242d08bba1ccad6212788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:14.391430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37befe3c-36aa-49f3-8637-2ac89f7e6852 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:14.391716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37befe3c-36aa-49f3-8637-2ac89f7e6852 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:14.391992 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37befe3c-36aa-49f3-8637-2ac89f7e6852 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:14.401164 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:14.404121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37befe3c-36aa-49f3-8637-2ac89f7e6852 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:14.423166 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37befe3c-36aa-49f3-8637-2ac89f7e6852 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:14.438003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1161/2329] 10.222.0.61 () {60 vars in 1384 bytes} [Thu May 26 21:10:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:10:15.068275 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d6869-8a7e-439e-8158-53d1ae7bb4b0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:15.070013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3e5d6869-8a7e-439e-8158-53d1ae7bb4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:15.176426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d6869-8a7e-439e-8158-53d1ae7bb4b0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:15.191756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ac33b-9252-477e-ba8c-0609b6a1bb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:15.197667 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ac33b-9252-477e-ba8c-0609b6a1bb8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:15.198031 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ac33b-9252-477e-ba8c-0609b6a1bb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:15.198310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ac33b-9252-477e-ba8c-0609b6a1bb8a admin admin] PATH_INFO: `/v3/users/def8dfcd87084f97b93bb263798a44b9` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:15.218499 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ac33b-9252-477e-ba8c-0609b6a1bb8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=def8dfcd87084f97b93bb263798a44b9)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:15.224347 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ac33b-9252-477e-ba8c-0609b6a1bb8a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:15.295714 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ab1a6-39ba-46ce-94bb-2a0ce1a18956 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:15.296630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ab1a6-39ba-46ce-94bb-2a0ce1a18956 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:15.297055 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ab1a6-39ba-46ce-94bb-2a0ce1a18956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:15.311439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f07ac33b-9252-477e-ba8c-0609b6a1bb8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def8dfcd87084f97b93bb263798a44b9'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:15.316915 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d67ab1a6-39ba-46ce-94bb-2a0ce1a18956 None None] MFA Rules not processed for user `3953b14656774edb92da1ecdb4bbbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:15.318046 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d67ab1a6-39ba-46ce-94bb-2a0ce1a18956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:15.330857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1162/2330] 10.222.0.61 () {58 vars in 967 bytes} [Thu May 26 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:15.332555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608527ae-aa96-41d3-937f-58be4e6a4188 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:15.333252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608527ae-aa96-41d3-937f-58be4e6a4188 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:15.333641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608527ae-aa96-41d3-937f-58be4e6a4188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:15.334901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f07ac33b-9252-477e-ba8c-0609b6a1bb8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def8dfcd87084f97b93bb263798a44b9'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:15.335597 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f07ac33b-9252-477e-ba8c-0609b6a1bb8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def8dfcd87084f97b93bb263798a44b9'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:15.347800 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f07ac33b-9252-477e-ba8c-0609b6a1bb8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def8dfcd87084f97b93bb263798a44b9'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:15.354445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:15.357679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f07ac33b-9252-477e-ba8c-0609b6a1bb8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def8dfcd87084f97b93bb263798a44b9'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:15.366215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1169/2331] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:10:15 2022] DELETE /identity/v3/users/def8dfcd87084f97b93bb263798a44b9 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:15.367293 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ac33b-9252-477e-ba8c-0609b6a1bb8a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:15.369517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f07ac33b-9252-477e-ba8c-0609b6a1bb8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:15.372848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-608527ae-aa96-41d3-937f-58be4e6a4188 None None] MFA Rules not processed for user `796103c08e1747e88d5ed270d2e8c70f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:15.374172 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-608527ae-aa96-41d3-937f-58be4e6a4188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:15.451903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ac33b-9252-477e-ba8c-0609b6a1bb8a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:15.452157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1163/2332] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:15.456131 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492edfd-bd87-41c1-9b48-1dc730c47854 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:15.456822 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492edfd-bd87-41c1-9b48-1dc730c47854 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:15.457252 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492edfd-bd87-41c1-9b48-1dc730c47854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:15.457976 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7efbdd-4c5e-4b86-a962-23b68a79bc9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a63879ec1242d08bba1ccad6212788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:15.458654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7efbdd-4c5e-4b86-a962-23b68a79bc9e service swift] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:15.458939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7efbdd-4c5e-4b86-a962-23b68a79bc9e service swift] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:15.459219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7efbdd-4c5e-4b86-a962-23b68a79bc9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:15.461232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bf7efbdd-4c5e-4b86-a962-23b68a79bc9e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:15.492462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7492edfd-bd87-41c1-9b48-1dc730c47854 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:15.494424 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7492edfd-bd87-41c1-9b48-1dc730c47854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:15.538080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7efbdd-4c5e-4b86-a962-23b68a79bc9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:15.540426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7efbdd-4c5e-4b86-a962-23b68a79bc9e service swift] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:15.550473 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1170/2333] 10.222.0.61 () {60 vars in 1384 bytes} [Thu May 26 21:10:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:10:15.551329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7efbdd-4c5e-4b86-a962-23b68a79bc9e service swift] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:15.552856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bf7efbdd-4c5e-4b86-a962-23b68a79bc9e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:15.577708 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1164/2334] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:15.587342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492edfd-bd87-41c1-9b48-1dc730c47854 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:15.588921 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7492edfd-bd87-41c1-9b48-1dc730c47854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:15.650006 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7efbdd-4c5e-4b86-a962-23b68a79bc9e service swift] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:15.659360 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7b208-d232-4569-9b49-8e590fb7387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:15.660075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7b208-d232-4569-9b49-8e590fb7387d admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:15.660360 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7b208-d232-4569-9b49-8e590fb7387d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:15.660630 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7b208-d232-4569-9b49-8e590fb7387d admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:15.661339 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7b208-d232-4569-9b49-8e590fb7387d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:15.663342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7b208-d232-4569-9b49-8e590fb7387d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:15.690336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492edfd-bd87-41c1-9b48-1dc730c47854 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:15.701523 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1171/2335] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:10:15 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:10:15.703558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b187844-9e84-40bd-9328-864bdf57350a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:15.704677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b187844-9e84-40bd-9328-864bdf57350a service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:15.705031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b187844-9e84-40bd-9328-864bdf57350a service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:15.705344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b187844-9e84-40bd-9328-864bdf57350a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:15.708161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7b208-d232-4569-9b49-8e590fb7387d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:15.717492 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:15.721894 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b187844-9e84-40bd-9328-864bdf57350a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:15.724557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b187844-9e84-40bd-9328-864bdf57350a service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:15.740395 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1165/2336] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:15.751176 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:15.809346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7b208-d232-4569-9b49-8e590fb7387d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:15.822088 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d6e01-c326-49df-ba0c-2606ff7cee19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:15.822088 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d6e01-c326-49df-ba0c-2606ff7cee19 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:15.822088 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d6e01-c326-49df-ba0c-2606ff7cee19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:15.822088 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d6e01-c326-49df-ba0c-2606ff7cee19 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:15.823178 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d6e01-c326-49df-ba0c-2606ff7cee19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:15.825419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d6e01-c326-49df-ba0c-2606ff7cee19 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:15.850538 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1172/2337] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:10:15 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:10:15.855173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b187844-9e84-40bd-9328-864bdf57350a service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:15.865935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b187844-9e84-40bd-9328-864bdf57350a service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:15.873682 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3d37f-9007-444c-a3f3-85aa56b04918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:15.878172 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3d37f-9007-444c-a3f3-85aa56b04918 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:15.879858 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3d37f-9007-444c-a3f3-85aa56b04918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:15.880487 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3d37f-9007-444c-a3f3-85aa56b04918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:15.884344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3d37f-9007-444c-a3f3-85aa56b04918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:15.887505 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3d37f-9007-444c-a3f3-85aa56b04918 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:15.902266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1166/2338] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:10:15.906574 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d6e01-c326-49df-ba0c-2606ff7cee19 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:15.917041 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d6e01-c326-49df-ba0c-2606ff7cee19 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:15.928990 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f72a4-d05b-4d35-bb98-479f557e9da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:15.930787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f72a4-d05b-4d35-bb98-479f557e9da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:15.931270 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f72a4-d05b-4d35-bb98-479f557e9da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:15.931785 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f72a4-d05b-4d35-bb98-479f557e9da7 admin admin] PATH_INFO: `/v3/projects/d11d1fad000046e2859ff9944b95a24b/users/de8f305d20424946ad4bd527e0248227/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:15.956473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49dbbd-b389-4f1b-9174-1128580e4b94 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:15.956767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49dbbd-b389-4f1b-9174-1128580e4b94 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:15.957033 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49dbbd-b389-4f1b-9174-1128580e4b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:15.964035 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f72a4-d05b-4d35-bb98-479f557e9da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11d1fad000046e2859ff9944b95a24b, user_id=de8f305d20424946ad4bd527e0248227, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:15.974688 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f72a4-d05b-4d35-bb98-479f557e9da7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:15.990157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cd49dbbd-b389-4f1b-9174-1128580e4b94 None None] MFA Rules not processed for user `3953b14656774edb92da1ecdb4bbbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:15.993536 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cd49dbbd-b389-4f1b-9174-1128580e4b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:15.998803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1173/2339] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:10:15 2022] PUT /identity/v3/projects/d11d1fad000046e2859ff9944b95a24b/users/de8f305d20424946ad4bd527e0248227/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:16.003095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f72a4-d05b-4d35-bb98-479f557e9da7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:16.068288 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1167/2340] 10.222.0.61 () {58 vars in 1009 bytes} [Thu May 26 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:16.080956 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49dbbd-b389-4f1b-9174-1128580e4b94 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:16.092047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f72a4-d05b-4d35-bb98-479f557e9da7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:16.098317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed12cd-d41f-4efc-bd39-23a26dabe5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:16.099394 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed12cd-d41f-4efc-bd39-23a26dabe5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:16.099934 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed12cd-d41f-4efc-bd39-23a26dabe5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:16.100837 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed12cd-d41f-4efc-bd39-23a26dabe5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:16.103734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed12cd-d41f-4efc-bd39-23a26dabe5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:16.105985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed12cd-d41f-4efc-bd39-23a26dabe5a7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:16.121835 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1174/2341] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:10:16.124756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed12cd-d41f-4efc-bd39-23a26dabe5a7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:16.137845 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed12cd-d41f-4efc-bd39-23a26dabe5a7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:16.143765 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154febd6-c298-4d25-a9e2-e4344e4f9e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:16.144939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154febd6-c298-4d25-a9e2-e4344e4f9e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:16.145339 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154febd6-c298-4d25-a9e2-e4344e4f9e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:16.145678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154febd6-c298-4d25-a9e2-e4344e4f9e1e admin admin] PATH_INFO: `/v3/projects/d11d1fad000046e2859ff9944b95a24b/users/de8f305d20424946ad4bd527e0248227/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:16.149049 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154febd6-c298-4d25-a9e2-e4344e4f9e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11d1fad000046e2859ff9944b95a24b, user_id=de8f305d20424946ad4bd527e0248227, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:16.152825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154febd6-c298-4d25-a9e2-e4344e4f9e1e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:16.163326 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49dbbd-b389-4f1b-9174-1128580e4b94 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:16.164297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1175/2342] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:10:16 2022] PUT /identity/v3/projects/d11d1fad000046e2859ff9944b95a24b/users/de8f305d20424946ad4bd527e0248227/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:10:16.193783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154febd6-c298-4d25-a9e2-e4344e4f9e1e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:16.197067 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-154febd6-c298-4d25-a9e2-e4344e4f9e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:16.252651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5312659-794e-4429-8755-ebccd11f733d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a63879ec1242d08bba1ccad6212788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:16.253355 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5312659-794e-4429-8755-ebccd11f733d service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:16.253643 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5312659-794e-4429-8755-ebccd11f733d service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:16.253973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5312659-794e-4429-8755-ebccd11f733d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:16.288033 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154febd6-c298-4d25-a9e2-e4344e4f9e1e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:16.294342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12296c-6b15-485b-bb8e-430191aff2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:16.295302 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12296c-6b15-485b-bb8e-430191aff2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:16.295593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12296c-6b15-485b-bb8e-430191aff2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:16.295899 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12296c-6b15-485b-bb8e-430191aff2ca admin admin] PATH_INFO: `/v3/projects/3086f8322ceb4fcea79f085d22b08327` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:16.297624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12296c-6b15-485b-bb8e-430191aff2ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3086f8322ceb4fcea79f085d22b08327)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:16.300723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12296c-6b15-485b-bb8e-430191aff2ca admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:16.309658 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:16.321683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:16.345222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5312659-794e-4429-8755-ebccd11f733d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:16.346988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5312659-794e-4429-8755-ebccd11f733d service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:16.365356 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1168/2343] 10.222.0.61 () {60 vars in 1384 bytes} [Thu May 26 21:10:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 21:10:16.383939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7f12296c-6b15-485b-bb8e-430191aff2ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3086f8322ceb4fcea79f085d22b08327', 'request_id': 'req-7f12296c-6b15-485b-bb8e-430191aff2ca'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:16.398742 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7f12296c-6b15-485b-bb8e-430191aff2ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3086f8322ceb4fcea79f085d22b08327', 'request_id': 'req-7f12296c-6b15-485b-bb8e-430191aff2ca'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:16.409914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7f12296c-6b15-485b-bb8e-430191aff2ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3086f8322ceb4fcea79f085d22b08327', 'request_id': 'req-7f12296c-6b15-485b-bb8e-430191aff2ca'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:16.446470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7f12296c-6b15-485b-bb8e-430191aff2ca admin admin] The token cache is being invalidate because project 3086f8322ceb4fcea79f085d22b08327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:10:16.447701 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7f12296c-6b15-485b-bb8e-430191aff2ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:16.448879 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7f12296c-6b15-485b-bb8e-430191aff2ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:16.451330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1176/2344] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:10:16 2022] DELETE /identity/v3/projects/3086f8322ceb4fcea79f085d22b08327 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:16.456129 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5312659-794e-4429-8755-ebccd11f733d service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:16.468360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5312659-794e-4429-8755-ebccd11f733d service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:16.604190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b5166-f274-4ce2-9128-92ba286bbd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:16.604896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b5166-f274-4ce2-9128-92ba286bbd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:16.605251 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b5166-f274-4ce2-9128-92ba286bbd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:16.605599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b5166-f274-4ce2-9128-92ba286bbd4c admin admin] PATH_INFO: `/v3/users/453fc8272f694c8b93b7e0b93c19bc73` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:16.607166 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b5166-f274-4ce2-9128-92ba286bbd4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=453fc8272f694c8b93b7e0b93c19bc73)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:16.609680 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b5166-f274-4ce2-9128-92ba286bbd4c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:16.702396 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5c2b5166-f274-4ce2-9128-92ba286bbd4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453fc8272f694c8b93b7e0b93c19bc73'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:16.704978 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5c2b5166-f274-4ce2-9128-92ba286bbd4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453fc8272f694c8b93b7e0b93c19bc73'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:16.730377 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5c2b5166-f274-4ce2-9128-92ba286bbd4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453fc8272f694c8b93b7e0b93c19bc73'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:16.784409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5c2b5166-f274-4ce2-9128-92ba286bbd4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453fc8272f694c8b93b7e0b93c19bc73'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:16.795560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5c2b5166-f274-4ce2-9128-92ba286bbd4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453fc8272f694c8b93b7e0b93c19bc73'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:16.805461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1169/2345] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:10:16 2022] DELETE /identity/v3/users/453fc8272f694c8b93b7e0b93c19bc73 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:16.946991 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fa6d-e26b-40eb-bae5-94d1fcad99d5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:16.947179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fa6d-e26b-40eb-bae5-94d1fcad99d5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:16.947409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fa6d-e26b-40eb-bae5-94d1fcad99d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:16.984756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0a41fa6d-e26b-40eb-bae5-94d1fcad99d5 None None] MFA Rules not processed for user `3953b14656774edb92da1ecdb4bbbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:16.984756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0a41fa6d-e26b-40eb-bae5-94d1fcad99d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:17.076526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1177/2346] 10.222.0.61 () {58 vars in 967 bytes} [Thu May 26 21:10:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:17.092791 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b5166-f274-4ce2-9128-92ba286bbd4c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:17.094740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5c2b5166-f274-4ce2-9128-92ba286bbd4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:17.158661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:17.179707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b5166-f274-4ce2-9128-92ba286bbd4c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:17.189148 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2388780-9ab6-4b52-aaf7-c88ce99b7816 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a63879ec1242d08bba1ccad6212788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:17.189934 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2388780-9ab6-4b52-aaf7-c88ce99b7816 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:17.190314 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2388780-9ab6-4b52-aaf7-c88ce99b7816 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:17.190663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2388780-9ab6-4b52-aaf7-c88ce99b7816 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:17.200591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2388780-9ab6-4b52-aaf7-c88ce99b7816 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:17.202396 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2388780-9ab6-4b52-aaf7-c88ce99b7816 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:17.211735 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1170/2347] 10.222.0.61 () {60 vars in 1384 bytes} [Thu May 26 21:10:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:10:17.326020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41fa6d-e26b-40eb-bae5-94d1fcad99d5 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:17.328632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0a41fa6d-e26b-40eb-bae5-94d1fcad99d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:17.456980 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41fa6d-e26b-40eb-bae5-94d1fcad99d5 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:17.462949 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82582cb2-329f-4461-ae66-9d9bf49b5e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:17.464077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82582cb2-329f-4461-ae66-9d9bf49b5e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:17.465509 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82582cb2-329f-4461-ae66-9d9bf49b5e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:17.465961 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82582cb2-329f-4461-ae66-9d9bf49b5e25 admin admin] PATH_INFO: `/v3/projects/0585c0905a06431a9fec2fcfbf1ae0b5` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:17.467643 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82582cb2-329f-4461-ae66-9d9bf49b5e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0585c0905a06431a9fec2fcfbf1ae0b5)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:17.471775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82582cb2-329f-4461-ae66-9d9bf49b5e25 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:17.547811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:17.559173 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-82582cb2-329f-4461-ae66-9d9bf49b5e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0585c0905a06431a9fec2fcfbf1ae0b5', 'request_id': 'req-82582cb2-329f-4461-ae66-9d9bf49b5e25'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:17.574395 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-82582cb2-329f-4461-ae66-9d9bf49b5e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0585c0905a06431a9fec2fcfbf1ae0b5', 'request_id': 'req-82582cb2-329f-4461-ae66-9d9bf49b5e25'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:17.595103 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-82582cb2-329f-4461-ae66-9d9bf49b5e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0585c0905a06431a9fec2fcfbf1ae0b5', 'request_id': 'req-82582cb2-329f-4461-ae66-9d9bf49b5e25'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:17.624363 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-82582cb2-329f-4461-ae66-9d9bf49b5e25 admin admin] The token cache is being invalidate because project 0585c0905a06431a9fec2fcfbf1ae0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:10:17.624684 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-82582cb2-329f-4461-ae66-9d9bf49b5e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:17.625410 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-82582cb2-329f-4461-ae66-9d9bf49b5e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:17.627145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1178/2348] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:10:17 2022] DELETE /identity/v3/projects/0585c0905a06431a9fec2fcfbf1ae0b5 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:17.631637 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2388780-9ab6-4b52-aaf7-c88ce99b7816 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:17.651767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2388780-9ab6-4b52-aaf7-c88ce99b7816 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:17.751946 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb37fa-daf5-4441-861c-8bb8b2fb47d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:17.752948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb37fa-daf5-4441-861c-8bb8b2fb47d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:17.753446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb37fa-daf5-4441-861c-8bb8b2fb47d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:17.754686 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb37fa-daf5-4441-861c-8bb8b2fb47d3 admin admin] PATH_INFO: `/v3/users/a8b95281e48942ba846dec9f5d1b29ad` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:17.765234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb37fa-daf5-4441-861c-8bb8b2fb47d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8b95281e48942ba846dec9f5d1b29ad)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:17.775976 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb37fa-daf5-4441-861c-8bb8b2fb47d3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:17.883410 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7ebb37fa-daf5-4441-861c-8bb8b2fb47d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8b95281e48942ba846dec9f5d1b29ad'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:17.884394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7ebb37fa-daf5-4441-861c-8bb8b2fb47d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8b95281e48942ba846dec9f5d1b29ad'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:17.925007 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7ebb37fa-daf5-4441-861c-8bb8b2fb47d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8b95281e48942ba846dec9f5d1b29ad'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:17.952410 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7ebb37fa-daf5-4441-861c-8bb8b2fb47d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8b95281e48942ba846dec9f5d1b29ad'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:17.967725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7ebb37fa-daf5-4441-861c-8bb8b2fb47d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8b95281e48942ba846dec9f5d1b29ad'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:17.992023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1171/2349] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:10:17 2022] DELETE /identity/v3/users/a8b95281e48942ba846dec9f5d1b29ad => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:18.657098 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82582cb2-329f-4461-ae66-9d9bf49b5e25 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:18.660006 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-82582cb2-329f-4461-ae66-9d9bf49b5e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:18.681893 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82582cb2-329f-4461-ae66-9d9bf49b5e25 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:18.815713 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934d9b5-9924-4282-baa0-288891abf806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:18.816824 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934d9b5-9924-4282-baa0-288891abf806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:18.817114 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934d9b5-9924-4282-baa0-288891abf806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:18.817396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934d9b5-9924-4282-baa0-288891abf806 admin admin] PATH_INFO: `/v3/projects/390ab9b5f6e141958331d6283fffc878` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:18.818661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934d9b5-9924-4282-baa0-288891abf806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=390ab9b5f6e141958331d6283fffc878)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:18.820758 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934d9b5-9924-4282-baa0-288891abf806 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:18.899114 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6934d9b5-9924-4282-baa0-288891abf806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '390ab9b5f6e141958331d6283fffc878', 'request_id': 'req-6934d9b5-9924-4282-baa0-288891abf806'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:18.907877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6934d9b5-9924-4282-baa0-288891abf806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '390ab9b5f6e141958331d6283fffc878', 'request_id': 'req-6934d9b5-9924-4282-baa0-288891abf806'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:18.917252 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6934d9b5-9924-4282-baa0-288891abf806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '390ab9b5f6e141958331d6283fffc878', 'request_id': 'req-6934d9b5-9924-4282-baa0-288891abf806'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:18.947905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6934d9b5-9924-4282-baa0-288891abf806 admin admin] The token cache is being invalidate because project 390ab9b5f6e141958331d6283fffc878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:10:18.948301 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6934d9b5-9924-4282-baa0-288891abf806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:18.949498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6934d9b5-9924-4282-baa0-288891abf806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:18.954574 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1179/2350] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:10:18 2022] DELETE /identity/v3/projects/390ab9b5f6e141958331d6283fffc878 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:18.960543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b41d9-c396-41aa-ac32-1d8cc3c65c37 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:18.961150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b41d9-c396-41aa-ac32-1d8cc3c65c37 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:18.961445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b41d9-c396-41aa-ac32-1d8cc3c65c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:19.027634 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7d1b41d9-c396-41aa-ac32-1d8cc3c65c37 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:19.029365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7d1b41d9-c396-41aa-ac32-1d8cc3c65c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:19.093436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:19.125953 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1172/2351] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:10:19.134908 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f664023-5ac5-4465-9971-ec1ec2219662 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:19.135960 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f664023-5ac5-4465-9971-ec1ec2219662 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:19.138007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f664023-5ac5-4465-9971-ec1ec2219662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:19.162163 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0f664023-5ac5-4465-9971-ec1ec2219662 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:19.163515 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0f664023-5ac5-4465-9971-ec1ec2219662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:19.176880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1180/2352] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:19.178663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b41d9-c396-41aa-ac32-1d8cc3c65c37 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:19.189428 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b41d9-c396-41aa-ac32-1d8cc3c65c37 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:19.195723 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef062e-e346-4039-928b-f900373815f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:19.196508 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef062e-e346-4039-928b-f900373815f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:19.196822 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef062e-e346-4039-928b-f900373815f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:19.197159 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef062e-e346-4039-928b-f900373815f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:19.197976 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef062e-e346-4039-928b-f900373815f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:10:19.198304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef062e-e346-4039-928b-f900373815f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:19.199932 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef062e-e346-4039-928b-f900373815f9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:19.221438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1173/2353] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:10:19.223042 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f664023-5ac5-4465-9971-ec1ec2219662 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:19.233890 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f664023-5ac5-4465-9971-ec1ec2219662 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:19.239139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d93c0a-995d-4c5c-aef8-d9f92460a2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:19.239866 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d93c0a-995d-4c5c-aef8-d9f92460a2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:19.240575 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d93c0a-995d-4c5c-aef8-d9f92460a2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:19.240871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d93c0a-995d-4c5c-aef8-d9f92460a2b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:19.241626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d93c0a-995d-4c5c-aef8-d9f92460a2b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:19.244578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d93c0a-995d-4c5c-aef8-d9f92460a2b8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:19.282313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1181/2354] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:10:19 2022] POST /identity/v3/projects => generated 399 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:10:19.287586 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef062e-e346-4039-928b-f900373815f9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:19.302201 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef062e-e346-4039-928b-f900373815f9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:19.423331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0d464-c1a7-4d12-a8b1-28fde0140cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:19.424717 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d464-c1a7-4d12-a8b1-28fde0140cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:19.425124 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d464-c1a7-4d12-a8b1-28fde0140cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:19.425494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d464-c1a7-4d12-a8b1-28fde0140cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:19.426377 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0d464-c1a7-4d12-a8b1-28fde0140cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:19.428490 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0d464-c1a7-4d12-a8b1-28fde0140cd9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:19.484466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1174/2355] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:10:19 2022] POST /identity/v3/users => generated 300 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:10:19.486510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d93c0a-995d-4c5c-aef8-d9f92460a2b8 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:19.507646 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d93c0a-995d-4c5c-aef8-d9f92460a2b8 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:19.513152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3433b-6f08-4a8f-8ee9-17314874bec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:19.513893 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3433b-6f08-4a8f-8ee9-17314874bec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:19.515228 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3433b-6f08-4a8f-8ee9-17314874bec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:19.515609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3433b-6f08-4a8f-8ee9-17314874bec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:19.516681 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3433b-6f08-4a8f-8ee9-17314874bec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:19.519038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3433b-6f08-4a8f-8ee9-17314874bec2 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:19.539711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0d464-c1a7-4d12-a8b1-28fde0140cd9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:19.542951 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1182/2356] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:10:19.566147 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0d464-c1a7-4d12-a8b1-28fde0140cd9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:19.583099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a41d2b-be9c-4278-b93f-4f23641db00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:19.592147 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a41d2b-be9c-4278-b93f-4f23641db00f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:19.592453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a41d2b-be9c-4278-b93f-4f23641db00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:19.592735 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a41d2b-be9c-4278-b93f-4f23641db00f admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:19.593638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a41d2b-be9c-4278-b93f-4f23641db00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:19.595337 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a41d2b-be9c-4278-b93f-4f23641db00f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:19.621769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3433b-6f08-4a8f-8ee9-17314874bec2 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:19.623522 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1175/2357] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:10:19.641692 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3433b-6f08-4a8f-8ee9-17314874bec2 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:19.651966 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521e89b-064a-4ae8-b85f-35c15d2ffa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:19.653100 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521e89b-064a-4ae8-b85f-35c15d2ffa64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:19.653436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521e89b-064a-4ae8-b85f-35c15d2ffa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:19.657407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521e89b-064a-4ae8-b85f-35c15d2ffa64 admin admin] PATH_INFO: `/v3/projects/d3a4747a74f14e78820b17992358c906/users/ab9ae3b019a14795b6fb21401f7e969d/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:19.711372 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521e89b-064a-4ae8-b85f-35c15d2ffa64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a4747a74f14e78820b17992358c906, user_id=ab9ae3b019a14795b6fb21401f7e969d, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:19.714210 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521e89b-064a-4ae8-b85f-35c15d2ffa64 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:19.746873 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:19.779551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1183/2358] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:10:19 2022] PUT /identity/v3/projects/d3a4747a74f14e78820b17992358c906/users/ab9ae3b019a14795b6fb21401f7e969d/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:10:19.790535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38f2d5-19bc-48a6-b151-a617540d9111 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:19.790851 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38f2d5-19bc-48a6-b151-a617540d9111 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:19.791094 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38f2d5-19bc-48a6-b151-a617540d9111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:19.902977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ad38f2d5-19bc-48a6-b151-a617540d9111 None None] MFA Rules not processed for user `ab9ae3b019a14795b6fb21401f7e969d`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:19.904517 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ad38f2d5-19bc-48a6-b151-a617540d9111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:20.011346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521e89b-064a-4ae8-b85f-35c15d2ffa64 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:20.013559 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f521e89b-064a-4ae8-b85f-35c15d2ffa64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:20.137031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1176/2359] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:20.146156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38f2d5-19bc-48a6-b151-a617540d9111 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:20.148732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ad38f2d5-19bc-48a6-b151-a617540d9111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:20.266967 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521e89b-064a-4ae8-b85f-35c15d2ffa64 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:20.274910 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9899cb-cd23-47c7-b32f-588a8c921ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:20.275878 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9899cb-cd23-47c7-b32f-588a8c921ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:20.276160 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9899cb-cd23-47c7-b32f-588a8c921ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:20.276480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9899cb-cd23-47c7-b32f-588a8c921ff3 admin admin] PATH_INFO: `/v3/users/d958437ab6884fcab6a21a90de5b001f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:20.277984 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9899cb-cd23-47c7-b32f-588a8c921ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d958437ab6884fcab6a21a90de5b001f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:20.282622 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9899cb-cd23-47c7-b32f-588a8c921ff3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:20.332735 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:20.362987 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38f2d5-19bc-48a6-b151-a617540d9111 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:20.373894 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e735aae-a6ff-4592-b80a-b6a034be1e25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:20.375492 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e735aae-a6ff-4592-b80a-b6a034be1e25 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:20.375972 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e735aae-a6ff-4592-b80a-b6a034be1e25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:20.376331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e735aae-a6ff-4592-b80a-b6a034be1e25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:20.393663 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ca9899cb-cd23-47c7-b32f-588a8c921ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd958437ab6884fcab6a21a90de5b001f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:20.408912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e735aae-a6ff-4592-b80a-b6a034be1e25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:20.409287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ca9899cb-cd23-47c7-b32f-588a8c921ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd958437ab6884fcab6a21a90de5b001f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:20.410158 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ca9899cb-cd23-47c7-b32f-588a8c921ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd958437ab6884fcab6a21a90de5b001f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:20.430433 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e735aae-a6ff-4592-b80a-b6a034be1e25 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:20.434322 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ca9899cb-cd23-47c7-b32f-588a8c921ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd958437ab6884fcab6a21a90de5b001f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:20.447612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ca9899cb-cd23-47c7-b32f-588a8c921ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd958437ab6884fcab6a21a90de5b001f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:20.462568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1184/2360] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:10:20 2022] DELETE /identity/v3/users/d958437ab6884fcab6a21a90de5b001f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:20.464747 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf0cd6-6647-4e52-9e0d-9aa9eecfddbd None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:20.465185 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf0cd6-6647-4e52-9e0d-9aa9eecfddbd None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:20.465622 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf0cd6-6647-4e52-9e0d-9aa9eecfddbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:20.482304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1177/2361] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:20.524556 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-18bf0cd6-6647-4e52-9e0d-9aa9eecfddbd None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:20.526154 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-18bf0cd6-6647-4e52-9e0d-9aa9eecfddbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:20.656230 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1185/2362] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:20.694340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e735aae-a6ff-4592-b80a-b6a034be1e25 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:20.695949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9e735aae-a6ff-4592-b80a-b6a034be1e25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:20.860273 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e735aae-a6ff-4592-b80a-b6a034be1e25 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:20.989205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a0218-17c0-4d0d-92da-7b51cee90854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:20.989205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a0218-17c0-4d0d-92da-7b51cee90854 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:20.989523 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a0218-17c0-4d0d-92da-7b51cee90854 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:20.990238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a0218-17c0-4d0d-92da-7b51cee90854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:21.007407 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a0218-17c0-4d0d-92da-7b51cee90854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:21.010108 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a0218-17c0-4d0d-92da-7b51cee90854 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:21.033775 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1178/2363] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:21.326462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf0cd6-6647-4e52-9e0d-9aa9eecfddbd None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:21.327906 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-18bf0cd6-6647-4e52-9e0d-9aa9eecfddbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:21.350841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf0cd6-6647-4e52-9e0d-9aa9eecfddbd None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:21.372281 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e098d2-7960-4fe6-b30b-6a7cf4988369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:21.373907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e098d2-7960-4fe6-b30b-6a7cf4988369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:21.374201 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e098d2-7960-4fe6-b30b-6a7cf4988369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:21.374436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e098d2-7960-4fe6-b30b-6a7cf4988369 admin admin] PATH_INFO: `/v3/projects/1830a4db0686456cb45b39b204b6b2b3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:21.375799 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e098d2-7960-4fe6-b30b-6a7cf4988369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1830a4db0686456cb45b39b204b6b2b3)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:21.378012 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e098d2-7960-4fe6-b30b-6a7cf4988369 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:21.417027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:21.501008 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-29e098d2-7960-4fe6-b30b-6a7cf4988369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1830a4db0686456cb45b39b204b6b2b3', 'request_id': 'req-29e098d2-7960-4fe6-b30b-6a7cf4988369'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:21.526718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-29e098d2-7960-4fe6-b30b-6a7cf4988369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1830a4db0686456cb45b39b204b6b2b3', 'request_id': 'req-29e098d2-7960-4fe6-b30b-6a7cf4988369'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:21.545228 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-29e098d2-7960-4fe6-b30b-6a7cf4988369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1830a4db0686456cb45b39b204b6b2b3', 'request_id': 'req-29e098d2-7960-4fe6-b30b-6a7cf4988369'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:21.576369 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-29e098d2-7960-4fe6-b30b-6a7cf4988369 admin admin] The token cache is being invalidate because project 1830a4db0686456cb45b39b204b6b2b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:10:21.576862 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-29e098d2-7960-4fe6-b30b-6a7cf4988369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:21.579927 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-29e098d2-7960-4fe6-b30b-6a7cf4988369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:21.583197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1186/2364] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:10:21 2022] DELETE /identity/v3/projects/1830a4db0686456cb45b39b204b6b2b3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:23.516311 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bc8a6-843c-4548-b00d-c39f695e1fb9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:23.516808 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bc8a6-843c-4548-b00d-c39f695e1fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:23.517037 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bc8a6-843c-4548-b00d-c39f695e1fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:23.557656 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cf8bc8a6-843c-4548-b00d-c39f695e1fb9 None None] MFA Rules not processed for user `de8f305d20424946ad4bd527e0248227`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:23.559097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cf8bc8a6-843c-4548-b00d-c39f695e1fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:23.646683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1179/2365] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:23.660566 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e098d2-7960-4fe6-b30b-6a7cf4988369 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:23.662235 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-29e098d2-7960-4fe6-b30b-6a7cf4988369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:23.725567 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e098d2-7960-4fe6-b30b-6a7cf4988369 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:23.730500 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b1e2b-c44a-4fd0-9a6d-2d0acd55df4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7e1c8c42cd4f6dab8b27829e5fc5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:23.731184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b1e2b-c44a-4fd0-9a6d-2d0acd55df4b service glance] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:23.731470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b1e2b-c44a-4fd0-9a6d-2d0acd55df4b service glance] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:23.731747 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b1e2b-c44a-4fd0-9a6d-2d0acd55df4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:23.733584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-364b1e2b-c44a-4fd0-9a6d-2d0acd55df4b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:23.797079 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b1e2b-c44a-4fd0-9a6d-2d0acd55df4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:23.798561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b1e2b-c44a-4fd0-9a6d-2d0acd55df4b service glance] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:23.809199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1187/2366] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:23.917193 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c189670-4170-4719-993a-eaace6de351c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:23.917493 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c189670-4170-4719-993a-eaace6de351c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:23.917783 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c189670-4170-4719-993a-eaace6de351c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:23.938303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8c189670-4170-4719-993a-eaace6de351c None None] MFA Rules not processed for user `3953b14656774edb92da1ecdb4bbbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:23.941337 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8c189670-4170-4719-993a-eaace6de351c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:23.990448 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:24.030198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1180/2367] 10.222.0.61 () {58 vars in 1009 bytes} [Thu May 26 21:10:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:24.042342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b1e2b-c44a-4fd0-9a6d-2d0acd55df4b service glance] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:24.044065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-364b1e2b-c44a-4fd0-9a6d-2d0acd55df4b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:24.107406 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:24.125530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b1e2b-c44a-4fd0-9a6d-2d0acd55df4b service glance] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:24.139606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bab28-e4a4-4535-94a1-2d0c97abdafb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a63879ec1242d08bba1ccad6212788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:24.140570 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bab28-e4a4-4535-94a1-2d0c97abdafb service swift] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:24.141029 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bab28-e4a4-4535-94a1-2d0c97abdafb service swift] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:24.141484 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bab28-e4a4-4535-94a1-2d0c97abdafb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:24.154335 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bab28-e4a4-4535-94a1-2d0c97abdafb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:24.155978 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bab28-e4a4-4535-94a1-2d0c97abdafb service swift] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:24.165885 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1188/2368] 10.222.0.61 () {60 vars in 1384 bytes} [Thu May 26 21:10:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:10:26.476476 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c189670-4170-4719-993a-eaace6de351c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:26.485259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8c189670-4170-4719-993a-eaace6de351c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:26.731612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c189670-4170-4719-993a-eaace6de351c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:26.738590 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d831a-94b1-45c3-a46a-beafc30cfcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:26.740245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d831a-94b1-45c3-a46a-beafc30cfcd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:26.740724 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d831a-94b1-45c3-a46a-beafc30cfcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:26.741365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d831a-94b1-45c3-a46a-beafc30cfcd9 admin admin] PATH_INFO: `/v3/users/ab9ae3b019a14795b6fb21401f7e969d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:26.743475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d831a-94b1-45c3-a46a-beafc30cfcd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab9ae3b019a14795b6fb21401f7e969d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:26.747493 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d831a-94b1-45c3-a46a-beafc30cfcd9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:26.848632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bab28-e4a4-4535-94a1-2d0c97abdafb service swift] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:26.852059 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e69bab28-e4a4-4535-94a1-2d0c97abdafb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:26.874340 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bab28-e4a4-4535-94a1-2d0c97abdafb service swift] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:26.884083 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56041a07-fab7-41e1-8fa4-3cf01497b7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:26.885309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56041a07-fab7-41e1-8fa4-3cf01497b7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:26.887338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56041a07-fab7-41e1-8fa4-3cf01497b7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:26.887928 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56041a07-fab7-41e1-8fa4-3cf01497b7aa admin admin] PATH_INFO: `/v3/users/eb9d449ec40c4e089bc7ae8b64750f7b` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:26.889455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56041a07-fab7-41e1-8fa4-3cf01497b7aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb9d449ec40c4e089bc7ae8b64750f7b)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:26.896340 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56041a07-fab7-41e1-8fa4-3cf01497b7aa admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:26.896937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-be3d831a-94b1-45c3-a46a-beafc30cfcd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab9ae3b019a14795b6fb21401f7e969d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:26.899882 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-be3d831a-94b1-45c3-a46a-beafc30cfcd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab9ae3b019a14795b6fb21401f7e969d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:26.924617 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-be3d831a-94b1-45c3-a46a-beafc30cfcd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab9ae3b019a14795b6fb21401f7e969d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:26.943062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-be3d831a-94b1-45c3-a46a-beafc30cfcd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab9ae3b019a14795b6fb21401f7e969d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:26.953327 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-be3d831a-94b1-45c3-a46a-beafc30cfcd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab9ae3b019a14795b6fb21401f7e969d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:26.962259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1181/2369] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:10:26 2022] DELETE /identity/v3/users/ab9ae3b019a14795b6fb21401f7e969d => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:26.970641 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb89ae0-a7bb-4d3c-9163-cdb9b121ec8e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:26.971151 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb89ae0-a7bb-4d3c-9163-cdb9b121ec8e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:26.972744 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb89ae0-a7bb-4d3c-9163-cdb9b121ec8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:27.003089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-56041a07-fab7-41e1-8fa4-3cf01497b7aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb9d449ec40c4e089bc7ae8b64750f7b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:27.005247 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bbb89ae0-a7bb-4d3c-9163-cdb9b121ec8e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:27.014985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bbb89ae0-a7bb-4d3c-9163-cdb9b121ec8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:27.039791 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-56041a07-fab7-41e1-8fa4-3cf01497b7aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb9d449ec40c4e089bc7ae8b64750f7b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:27.041215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-56041a07-fab7-41e1-8fa4-3cf01497b7aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb9d449ec40c4e089bc7ae8b64750f7b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:27.053892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-56041a07-fab7-41e1-8fa4-3cf01497b7aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb9d449ec40c4e089bc7ae8b64750f7b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:27.086826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-56041a07-fab7-41e1-8fa4-3cf01497b7aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb9d449ec40c4e089bc7ae8b64750f7b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:27.107655 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1189/2370] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:10:26 2022] DELETE /identity/v3/users/eb9d449ec40c4e089bc7ae8b64750f7b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:10:27.114381 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166680fd-1733-471e-a06c-894087461ec1 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:27.114381 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166680fd-1733-471e-a06c-894087461ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:27.114381 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166680fd-1733-471e-a06c-894087461ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:27.128379 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:27.159367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-166680fd-1733-471e-a06c-894087461ec1 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:27.163262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1182/2371] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:27.163397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-166680fd-1733-471e-a06c-894087461ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:27.176095 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb89ae0-a7bb-4d3c-9163-cdb9b121ec8e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:27.178529 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bbb89ae0-a7bb-4d3c-9163-cdb9b121ec8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:27.286642 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1190/2372] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:10:27.312002 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166680fd-1733-471e-a06c-894087461ec1 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:27.319063 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-166680fd-1733-471e-a06c-894087461ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:27.340520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb89ae0-a7bb-4d3c-9163-cdb9b121ec8e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:27.458775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166680fd-1733-471e-a06c-894087461ec1 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:27.465945 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9ed2c-9d2a-4d2f-b40c-8c1ff0878940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:27.467476 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9ed2c-9d2a-4d2f-b40c-8c1ff0878940 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:27.468013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9ed2c-9d2a-4d2f-b40c-8c1ff0878940 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:27.468396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9ed2c-9d2a-4d2f-b40c-8c1ff0878940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:27.483919 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9ed2c-9d2a-4d2f-b40c-8c1ff0878940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:27.486434 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9ed2c-9d2a-4d2f-b40c-8c1ff0878940 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:27.498570 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f362f-52bb-488a-b3a1-989779a62881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:27.499984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f362f-52bb-488a-b3a1-989779a62881 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:27.500414 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f362f-52bb-488a-b3a1-989779a62881 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:27.500608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1191/2373] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:27.501021 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f362f-52bb-488a-b3a1-989779a62881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:27.526813 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f362f-52bb-488a-b3a1-989779a62881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:27.528757 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f362f-52bb-488a-b3a1-989779a62881 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:27.549944 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1183/2374] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:28.406903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9ed2c-9d2a-4d2f-b40c-8c1ff0878940 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:28.408709 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-83e9ed2c-9d2a-4d2f-b40c-8c1ff0878940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:28.424648 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:28.441336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9ed2c-9d2a-4d2f-b40c-8c1ff0878940 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:28.444307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f362f-52bb-488a-b3a1-989779a62881 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:28.446076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-924f362f-52bb-488a-b3a1-989779a62881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:28.467701 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fff041-ab60-4e6c-94a2-ccfea5a775ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:28.468605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fff041-ab60-4e6c-94a2-ccfea5a775ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:28.468883 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fff041-ab60-4e6c-94a2-ccfea5a775ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:28.469154 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fff041-ab60-4e6c-94a2-ccfea5a775ef admin admin] PATH_INFO: `/v3/projects/a58e814962c9491487d3b721fb394c95` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:28.475005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f362f-52bb-488a-b3a1-989779a62881 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:28.477660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fff041-ab60-4e6c-94a2-ccfea5a775ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58e814962c9491487d3b721fb394c95)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:28.486348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fff041-ab60-4e6c-94a2-ccfea5a775ef admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:28.500571 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d9161-dd52-4eeb-a285-3975bd4a283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:28.502314 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d9161-dd52-4eeb-a285-3975bd4a283f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:28.503779 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d9161-dd52-4eeb-a285-3975bd4a283f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:28.504221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d9161-dd52-4eeb-a285-3975bd4a283f admin admin] PATH_INFO: `/v3/projects/d3a4747a74f14e78820b17992358c906` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:28.514294 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d9161-dd52-4eeb-a285-3975bd4a283f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a4747a74f14e78820b17992358c906)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:28.526620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d9161-dd52-4eeb-a285-3975bd4a283f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:28.663076 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a0fff041-ab60-4e6c-94a2-ccfea5a775ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58e814962c9491487d3b721fb394c95', 'request_id': 'req-a0fff041-ab60-4e6c-94a2-ccfea5a775ef'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:28.689565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a0fff041-ab60-4e6c-94a2-ccfea5a775ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58e814962c9491487d3b721fb394c95', 'request_id': 'req-a0fff041-ab60-4e6c-94a2-ccfea5a775ef'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:28.697776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8b7d9161-dd52-4eeb-a285-3975bd4a283f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a4747a74f14e78820b17992358c906', 'request_id': 'req-8b7d9161-dd52-4eeb-a285-3975bd4a283f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:28.705916 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a0fff041-ab60-4e6c-94a2-ccfea5a775ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58e814962c9491487d3b721fb394c95', 'request_id': 'req-a0fff041-ab60-4e6c-94a2-ccfea5a775ef'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:28.727403 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8b7d9161-dd52-4eeb-a285-3975bd4a283f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a4747a74f14e78820b17992358c906', 'request_id': 'req-8b7d9161-dd52-4eeb-a285-3975bd4a283f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:28.758569 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8b7d9161-dd52-4eeb-a285-3975bd4a283f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a4747a74f14e78820b17992358c906', 'request_id': 'req-8b7d9161-dd52-4eeb-a285-3975bd4a283f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:28.775371 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a0fff041-ab60-4e6c-94a2-ccfea5a775ef admin admin] The token cache is being invalidate because project a58e814962c9491487d3b721fb394c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:10:28.776013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a0fff041-ab60-4e6c-94a2-ccfea5a775ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:28.777358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a0fff041-ab60-4e6c-94a2-ccfea5a775ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:28.779511 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1192/2375] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:10:28 2022] DELETE /identity/v3/projects/a58e814962c9491487d3b721fb394c95 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:28.785950 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a4235-f6b3-43ab-84f6-f468841d3fd4 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:28.786478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a4235-f6b3-43ab-84f6-f468841d3fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:28.786931 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a4235-f6b3-43ab-84f6-f468841d3fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:28.792599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8b7d9161-dd52-4eeb-a285-3975bd4a283f admin admin] The token cache is being invalidate because project d3a4747a74f14e78820b17992358c906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:10:28.792898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8b7d9161-dd52-4eeb-a285-3975bd4a283f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:28.793727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8b7d9161-dd52-4eeb-a285-3975bd4a283f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:28.795892 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1184/2376] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:10:28 2022] DELETE /identity/v3/projects/d3a4747a74f14e78820b17992358c906 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:28.828003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-433a4235-f6b3-43ab-84f6-f468841d3fd4 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:28.829918 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-433a4235-f6b3-43ab-84f6-f468841d3fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:28.926472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1193/2377] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:28.928605 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc4e4-4f3a-4eb1-af05-244407d4568d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:28.928605 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc4e4-4f3a-4eb1-af05-244407d4568d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:28.928899 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc4e4-4f3a-4eb1-af05-244407d4568d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:28.956833 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-166fc4e4-4f3a-4eb1-af05-244407d4568d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:28.958962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-166fc4e4-4f3a-4eb1-af05-244407d4568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:28.985742 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1185/2378] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:28.987041 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a4235-f6b3-43ab-84f6-f468841d3fd4 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:29.002911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a4235-f6b3-43ab-84f6-f468841d3fd4 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:29.014267 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d85e4-65aa-41b8-8051-6cd93cd7d133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:29.015151 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d85e4-65aa-41b8-8051-6cd93cd7d133 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:29.015623 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d85e4-65aa-41b8-8051-6cd93cd7d133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:29.015914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d85e4-65aa-41b8-8051-6cd93cd7d133 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:29.017137 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d85e4-65aa-41b8-8051-6cd93cd7d133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:10:29.017137 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d85e4-65aa-41b8-8051-6cd93cd7d133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:29.023001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d85e4-65aa-41b8-8051-6cd93cd7d133 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:29.046207 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1194/2379] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:10:29.050245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fc4e4-4f3a-4eb1-af05-244407d4568d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:29.062843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fc4e4-4f3a-4eb1-af05-244407d4568d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:29.078653 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecec95-7594-4e5d-997e-0435fc2159ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:29.078653 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecec95-7594-4e5d-997e-0435fc2159ee admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:29.078653 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecec95-7594-4e5d-997e-0435fc2159ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:29.078653 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecec95-7594-4e5d-997e-0435fc2159ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:29.079397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecec95-7594-4e5d-997e-0435fc2159ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:29.080999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecec95-7594-4e5d-997e-0435fc2159ee admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:29.126200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1186/2380] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:10:29 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:10:29.130407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d85e4-65aa-41b8-8051-6cd93cd7d133 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:29.143096 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d85e4-65aa-41b8-8051-6cd93cd7d133 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:29.255728 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71420d6c-2e29-418d-b2ca-24f4fbfef506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:29.256902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71420d6c-2e29-418d-b2ca-24f4fbfef506 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:29.257715 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71420d6c-2e29-418d-b2ca-24f4fbfef506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:29.258313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71420d6c-2e29-418d-b2ca-24f4fbfef506 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:29.259247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71420d6c-2e29-418d-b2ca-24f4fbfef506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:29.261664 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71420d6c-2e29-418d-b2ca-24f4fbfef506 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:29.273502 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:29.308829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1195/2381] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:10:29 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:10:29.309556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecec95-7594-4e5d-997e-0435fc2159ee admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:29.322280 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecec95-7594-4e5d-997e-0435fc2159ee admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:29.328256 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3a42f-83c6-4809-a4d7-ebd6a5eb5dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:29.330286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3a42f-83c6-4809-a4d7-ebd6a5eb5dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:29.330777 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3a42f-83c6-4809-a4d7-ebd6a5eb5dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:29.331221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3a42f-83c6-4809-a4d7-ebd6a5eb5dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:29.332164 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3a42f-83c6-4809-a4d7-ebd6a5eb5dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:29.334206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3a42f-83c6-4809-a4d7-ebd6a5eb5dc7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:29.337830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:29.354009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71420d6c-2e29-418d-b2ca-24f4fbfef506 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:29.365402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1187/2382] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:10:29.367280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71420d6c-2e29-418d-b2ca-24f4fbfef506 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:29.407513 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b67b37-edb0-4abf-a521-fe3ac02fc075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:29.408295 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67b37-edb0-4abf-a521-fe3ac02fc075 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:29.408583 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67b37-edb0-4abf-a521-fe3ac02fc075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:29.408859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67b37-edb0-4abf-a521-fe3ac02fc075 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:29.412586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b67b37-edb0-4abf-a521-fe3ac02fc075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:29.412586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b67b37-edb0-4abf-a521-fe3ac02fc075 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:29.428283 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1196/2383] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:10:29.430316 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3a42f-83c6-4809-a4d7-ebd6a5eb5dc7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:29.442154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3a42f-83c6-4809-a4d7-ebd6a5eb5dc7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:29.448985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9290e-068f-410b-bbd5-e44f6db0d271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:29.450251 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9290e-068f-410b-bbd5-e44f6db0d271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:29.454564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9290e-068f-410b-bbd5-e44f6db0d271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:29.455271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9290e-068f-410b-bbd5-e44f6db0d271 admin admin] PATH_INFO: `/v3/projects/3f02331f8305411599603bc2720f32d4/users/b8be2fe356184800bc704a7f98055005/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:29.483690 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9290e-068f-410b-bbd5-e44f6db0d271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f02331f8305411599603bc2720f32d4, user_id=b8be2fe356184800bc704a7f98055005, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:29.486582 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9290e-068f-410b-bbd5-e44f6db0d271 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:29.513580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1188/2384] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:10:29 2022] PUT /identity/v3/projects/3f02331f8305411599603bc2720f32d4/users/b8be2fe356184800bc704a7f98055005/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:29.527097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c09ad-df2b-4227-b9e7-e56bc7aaa13a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:29.527097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c09ad-df2b-4227-b9e7-e56bc7aaa13a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:29.527653 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c09ad-df2b-4227-b9e7-e56bc7aaa13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:29.576079 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-fa9c09ad-df2b-4227-b9e7-e56bc7aaa13a None None] MFA Rules not processed for user `b8be2fe356184800bc704a7f98055005`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:29.577458 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fa9c09ad-df2b-4227-b9e7-e56bc7aaa13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:29.704479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1197/2385] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:29.714933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9290e-068f-410b-bbd5-e44f6db0d271 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:29.718309 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f8d9290e-068f-410b-bbd5-e44f6db0d271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:29.834070 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9290e-068f-410b-bbd5-e44f6db0d271 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:29.844480 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699fa25-98e0-4a39-bccb-e655f21be857 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:29.845197 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699fa25-98e0-4a39-bccb-e655f21be857 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:29.845656 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699fa25-98e0-4a39-bccb-e655f21be857 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:29.846022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699fa25-98e0-4a39-bccb-e655f21be857 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:29.861701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699fa25-98e0-4a39-bccb-e655f21be857 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:29.864199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699fa25-98e0-4a39-bccb-e655f21be857 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:29.908330 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1189/2386] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:32.881374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4989f-0d9a-4b6c-9894-a38ac75afb89 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:32.882046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4989f-0d9a-4b6c-9894-a38ac75afb89 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:32.882046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4989f-0d9a-4b6c-9894-a38ac75afb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:32.911133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-17c4989f-0d9a-4b6c-9894-a38ac75afb89 None None] MFA Rules not processed for user `c1f33c40207e4701bb5bbd680d729c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:32.913191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-17c4989f-0d9a-4b6c-9894-a38ac75afb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:32.998626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1198/2387] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:37.952302 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830580e0-126f-4c8f-998f-052a403d8a7c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:37.952895 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830580e0-126f-4c8f-998f-052a403d8a7c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:37.952895 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830580e0-126f-4c8f-998f-052a403d8a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:37.974853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-830580e0-126f-4c8f-998f-052a403d8a7c None None] MFA Rules not processed for user `796103c08e1747e88d5ed270d2e8c70f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:37.976247 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-830580e0-126f-4c8f-998f-052a403d8a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:38.136843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1190/2388] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:39.971668 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd07eb-6293-441e-b483-ec8efcead7d8 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:39.972212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd07eb-6293-441e-b483-ec8efcead7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:39.972311 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd07eb-6293-441e-b483-ec8efcead7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:40.003740 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-19cd07eb-6293-441e-b483-ec8efcead7d8 None None] MFA Rules not processed for user `3953b14656774edb92da1ecdb4bbbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:40.005116 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-19cd07eb-6293-441e-b483-ec8efcead7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:40.072016 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1199/2389] 10.222.0.61 () {58 vars in 1009 bytes} [Thu May 26 21:10:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:40.085064 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830580e0-126f-4c8f-998f-052a403d8a7c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:40.086653 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-830580e0-126f-4c8f-998f-052a403d8a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:40.220093 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830580e0-126f-4c8f-998f-052a403d8a7c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:40.236831 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec575e4-45f2-4faa-b9ac-8b9b3bd512a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a63879ec1242d08bba1ccad6212788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:40.240406 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec575e4-45f2-4faa-b9ac-8b9b3bd512a4 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:40.240699 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec575e4-45f2-4faa-b9ac-8b9b3bd512a4 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:40.240983 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec575e4-45f2-4faa-b9ac-8b9b3bd512a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:40.250855 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec575e4-45f2-4faa-b9ac-8b9b3bd512a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:40.252471 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec575e4-45f2-4faa-b9ac-8b9b3bd512a4 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:40.263305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1191/2390] 10.222.0.61 () {60 vars in 1384 bytes} [Thu May 26 21:10:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:10:41.207670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edb0cc-edb6-47be-8ec1-38127f707309 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:41.208211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edb0cc-edb6-47be-8ec1-38127f707309 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:41.208211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edb0cc-edb6-47be-8ec1-38127f707309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:41.236538 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:41.252199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-c3edb0cc-edb6-47be-8ec1-38127f707309 None None] MFA Rules not processed for user `3953b14656774edb92da1ecdb4bbbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:41.256636 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c3edb0cc-edb6-47be-8ec1-38127f707309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:41.284859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1200/2391] 10.222.0.61 () {58 vars in 1009 bytes} [Thu May 26 21:10:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:41.324516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec575e4-45f2-4faa-b9ac-8b9b3bd512a4 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:41.346502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec575e4-45f2-4faa-b9ac-8b9b3bd512a4 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:41.354756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e09b1e-a7cb-49e0-84ac-d620b376dab9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a63879ec1242d08bba1ccad6212788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:41.355850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e09b1e-a7cb-49e0-84ac-d620b376dab9 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:41.356336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e09b1e-a7cb-49e0-84ac-d620b376dab9 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:41.356818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e09b1e-a7cb-49e0-84ac-d620b376dab9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:41.365149 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:41.370524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e09b1e-a7cb-49e0-84ac-d620b376dab9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:41.372938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e09b1e-a7cb-49e0-84ac-d620b376dab9 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:41.386285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1192/2392] 10.222.0.61 () {60 vars in 1384 bytes} [Thu May 26 21:10:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:10:41.579078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edb0cc-edb6-47be-8ec1-38127f707309 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:41.793520 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edb0cc-edb6-47be-8ec1-38127f707309 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:41.807367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2c1ce-88fe-429a-91a3-162dfae3b721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:41.808449 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c1ce-88fe-429a-91a3-162dfae3b721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:41.808846 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c1ce-88fe-429a-91a3-162dfae3b721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:41.809225 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c1ce-88fe-429a-91a3-162dfae3b721 admin admin] PATH_INFO: `/v3/users/b8be2fe356184800bc704a7f98055005` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:41.812913 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2c1ce-88fe-429a-91a3-162dfae3b721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8be2fe356184800bc704a7f98055005)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:41.817156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2c1ce-88fe-429a-91a3-162dfae3b721 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:41.939081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d0b2c1ce-88fe-429a-91a3-162dfae3b721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8be2fe356184800bc704a7f98055005'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:41.987827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d0b2c1ce-88fe-429a-91a3-162dfae3b721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8be2fe356184800bc704a7f98055005'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:41.988930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d0b2c1ce-88fe-429a-91a3-162dfae3b721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8be2fe356184800bc704a7f98055005'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:42.013962 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d0b2c1ce-88fe-429a-91a3-162dfae3b721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8be2fe356184800bc704a7f98055005'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:42.039846 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d0b2c1ce-88fe-429a-91a3-162dfae3b721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8be2fe356184800bc704a7f98055005'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:42.051682 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1201/2393] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:10:41 2022] DELETE /identity/v3/users/b8be2fe356184800bc704a7f98055005 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:42.056366 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e555c-5fda-4ec1-9d45-0719e53c961a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:42.056663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e555c-5fda-4ec1-9d45-0719e53c961a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:42.056951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e555c-5fda-4ec1-9d45-0719e53c961a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:42.098710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-974e555c-5fda-4ec1-9d45-0719e53c961a None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:42.100350 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-974e555c-5fda-4ec1-9d45-0719e53c961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:42.293403 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1193/2394] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:42.304207 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2c1ce-88fe-429a-91a3-162dfae3b721 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:42.307016 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d0b2c1ce-88fe-429a-91a3-162dfae3b721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:42.474997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2c1ce-88fe-429a-91a3-162dfae3b721 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:42.487186 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0362bb4-467d-4191-8188-e354c1597c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:42.488007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0362bb4-467d-4191-8188-e354c1597c4e service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:42.488388 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0362bb4-467d-4191-8188-e354c1597c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:42.488837 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0362bb4-467d-4191-8188-e354c1597c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:42.512404 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0362bb4-467d-4191-8188-e354c1597c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:42.516197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0362bb4-467d-4191-8188-e354c1597c4e service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:42.552666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1202/2395] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:43.858194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e555c-5fda-4ec1-9d45-0719e53c961a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:43.859791 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-974e555c-5fda-4ec1-9d45-0719e53c961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:43.878006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e555c-5fda-4ec1-9d45-0719e53c961a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:43.893683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697c885-50a6-4f28-8cda-07612e79b22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:43.894623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697c885-50a6-4f28-8cda-07612e79b22c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:43.894901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697c885-50a6-4f28-8cda-07612e79b22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:43.895177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697c885-50a6-4f28-8cda-07612e79b22c admin admin] PATH_INFO: `/v3/projects/3f02331f8305411599603bc2720f32d4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:43.898740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697c885-50a6-4f28-8cda-07612e79b22c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f02331f8305411599603bc2720f32d4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:43.903794 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697c885-50a6-4f28-8cda-07612e79b22c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:44.115880 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a697c885-50a6-4f28-8cda-07612e79b22c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f02331f8305411599603bc2720f32d4', 'request_id': 'req-a697c885-50a6-4f28-8cda-07612e79b22c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:44.133757 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a697c885-50a6-4f28-8cda-07612e79b22c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f02331f8305411599603bc2720f32d4', 'request_id': 'req-a697c885-50a6-4f28-8cda-07612e79b22c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:44.145214 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a697c885-50a6-4f28-8cda-07612e79b22c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f02331f8305411599603bc2720f32d4', 'request_id': 'req-a697c885-50a6-4f28-8cda-07612e79b22c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:44.168448 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a697c885-50a6-4f28-8cda-07612e79b22c admin admin] The token cache is being invalidate because project 3f02331f8305411599603bc2720f32d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:10:44.168690 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a697c885-50a6-4f28-8cda-07612e79b22c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:44.170288 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a697c885-50a6-4f28-8cda-07612e79b22c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:44.176768 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1194/2396] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:10:43 2022] DELETE /identity/v3/projects/3f02331f8305411599603bc2720f32d4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:44.178709 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a0168-dd9b-40a4-8800-2662f2dc88c2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:44.179338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a0168-dd9b-40a4-8800-2662f2dc88c2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:44.179338 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a0168-dd9b-40a4-8800-2662f2dc88c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:44.217876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-c73a0168-dd9b-40a4-8800-2662f2dc88c2 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:44.219131 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c73a0168-dd9b-40a4-8800-2662f2dc88c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:44.256157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:44.361081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1203/2397] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:44.362905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43aa233-4ec2-4269-959e-a371486ec5e5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:44.363202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43aa233-4ec2-4269-959e-a371486ec5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:44.363473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43aa233-4ec2-4269-959e-a371486ec5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:44.405695 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d43aa233-4ec2-4269-959e-a371486ec5e5 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:44.406979 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d43aa233-4ec2-4269-959e-a371486ec5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:44.419290 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1195/2398] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:10:44.420973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a0168-dd9b-40a4-8800-2662f2dc88c2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:44.434261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a0168-dd9b-40a4-8800-2662f2dc88c2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:44.439861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e16d74-a8e4-4ad8-acb0-f691f599b48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:44.441125 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e16d74-a8e4-4ad8-acb0-f691f599b48b admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:44.441723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e16d74-a8e4-4ad8-acb0-f691f599b48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:44.442264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e16d74-a8e4-4ad8-acb0-f691f599b48b admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:44.443243 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e16d74-a8e4-4ad8-acb0-f691f599b48b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:10:44.443768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e16d74-a8e4-4ad8-acb0-f691f599b48b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:44.445699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e16d74-a8e4-4ad8-acb0-f691f599b48b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:44.470364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1204/2399] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:10:44.472147 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43aa233-4ec2-4269-959e-a371486ec5e5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:44.487639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43aa233-4ec2-4269-959e-a371486ec5e5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:44.500539 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0708f-1919-443e-9674-a239727866a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:44.502402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0708f-1919-443e-9674-a239727866a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:44.502953 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0708f-1919-443e-9674-a239727866a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:44.506007 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0708f-1919-443e-9674-a239727866a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:44.507078 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0708f-1919-443e-9674-a239727866a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:44.512599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0708f-1919-443e-9674-a239727866a9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:44.599075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e16d74-a8e4-4ad8-acb0-f691f599b48b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:44.606364 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1196/2400] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:10:44 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:10:44.617187 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e16d74-a8e4-4ad8-acb0-f691f599b48b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:44.825780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c36c8-12c1-4855-8e1b-466a0b4555e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:44.826974 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c36c8-12c1-4855-8e1b-466a0b4555e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:44.827423 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c36c8-12c1-4855-8e1b-466a0b4555e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:44.827874 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c36c8-12c1-4855-8e1b-466a0b4555e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:44.829540 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c36c8-12c1-4855-8e1b-466a0b4555e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:44.835827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c36c8-12c1-4855-8e1b-466a0b4555e5 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:44.889756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1205/2401] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:10:44 2022] POST /identity/v3/users => generated 295 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:10:44.893737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0708f-1919-443e-9674-a239727866a9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:44.910478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0708f-1919-443e-9674-a239727866a9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:44.938239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2596a9-d726-434f-ac72-c0e7c6fd7e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:44.942780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2596a9-d726-434f-ac72-c0e7c6fd7e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:44.943227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2596a9-d726-434f-ac72-c0e7c6fd7e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:44.943646 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2596a9-d726-434f-ac72-c0e7c6fd7e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:44.970958 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2596a9-d726-434f-ac72-c0e7c6fd7e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:44.973609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2596a9-d726-434f-ac72-c0e7c6fd7e96 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:45.019419 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1197/2402] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:10:45.023790 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c36c8-12c1-4855-8e1b-466a0b4555e5 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:45.045637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c36c8-12c1-4855-8e1b-466a0b4555e5 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:45.050602 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4de21-d1b5-45a8-931f-80f136e6da9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:45.051558 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4de21-d1b5-45a8-931f-80f136e6da9e admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:45.051703 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4de21-d1b5-45a8-931f-80f136e6da9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:45.051853 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4de21-d1b5-45a8-931f-80f136e6da9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:45.061242 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4de21-d1b5-45a8-931f-80f136e6da9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:45.063456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4de21-d1b5-45a8-931f-80f136e6da9e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:45.088944 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2596a9-d726-434f-ac72-c0e7c6fd7e96 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:45.089410 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1206/2403] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:10:45.106059 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2596a9-d726-434f-ac72-c0e7c6fd7e96 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:45.115409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e74328-3bd4-42ad-8cd8-34ad4023ab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:45.117415 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e74328-3bd4-42ad-8cd8-34ad4023ab3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:45.118360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e74328-3bd4-42ad-8cd8-34ad4023ab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:45.118360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e74328-3bd4-42ad-8cd8-34ad4023ab3a admin admin] PATH_INFO: `/v3/projects/03b09fe2224547069c51e20d43897848/users/e2189f28a89f48ee84a387fd145ae62d/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:45.177059 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e74328-3bd4-42ad-8cd8-34ad4023ab3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b09fe2224547069c51e20d43897848, user_id=e2189f28a89f48ee84a387fd145ae62d, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:45.180289 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e74328-3bd4-42ad-8cd8-34ad4023ab3a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:45.210830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1198/2404] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:10:45 2022] PUT /identity/v3/projects/03b09fe2224547069c51e20d43897848/users/e2189f28a89f48ee84a387fd145ae62d/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:45.227697 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335c97b-2e3f-4aa0-8a3d-131b9c30c288 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:45.228257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335c97b-2e3f-4aa0-8a3d-131b9c30c288 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:45.228257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335c97b-2e3f-4aa0-8a3d-131b9c30c288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:45.347653 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3335c97b-2e3f-4aa0-8a3d-131b9c30c288 None None] MFA Rules not processed for user `e2189f28a89f48ee84a387fd145ae62d`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:45.349192 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3335c97b-2e3f-4aa0-8a3d-131b9c30c288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:45.567409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1207/2405] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:45.583239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e74328-3bd4-42ad-8cd8-34ad4023ab3a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:45.586834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-17e74328-3bd4-42ad-8cd8-34ad4023ab3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:45.656298 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:45.891170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e74328-3bd4-42ad-8cd8-34ad4023ab3a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:45.895614 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea1c31-1a29-47dd-aeac-d887eaa5343b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:45.896310 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea1c31-1a29-47dd-aeac-d887eaa5343b service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:45.896570 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea1c31-1a29-47dd-aeac-d887eaa5343b service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:45.896848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea1c31-1a29-47dd-aeac-d887eaa5343b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:45.916411 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea1c31-1a29-47dd-aeac-d887eaa5343b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:45.917831 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea1c31-1a29-47dd-aeac-d887eaa5343b service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:45.934609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1199/2406] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:55.559796 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:55.925172 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=28 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:10:57.875985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335c97b-2e3f-4aa0-8a3d-131b9c30c288 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:57.994483 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335c97b-2e3f-4aa0-8a3d-131b9c30c288 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:57.999864 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dfae0-0d57-4ceb-a2c7-7605c07ab656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:58.000916 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dfae0-0d57-4ceb-a2c7-7605c07ab656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:58.001282 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dfae0-0d57-4ceb-a2c7-7605c07ab656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:58.001638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dfae0-0d57-4ceb-a2c7-7605c07ab656 admin admin] PATH_INFO: `/v3/users/e2189f28a89f48ee84a387fd145ae62d` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:58.003270 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dfae0-0d57-4ceb-a2c7-7605c07ab656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2189f28a89f48ee84a387fd145ae62d)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:58.005558 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dfae0-0d57-4ceb-a2c7-7605c07ab656 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:58.102878 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b40dfae0-0d57-4ceb-a2c7-7605c07ab656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2189f28a89f48ee84a387fd145ae62d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:58.123515 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b40dfae0-0d57-4ceb-a2c7-7605c07ab656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2189f28a89f48ee84a387fd145ae62d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:58.124231 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b40dfae0-0d57-4ceb-a2c7-7605c07ab656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2189f28a89f48ee84a387fd145ae62d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:58.137422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b40dfae0-0d57-4ceb-a2c7-7605c07ab656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2189f28a89f48ee84a387fd145ae62d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:58.151876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b40dfae0-0d57-4ceb-a2c7-7605c07ab656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2189f28a89f48ee84a387fd145ae62d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:58.161706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1208/2407] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:10:57 2022] DELETE /identity/v3/users/e2189f28a89f48ee84a387fd145ae62d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:10:58.166598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7af79e-ca7f-487f-a51b-25b895e6705c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:58.167574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7af79e-ca7f-487f-a51b-25b895e6705c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:58.168031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7af79e-ca7f-487f-a51b-25b895e6705c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:58.197202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6c7af79e-ca7f-487f-a51b-25b895e6705c None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:10:58.199170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6c7af79e-ca7f-487f-a51b-25b895e6705c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:58.283516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1200/2408] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:10:58.306569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dfae0-0d57-4ceb-a2c7-7605c07ab656 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:58.308160 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b40dfae0-0d57-4ceb-a2c7-7605c07ab656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:58.397426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dfae0-0d57-4ceb-a2c7-7605c07ab656 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:58.401508 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436468e-a465-4283-8bad-93428d5774e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:58.402240 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436468e-a465-4283-8bad-93428d5774e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:58.402526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436468e-a465-4283-8bad-93428d5774e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:58.402801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436468e-a465-4283-8bad-93428d5774e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:58.414952 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436468e-a465-4283-8bad-93428d5774e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:58.417116 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436468e-a465-4283-8bad-93428d5774e7 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:58.430320 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1209/2409] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:10:58.825460 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7af79e-ca7f-487f-a51b-25b895e6705c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:10:58.827446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6c7af79e-ca7f-487f-a51b-25b895e6705c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:10:58.844626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7af79e-ca7f-487f-a51b-25b895e6705c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:10:58.851764 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baed6a-0952-4dd5-ab21-f89eec77dbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:10:58.852834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baed6a-0952-4dd5-ab21-f89eec77dbfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:10:58.853123 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baed6a-0952-4dd5-ab21-f89eec77dbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:10:58.854232 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baed6a-0952-4dd5-ab21-f89eec77dbfb admin admin] PATH_INFO: `/v3/projects/03b09fe2224547069c51e20d43897848` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:10:58.856828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baed6a-0952-4dd5-ab21-f89eec77dbfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b09fe2224547069c51e20d43897848)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:10:58.860830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baed6a-0952-4dd5-ab21-f89eec77dbfb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:10:58.937806 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-30baed6a-0952-4dd5-ab21-f89eec77dbfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b09fe2224547069c51e20d43897848', 'request_id': 'req-30baed6a-0952-4dd5-ab21-f89eec77dbfb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:58.948696 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-30baed6a-0952-4dd5-ab21-f89eec77dbfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b09fe2224547069c51e20d43897848', 'request_id': 'req-30baed6a-0952-4dd5-ab21-f89eec77dbfb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:58.958068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-30baed6a-0952-4dd5-ab21-f89eec77dbfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b09fe2224547069c51e20d43897848', 'request_id': 'req-30baed6a-0952-4dd5-ab21-f89eec77dbfb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:58.973353 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-30baed6a-0952-4dd5-ab21-f89eec77dbfb admin admin] The token cache is being invalidate because project 03b09fe2224547069c51e20d43897848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:10:58.973689 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-30baed6a-0952-4dd5-ab21-f89eec77dbfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:58.974417 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-30baed6a-0952-4dd5-ab21-f89eec77dbfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:10:58.976460 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1201/2410] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:10:58 2022] DELETE /identity/v3/projects/03b09fe2224547069c51e20d43897848 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:11:02.723281 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9818be4-99f8-42f6-9f93-8926b80be3ab None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:11:02.724246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9818be4-99f8-42f6-9f93-8926b80be3ab None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:11:02.724940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9818be4-99f8-42f6-9f93-8926b80be3ab None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:11:02.727440 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1210/2411] 10.222.0.61 () {54 vars in 921 bytes} [Thu May 26 21:11:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:11:02.734328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9d1ab-3065-4014-8a40-2ad274933836 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:11:02.734882 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9d1ab-3065-4014-8a40-2ad274933836 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:11:02.734882 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9d1ab-3065-4014-8a40-2ad274933836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:11:02.809525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-eaf9d1ab-3065-4014-8a40-2ad274933836 None None] MFA Rules not processed for user `a99b767501244338bc48fb5428a589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:11:02.810700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-eaf9d1ab-3065-4014-8a40-2ad274933836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:11:02.879479 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:11:02.919679 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1202/2412] 10.222.0.61 () {58 vars in 1018 bytes} [Thu May 26 21:11:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:11:02.939310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9818be4-99f8-42f6-9f93-8926b80be3ab None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:11:02.941441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d9818be4-99f8-42f6-9f93-8926b80be3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:11:02.973638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:11:03.034131 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9818be4-99f8-42f6-9f93-8926b80be3ab None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:11:03.038789 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efdd7f-49f2-4c00-8f7f-1265e70bfe4d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7e1c8c42cd4f6dab8b27829e5fc5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:11:03.039461 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efdd7f-49f2-4c00-8f7f-1265e70bfe4d service glance] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:11:03.039747 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efdd7f-49f2-4c00-8f7f-1265e70bfe4d service glance] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:11:03.040025 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efdd7f-49f2-4c00-8f7f-1265e70bfe4d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:11:03.051485 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efdd7f-49f2-4c00-8f7f-1265e70bfe4d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:11:03.052964 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efdd7f-49f2-4c00-8f7f-1265e70bfe4d service glance] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:11:03.064449 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1211/2413] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:11:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:11:03.144167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f67677-37d4-4673-a572-b93532b0f14b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:11:03.144644 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f67677-37d4-4673-a572-b93532b0f14b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:11:03.144985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f67677-37d4-4673-a572-b93532b0f14b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:11:03.147514 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1203/2414] 10.222.0.61 () {54 vars in 921 bytes} [Thu May 26 21:11:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:11:03.153443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f4338-8629-4b3c-81cd-cbc00c55db21 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:11:03.153746 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f4338-8629-4b3c-81cd-cbc00c55db21 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:11:03.154092 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f4338-8629-4b3c-81cd-cbc00c55db21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:11:03.177022 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-703f4338-8629-4b3c-81cd-cbc00c55db21 None None] MFA Rules not processed for user `e3514a1833104114894abe6c41ea30a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:11:03.178325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-703f4338-8629-4b3c-81cd-cbc00c55db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:11:03.239009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1212/2415] 10.222.0.61 () {58 vars in 1018 bytes} [Thu May 26 21:11:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:11:03.251511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f67677-37d4-4673-a572-b93532b0f14b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:11:03.253595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d2f67677-37d4-4673-a572-b93532b0f14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:11:03.273007 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f67677-37d4-4673-a572-b93532b0f14b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:11:03.276742 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7020a-9ccb-4952-acdf-5792b9f625fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:11:03.277517 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7020a-9ccb-4952-acdf-5792b9f625fc service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:11:03.277875 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7020a-9ccb-4952-acdf-5792b9f625fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:11:03.278138 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7020a-9ccb-4952-acdf-5792b9f625fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:11:03.286144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7020a-9ccb-4952-acdf-5792b9f625fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:11:03.287891 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7020a-9ccb-4952-acdf-5792b9f625fc service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:11:03.297048 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1204/2416] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:11:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:11:03.419679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddf773-9f17-4997-9110-ba427be02519 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:11:03.419941 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddf773-9f17-4997-9110-ba427be02519 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:11:03.420246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddf773-9f17-4997-9110-ba427be02519 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:11:03.421647 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1213/2417] 10.222.0.61 () {54 vars in 921 bytes} [Thu May 26 21:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:11:03.427341 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f2975-5ae8-4bf2-b93e-135d303ae2f7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:11:03.427631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f2975-5ae8-4bf2-b93e-135d303ae2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:11:03.427995 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f2975-5ae8-4bf2-b93e-135d303ae2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:11:03.448868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-727f2975-5ae8-4bf2-b93e-135d303ae2f7 None None] MFA Rules not processed for user `a99b767501244338bc48fb5428a589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:11:03.450164 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-727f2975-5ae8-4bf2-b93e-135d303ae2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:11:03.461572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1205/2418] 10.222.0.61 () {58 vars in 1018 bytes} [Thu May 26 21:11:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:11:03.472270 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddf773-9f17-4997-9110-ba427be02519 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:11:03.484956 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddf773-9f17-4997-9110-ba427be02519 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:11:03.489235 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42f29b-35df-4017-859f-ad5283fc789a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:11:03.489930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42f29b-35df-4017-859f-ad5283fc789a service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:11:03.490214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42f29b-35df-4017-859f-ad5283fc789a service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:11:03.490486 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42f29b-35df-4017-859f-ad5283fc789a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:11:03.502904 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42f29b-35df-4017-859f-ad5283fc789a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:11:03.504537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42f29b-35df-4017-859f-ad5283fc789a service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:11:03.517555 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1214/2419] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:11:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:11:06.121234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d6199-6d6f-4bc4-8ae7-2ed90b7120a2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:11:06.121811 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d6199-6d6f-4bc4-8ae7-2ed90b7120a2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:11:06.121811 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d6199-6d6f-4bc4-8ae7-2ed90b7120a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:11:06.180869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6d2d6199-6d6f-4bc4-8ae7-2ed90b7120a2 None None] MFA Rules not processed for user `3953b14656774edb92da1ecdb4bbbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:11:06.182204 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6d2d6199-6d6f-4bc4-8ae7-2ed90b7120a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:11:06.253561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1206/2420] 10.222.0.61 () {58 vars in 1009 bytes} [Thu May 26 21:11:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:11:06.267070 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42f29b-35df-4017-859f-ad5283fc789a service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:11:06.268587 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fc42f29b-35df-4017-859f-ad5283fc789a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:11:06.375230 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42f29b-35df-4017-859f-ad5283fc789a service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:11:06.382651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c762be-2b2d-46df-b066-4e4effcc6adb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a63879ec1242d08bba1ccad6212788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:11:06.383274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c762be-2b2d-46df-b066-4e4effcc6adb service swift] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:11:06.383576 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c762be-2b2d-46df-b066-4e4effcc6adb service swift] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:11:06.383855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c762be-2b2d-46df-b066-4e4effcc6adb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:11:06.395575 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c762be-2b2d-46df-b066-4e4effcc6adb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:11:06.397329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c762be-2b2d-46df-b066-4e4effcc6adb service swift] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:11:06.406701 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1215/2421] 10.222.0.61 () {60 vars in 1384 bytes} [Thu May 26 21:11:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:11:16.249915 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=57 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:11:16.402977 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:11:19.443200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d6199-6d6f-4bc4-8ae7-2ed90b7120a2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:11:19.453888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d6199-6d6f-4bc4-8ae7-2ed90b7120a2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:11:19.458211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f0b71-4267-435a-9e79-e99a5fe10df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:11:19.458953 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f0b71-4267-435a-9e79-e99a5fe10df2 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:11:19.459213 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f0b71-4267-435a-9e79-e99a5fe10df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:11:19.459625 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f0b71-4267-435a-9e79-e99a5fe10df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:11:19.461518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-759f0b71-4267-435a-9e79-e99a5fe10df2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:11:19.527827 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f0b71-4267-435a-9e79-e99a5fe10df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:11:19.529294 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f0b71-4267-435a-9e79-e99a5fe10df2 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:11:19.540327 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1207/2422] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:11:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:11:23.525523 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6089-4aea-42aa-9fb3-22cecdafe93e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:11:23.527707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6089-4aea-42aa-9fb3-22cecdafe93e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:11:23.528694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6089-4aea-42aa-9fb3-22cecdafe93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:11:23.566246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-742f6089-4aea-42aa-9fb3-22cecdafe93e None None] MFA Rules not processed for user `3953b14656774edb92da1ecdb4bbbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:11:23.567591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-742f6089-4aea-42aa-9fb3-22cecdafe93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:11:23.579394 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1216/2423] 10.222.0.61 () {58 vars in 967 bytes} [Thu May 26 21:11:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:11:23.609100 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f0b71-4267-435a-9e79-e99a5fe10df2 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:11:23.634734 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f0b71-4267-435a-9e79-e99a5fe10df2 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:11:23.641102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9255c1e-ba83-4cd5-93c3-ee46177f597f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a63879ec1242d08bba1ccad6212788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:11:23.642122 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9255c1e-ba83-4cd5-93c3-ee46177f597f service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:11:23.642657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9255c1e-ba83-4cd5-93c3-ee46177f597f service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:11:23.643137 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9255c1e-ba83-4cd5-93c3-ee46177f597f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:11:23.657401 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9255c1e-ba83-4cd5-93c3-ee46177f597f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:11:23.659265 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9255c1e-ba83-4cd5-93c3-ee46177f597f service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:11:23.671804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1208/2424] 10.222.0.61 () {60 vars in 1384 bytes} [Thu May 26 21:11:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:11:33.557539 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:11:33.666991 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=36 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:11:57.047629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a38b14-c0fe-4fbb-9503-c894b1d70e67 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:11:57.048527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a38b14-c0fe-4fbb-9503-c894b1d70e67 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:11:57.048527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a38b14-c0fe-4fbb-9503-c894b1d70e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:11:57.070049 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f6a38b14-c0fe-4fbb-9503-c894b1d70e67 None None] MFA Rules not processed for user `c1f33c40207e4701bb5bbd680d729c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:11:57.072089 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f6a38b14-c0fe-4fbb-9503-c894b1d70e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:11:57.170901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1217/2425] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:11:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:12:07.162694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=25 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:09.012647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9255c1e-ba83-4cd5-93c3-ee46177f597f service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:12:09.016945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d9255c1e-ba83-4cd5-93c3-ee46177f597f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:09.186904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9255c1e-ba83-4cd5-93c3-ee46177f597f service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:12:09.197161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db2788-70a2-4bd0-9c7a-95ee0dae1203 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8952f35c21c4a2eaf1fbc601fe76242', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:12:09.199018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db2788-70a2-4bd0-9c7a-95ee0dae1203 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:09.199651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db2788-70a2-4bd0-9c7a-95ee0dae1203 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:09.200063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db2788-70a2-4bd0-9c7a-95ee0dae1203 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:09.203110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-11db2788-70a2-4bd0-9c7a-95ee0dae1203 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:09.220482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db2788-70a2-4bd0-9c7a-95ee0dae1203 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:12:09.222155 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db2788-70a2-4bd0-9c7a-95ee0dae1203 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:12:09.238932 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1209/2426] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:12:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:12:13.126446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade13f1-cee6-4d2d-9696-491c4561dbc0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:13.127293 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade13f1-cee6-4d2d-9696-491c4561dbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:13.127293 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade13f1-cee6-4d2d-9696-491c4561dbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:13.146420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-fade13f1-cee6-4d2d-9696-491c4561dbc0 None None] MFA Rules not processed for user `5cec6311f0fb4d908877ebdb7236ef21`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:13.147660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fade13f1-cee6-4d2d-9696-491c4561dbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:13.215212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1218/2427] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:12:19.229526 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=41 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:23.204544 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=25 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:12:49.659158 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512477c7-3d6b-43bc-8b8f-ab7322d109df None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:49.660049 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512477c7-3d6b-43bc-8b8f-ab7322d109df None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:49.661078 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512477c7-3d6b-43bc-8b8f-ab7322d109df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:49.684832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-512477c7-3d6b-43bc-8b8f-ab7322d109df None None] MFA Rules not processed for user `f215554a96e0461aa1dc78f930586cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:49.686114 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-512477c7-3d6b-43bc-8b8f-ab7322d109df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:49.753527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1210/2428] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:12:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:12:55.312402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef197212-c9cc-45fb-b9ad-044c4053f529 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:55.313500 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef197212-c9cc-45fb-b9ad-044c4053f529 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:55.313962 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef197212-c9cc-45fb-b9ad-044c4053f529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:55.367690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ef197212-c9cc-45fb-b9ad-044c4053f529 None None] MFA Rules not processed for user `3953b14656774edb92da1ecdb4bbbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:12:55.369291 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ef197212-c9cc-45fb-b9ad-044c4053f529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:12:55.388754 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1219/2429] 10.222.0.61 () {58 vars in 967 bytes} [Thu May 26 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:12:55.472305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512477c7-3d6b-43bc-8b8f-ab7322d109df None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:12:55.522688 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512477c7-3d6b-43bc-8b8f-ab7322d109df None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:12:55.532841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76082e48-832e-4153-b557-a10985c3d77d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a63879ec1242d08bba1ccad6212788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:12:55.534587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76082e48-832e-4153-b557-a10985c3d77d service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:12:55.534991 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76082e48-832e-4153-b557-a10985c3d77d service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:12:55.535369 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76082e48-832e-4153-b557-a10985c3d77d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:12:55.555560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76082e48-832e-4153-b557-a10985c3d77d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:12:55.561950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76082e48-832e-4153-b557-a10985c3d77d service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:12:55.578841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1211/2430] 10.222.0.61 () {60 vars in 1384 bytes} [Thu May 26 21:12:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:13:05.346993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:05.572919 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=31 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:06.881958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0adac-628d-4ccf-ab5d-23ef3560aa56 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:06.883220 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0adac-628d-4ccf-ab5d-23ef3560aa56 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:06.883732 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0adac-628d-4ccf-ab5d-23ef3560aa56 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:06.886743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1220/2431] 10.222.0.61 () {54 vars in 921 bytes} [Thu May 26 21:13:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:06.903476 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb7a3-61ed-4d72-b374-0c11abf3827c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:06.904349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb7a3-61ed-4d72-b374-0c11abf3827c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:06.905612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb7a3-61ed-4d72-b374-0c11abf3827c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:06.976243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-530cb7a3-61ed-4d72-b374-0c11abf3827c None None] MFA Rules not processed for user `e8952f35c21c4a2eaf1fbc601fe76242`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:06.978310 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-530cb7a3-61ed-4d72-b374-0c11abf3827c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:06.990877 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1212/2432] 10.222.0.61 () {58 vars in 1018 bytes} [Thu May 26 21:13:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:13:07.035916 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0adac-628d-4ccf-ab5d-23ef3560aa56 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:07.041123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cdc0adac-628d-4ccf-ab5d-23ef3560aa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:07.063799 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0adac-628d-4ccf-ab5d-23ef3560aa56 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:07.072210 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91eadba-629e-4217-8682-8c2b17fa9e14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8952f35c21c4a2eaf1fbc601fe76242', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:07.072959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91eadba-629e-4217-8682-8c2b17fa9e14 service placement] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:07.073501 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91eadba-629e-4217-8682-8c2b17fa9e14 service placement] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:07.073990 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91eadba-629e-4217-8682-8c2b17fa9e14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:07.083102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cb7a3-61ed-4d72-b374-0c11abf3827c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:07.085430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-530cb7a3-61ed-4d72-b374-0c11abf3827c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:07.091082 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91eadba-629e-4217-8682-8c2b17fa9e14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:07.095029 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91eadba-629e-4217-8682-8c2b17fa9e14 service placement] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:07.127756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1221/2433] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:13:07.158895 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cb7a3-61ed-4d72-b374-0c11abf3827c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:07.164436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a98e0-1455-41cb-9439-64ddeb9750ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:07.165400 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a98e0-1455-41cb-9439-64ddeb9750ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:07.165717 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a98e0-1455-41cb-9439-64ddeb9750ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:07.166264 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a98e0-1455-41cb-9439-64ddeb9750ff admin admin] PATH_INFO: `/v3/users/796103c08e1747e88d5ed270d2e8c70f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:07.167611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a98e0-1455-41cb-9439-64ddeb9750ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=796103c08e1747e88d5ed270d2e8c70f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:07.170970 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a98e0-1455-41cb-9439-64ddeb9750ff admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:07.262218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8e6a98e0-1455-41cb-9439-64ddeb9750ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '796103c08e1747e88d5ed270d2e8c70f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:07.263088 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8e6a98e0-1455-41cb-9439-64ddeb9750ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '796103c08e1747e88d5ed270d2e8c70f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:07.279019 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8e6a98e0-1455-41cb-9439-64ddeb9750ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '796103c08e1747e88d5ed270d2e8c70f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:07.314231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8e6a98e0-1455-41cb-9439-64ddeb9750ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '796103c08e1747e88d5ed270d2e8c70f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:07.324411 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8e6a98e0-1455-41cb-9439-64ddeb9750ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '796103c08e1747e88d5ed270d2e8c70f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:07.338588 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1213/2434] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:13:07 2022] DELETE /identity/v3/users/796103c08e1747e88d5ed270d2e8c70f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:08.008196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91eadba-629e-4217-8682-8c2b17fa9e14 service placement] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:08.027842 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91eadba-629e-4217-8682-8c2b17fa9e14 service placement] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:08.120809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfa61f-a7eb-4c92-9861-104bedca2f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:08.124208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfa61f-a7eb-4c92-9861-104bedca2f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:08.124208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfa61f-a7eb-4c92-9861-104bedca2f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:08.124208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfa61f-a7eb-4c92-9861-104bedca2f5b admin admin] PATH_INFO: `/v3/projects/41749fb199e348cb8579099d9be841ac` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:08.125409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfa61f-a7eb-4c92-9861-104bedca2f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=41749fb199e348cb8579099d9be841ac)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:08.128855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfa61f-a7eb-4c92-9861-104bedca2f5b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:08.224110 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-badfa61f-a7eb-4c92-9861-104bedca2f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41749fb199e348cb8579099d9be841ac', 'request_id': 'req-badfa61f-a7eb-4c92-9861-104bedca2f5b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:08.232755 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-badfa61f-a7eb-4c92-9861-104bedca2f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41749fb199e348cb8579099d9be841ac', 'request_id': 'req-badfa61f-a7eb-4c92-9861-104bedca2f5b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:08.243025 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-badfa61f-a7eb-4c92-9861-104bedca2f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41749fb199e348cb8579099d9be841ac', 'request_id': 'req-badfa61f-a7eb-4c92-9861-104bedca2f5b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:08.261518 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-badfa61f-a7eb-4c92-9861-104bedca2f5b admin admin] The token cache is being invalidate because project 41749fb199e348cb8579099d9be841ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:13:08.262136 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-badfa61f-a7eb-4c92-9861-104bedca2f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:08.263126 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-badfa61f-a7eb-4c92-9861-104bedca2f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:08.265142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1222/2435] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:13:08 2022] DELETE /identity/v3/projects/41749fb199e348cb8579099d9be841ac => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:08.271625 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a98e0-1455-41cb-9439-64ddeb9750ff admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:08.275388 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8e6a98e0-1455-41cb-9439-64ddeb9750ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:08.290921 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a98e0-1455-41cb-9439-64ddeb9750ff admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:08.379143 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5ef25-0136-4857-8d70-15f2fc503de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:08.380226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5ef25-0136-4857-8d70-15f2fc503de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:08.380581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5ef25-0136-4857-8d70-15f2fc503de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:08.380857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5ef25-0136-4857-8d70-15f2fc503de2 admin admin] PATH_INFO: `/v3/users/de8f305d20424946ad4bd527e0248227` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:08.382134 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5ef25-0136-4857-8d70-15f2fc503de2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de8f305d20424946ad4bd527e0248227)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:08.386932 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5ef25-0136-4857-8d70-15f2fc503de2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:08.389410 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:08.461373 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5ab5ef25-0136-4857-8d70-15f2fc503de2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de8f305d20424946ad4bd527e0248227'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:08.463513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5ab5ef25-0136-4857-8d70-15f2fc503de2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de8f305d20424946ad4bd527e0248227'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:08.485872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5ab5ef25-0136-4857-8d70-15f2fc503de2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de8f305d20424946ad4bd527e0248227'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:08.517075 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5ab5ef25-0136-4857-8d70-15f2fc503de2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de8f305d20424946ad4bd527e0248227'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:08.534109 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5ab5ef25-0136-4857-8d70-15f2fc503de2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de8f305d20424946ad4bd527e0248227'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:08.566484 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1214/2436] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:13:08 2022] DELETE /identity/v3/users/de8f305d20424946ad4bd527e0248227 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:08.915735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfa61f-a7eb-4c92-9861-104bedca2f5b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:08.917970 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-badfa61f-a7eb-4c92-9861-104bedca2f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:08.942667 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfa61f-a7eb-4c92-9861-104bedca2f5b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:09.066759 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece9b42-d68b-4e8a-a306-f9f22345136f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:09.069438 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece9b42-d68b-4e8a-a306-f9f22345136f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:09.070015 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece9b42-d68b-4e8a-a306-f9f22345136f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:09.071594 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece9b42-d68b-4e8a-a306-f9f22345136f admin admin] PATH_INFO: `/v3/projects/d11d1fad000046e2859ff9944b95a24b` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:09.073432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece9b42-d68b-4e8a-a306-f9f22345136f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11d1fad000046e2859ff9944b95a24b)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:09.078450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece9b42-d68b-4e8a-a306-f9f22345136f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:09.110615 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:09.165019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3ece9b42-d68b-4e8a-a306-f9f22345136f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11d1fad000046e2859ff9944b95a24b', 'request_id': 'req-3ece9b42-d68b-4e8a-a306-f9f22345136f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:09.181285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3ece9b42-d68b-4e8a-a306-f9f22345136f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11d1fad000046e2859ff9944b95a24b', 'request_id': 'req-3ece9b42-d68b-4e8a-a306-f9f22345136f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:09.194966 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3ece9b42-d68b-4e8a-a306-f9f22345136f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11d1fad000046e2859ff9944b95a24b', 'request_id': 'req-3ece9b42-d68b-4e8a-a306-f9f22345136f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:09.228238 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3ece9b42-d68b-4e8a-a306-f9f22345136f admin admin] The token cache is being invalidate because project d11d1fad000046e2859ff9944b95a24b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:13:09.229707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3ece9b42-d68b-4e8a-a306-f9f22345136f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:09.231161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3ece9b42-d68b-4e8a-a306-f9f22345136f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:09.235001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1223/2437] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:13:08 2022] DELETE /identity/v3/projects/d11d1fad000046e2859ff9944b95a24b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:10.345295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5ef25-0136-4857-8d70-15f2fc503de2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:10.348404 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5ab5ef25-0136-4857-8d70-15f2fc503de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:10.366980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5ef25-0136-4857-8d70-15f2fc503de2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:10.447380 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec8c93-5f21-43ea-8783-3e73e81723f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:10.448399 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec8c93-5f21-43ea-8783-3e73e81723f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:10.448702 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec8c93-5f21-43ea-8783-3e73e81723f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:10.449116 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec8c93-5f21-43ea-8783-3e73e81723f3 admin admin] PATH_INFO: `/v3/users/c1f33c40207e4701bb5bbd680d729c48` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:10.450443 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec8c93-5f21-43ea-8783-3e73e81723f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f33c40207e4701bb5bbd680d729c48)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:10.452727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec8c93-5f21-43ea-8783-3e73e81723f3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:10.523603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a5ec8c93-5f21-43ea-8783-3e73e81723f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f33c40207e4701bb5bbd680d729c48'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:10.524283 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a5ec8c93-5f21-43ea-8783-3e73e81723f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f33c40207e4701bb5bbd680d729c48'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:10.534006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a5ec8c93-5f21-43ea-8783-3e73e81723f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f33c40207e4701bb5bbd680d729c48'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:10.551164 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a5ec8c93-5f21-43ea-8783-3e73e81723f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f33c40207e4701bb5bbd680d729c48'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:10.559587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a5ec8c93-5f21-43ea-8783-3e73e81723f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f33c40207e4701bb5bbd680d729c48'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:10.564275 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:10.572281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1215/2438] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:13:10 2022] DELETE /identity/v3/users/c1f33c40207e4701bb5bbd680d729c48 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:10.911491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece9b42-d68b-4e8a-a306-f9f22345136f admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:10.913980 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3ece9b42-d68b-4e8a-a306-f9f22345136f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:10.933738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece9b42-d68b-4e8a-a306-f9f22345136f admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:11.025397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c3052-4904-4bf5-a4da-9512a1cef832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:11.026374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c3052-4904-4bf5-a4da-9512a1cef832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:11.027008 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c3052-4904-4bf5-a4da-9512a1cef832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:11.027130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c3052-4904-4bf5-a4da-9512a1cef832 admin admin] PATH_INFO: `/v3/projects/5b83792633104e04bb4bf4a4d4c9e5c6` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:11.029231 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c3052-4904-4bf5-a4da-9512a1cef832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b83792633104e04bb4bf4a4d4c9e5c6)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:11.033224 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c3052-4904-4bf5-a4da-9512a1cef832 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:11.134969 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-758c3052-4904-4bf5-a4da-9512a1cef832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b83792633104e04bb4bf4a4d4c9e5c6', 'request_id': 'req-758c3052-4904-4bf5-a4da-9512a1cef832'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:11.145475 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-758c3052-4904-4bf5-a4da-9512a1cef832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b83792633104e04bb4bf4a4d4c9e5c6', 'request_id': 'req-758c3052-4904-4bf5-a4da-9512a1cef832'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:11.153366 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-758c3052-4904-4bf5-a4da-9512a1cef832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b83792633104e04bb4bf4a4d4c9e5c6', 'request_id': 'req-758c3052-4904-4bf5-a4da-9512a1cef832'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:11.170584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-758c3052-4904-4bf5-a4da-9512a1cef832 admin admin] The token cache is being invalidate because project 5b83792633104e04bb4bf4a4d4c9e5c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:13:11.171064 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-758c3052-4904-4bf5-a4da-9512a1cef832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:11.171943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-758c3052-4904-4bf5-a4da-9512a1cef832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:11.178385 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1224/2439] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:13:10 2022] DELETE /identity/v3/projects/5b83792633104e04bb4bf4a4d4c9e5c6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:11.179511 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37fa88-2e66-49f7-bec0-393b3c342ac7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:11.179940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37fa88-2e66-49f7-bec0-393b3c342ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:11.180220 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37fa88-2e66-49f7-bec0-393b3c342ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:11.206409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ea37fa88-2e66-49f7-bec0-393b3c342ac7 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:11.207757 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ea37fa88-2e66-49f7-bec0-393b3c342ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:11.301759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1216/2440] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:13:11.310844 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580e47-1c83-4526-94ed-4dacfeae0671 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:11.311758 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580e47-1c83-4526-94ed-4dacfeae0671 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:11.312479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580e47-1c83-4526-94ed-4dacfeae0671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:11.344217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ec580e47-1c83-4526-94ed-4dacfeae0671 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:11.347241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ec580e47-1c83-4526-94ed-4dacfeae0671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:11.362508 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1225/2441] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:11.369243 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37fa88-2e66-49f7-bec0-393b3c342ac7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:11.386994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37fa88-2e66-49f7-bec0-393b3c342ac7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:11.393755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ff663-140f-4954-a1aa-b9f6848e46be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:11.394974 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ff663-140f-4954-a1aa-b9f6848e46be admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:11.395454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ff663-140f-4954-a1aa-b9f6848e46be admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:11.395941 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ff663-140f-4954-a1aa-b9f6848e46be admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:11.397296 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ff663-140f-4954-a1aa-b9f6848e46be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:13:11.397863 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ff663-140f-4954-a1aa-b9f6848e46be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:11.401159 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ff663-140f-4954-a1aa-b9f6848e46be admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:11.425489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1217/2442] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:13:11.430216 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec580e47-1c83-4526-94ed-4dacfeae0671 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:11.444661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec580e47-1c83-4526-94ed-4dacfeae0671 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:11.450426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f5171-4be6-4bdd-a1a5-cefc109dd424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:11.451546 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f5171-4be6-4bdd-a1a5-cefc109dd424 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:11.451902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f5171-4be6-4bdd-a1a5-cefc109dd424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:11.452406 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f5171-4be6-4bdd-a1a5-cefc109dd424 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:11.453204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f5171-4be6-4bdd-a1a5-cefc109dd424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:11.455495 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f5171-4be6-4bdd-a1a5-cefc109dd424 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:11.498576 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1226/2443] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:13:11 2022] POST /identity/v3/projects => generated 363 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:13:11.504051 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ff663-140f-4954-a1aa-b9f6848e46be admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:11.523775 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ff663-140f-4954-a1aa-b9f6848e46be admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:11.624940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f39248-3b46-4178-b575-2fd034e97799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:11.625902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f39248-3b46-4178-b575-2fd034e97799 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:11.626773 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f39248-3b46-4178-b575-2fd034e97799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:11.626773 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f39248-3b46-4178-b575-2fd034e97799 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:11.627702 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f39248-3b46-4178-b575-2fd034e97799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:11.629835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f39248-3b46-4178-b575-2fd034e97799 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:11.671869 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f5171-4be6-4bdd-a1a5-cefc109dd424 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:11.673490 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1218/2444] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:13:11 2022] POST /identity/v3/users => generated 282 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:13:11.689674 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f5171-4be6-4bdd-a1a5-cefc109dd424 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:11.698144 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339309b-70b4-4975-9378-ffe049f46760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:11.699551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339309b-70b4-4975-9378-ffe049f46760 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:11.700662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339309b-70b4-4975-9378-ffe049f46760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:11.700662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339309b-70b4-4975-9378-ffe049f46760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:11.702534 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339309b-70b4-4975-9378-ffe049f46760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:11.705902 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339309b-70b4-4975-9378-ffe049f46760 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:11.710080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:11.727002 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1227/2445] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:13:11.732704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f39248-3b46-4178-b575-2fd034e97799 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:11.748951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f39248-3b46-4178-b575-2fd034e97799 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:11.755248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b7455-54c0-4565-9f65-a1ec355bd7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:11.756140 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b7455-54c0-4565-9f65-a1ec355bd7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:11.756517 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b7455-54c0-4565-9f65-a1ec355bd7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:11.756910 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b7455-54c0-4565-9f65-a1ec355bd7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:11.763975 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b7455-54c0-4565-9f65-a1ec355bd7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:11.767800 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b7455-54c0-4565-9f65-a1ec355bd7c8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:11.781922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1219/2446] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:13:11.786678 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339309b-70b4-4975-9378-ffe049f46760 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:11.797785 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339309b-70b4-4975-9378-ffe049f46760 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:11.803392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a0682-858d-4754-97f9-58fe3966d764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:11.804198 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a0682-858d-4754-97f9-58fe3966d764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:11.804481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a0682-858d-4754-97f9-58fe3966d764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:11.804756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a0682-858d-4754-97f9-58fe3966d764 admin admin] PATH_INFO: `/v3/projects/cc2ecc36f5b34604be7116bf4acd7999/users/2b2c96a4e9aa4418bfa59bd4122f854a/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:11.824001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a0682-858d-4754-97f9-58fe3966d764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2ecc36f5b34604be7116bf4acd7999, user_id=2b2c96a4e9aa4418bfa59bd4122f854a, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:11.827992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a0682-858d-4754-97f9-58fe3966d764 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:11.842841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1228/2447] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:13:11 2022] PUT /identity/v3/projects/cc2ecc36f5b34604be7116bf4acd7999/users/2b2c96a4e9aa4418bfa59bd4122f854a/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:13:11.853767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e5236-534a-4413-91bc-486b26abad59 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:11.853767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e5236-534a-4413-91bc-486b26abad59 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:11.853767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e5236-534a-4413-91bc-486b26abad59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:11.884652 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ed5e5236-534a-4413-91bc-486b26abad59 None None] MFA Rules not processed for user `2b2c96a4e9aa4418bfa59bd4122f854a`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:11.886347 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ed5e5236-534a-4413-91bc-486b26abad59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:11.971063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:11.985968 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1220/2448] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:11.992004 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a0682-858d-4754-97f9-58fe3966d764 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:12.097385 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a0682-858d-4754-97f9-58fe3966d764 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:12.102977 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a86397-4f6d-49f0-b442-a3f4ba87edb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:12.103860 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a86397-4f6d-49f0-b442-a3f4ba87edb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:12.104144 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a86397-4f6d-49f0-b442-a3f4ba87edb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:12.104413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a86397-4f6d-49f0-b442-a3f4ba87edb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:12.104413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a86397-4f6d-49f0-b442-a3f4ba87edb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:12.108204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a86397-4f6d-49f0-b442-a3f4ba87edb7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:12.149390 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1229/2449] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:13:11 2022] POST /identity/v3/projects => generated 365 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:13:12.154902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e5236-534a-4413-91bc-486b26abad59 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:12.171916 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e5236-534a-4413-91bc-486b26abad59 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:12.250727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c356c8-3e84-4613-a16c-5367818dea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:12.252234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c356c8-3e84-4613-a16c-5367818dea98 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:12.252234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c356c8-3e84-4613-a16c-5367818dea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:12.252234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c356c8-3e84-4613-a16c-5367818dea98 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:12.252785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c356c8-3e84-4613-a16c-5367818dea98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:12.254792 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c356c8-3e84-4613-a16c-5367818dea98 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:12.278965 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1221/2450] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:13:12 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:13:12.284456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a86397-4f6d-49f0-b442-a3f4ba87edb7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:12.296165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a86397-4f6d-49f0-b442-a3f4ba87edb7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:12.301399 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09bac8-39f5-4816-ae64-34a7e0176539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:12.302160 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09bac8-39f5-4816-ae64-34a7e0176539 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:12.302391 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09bac8-39f5-4816-ae64-34a7e0176539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:12.302765 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09bac8-39f5-4816-ae64-34a7e0176539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:12.303462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09bac8-39f5-4816-ae64-34a7e0176539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:12.305112 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09bac8-39f5-4816-ae64-34a7e0176539 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:12.318279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1230/2451] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:13:12.322626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c356c8-3e84-4613-a16c-5367818dea98 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:12.337226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c356c8-3e84-4613-a16c-5367818dea98 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:12.342592 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5050c-258d-4c46-b390-3cc18122a174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:12.343538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5050c-258d-4c46-b390-3cc18122a174 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:12.343823 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5050c-258d-4c46-b390-3cc18122a174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:12.344208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5050c-258d-4c46-b390-3cc18122a174 admin admin] PATH_INFO: `/v3/projects/17fe3104257740cdbf74776448a35897/users/06ff5cd7d81149679f5f75ba66c6043e/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:12.363070 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5050c-258d-4c46-b390-3cc18122a174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17fe3104257740cdbf74776448a35897, user_id=06ff5cd7d81149679f5f75ba66c6043e, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:12.367376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5050c-258d-4c46-b390-3cc18122a174 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:12.390209 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1222/2452] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:13:12 2022] PUT /identity/v3/projects/17fe3104257740cdbf74776448a35897/users/06ff5cd7d81149679f5f75ba66c6043e/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:12.394649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09bac8-39f5-4816-ae64-34a7e0176539 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:12.405504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09bac8-39f5-4816-ae64-34a7e0176539 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:12.470537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758c95d-e113-43dd-8e21-3dd3038dd860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:12.471252 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758c95d-e113-43dd-8e21-3dd3038dd860 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:12.471624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758c95d-e113-43dd-8e21-3dd3038dd860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:12.471908 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758c95d-e113-43dd-8e21-3dd3038dd860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:12.472665 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758c95d-e113-43dd-8e21-3dd3038dd860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:12.474350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758c95d-e113-43dd-8e21-3dd3038dd860 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:12.485037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1231/2453] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:13:12.490398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5050c-258d-4c46-b390-3cc18122a174 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:12.508388 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5050c-258d-4c46-b390-3cc18122a174 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:12.513714 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8e54b-4792-49a1-84d6-4fc858eb3f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:12.514803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8e54b-4792-49a1-84d6-4fc858eb3f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:12.515226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8e54b-4792-49a1-84d6-4fc858eb3f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:12.515602 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8e54b-4792-49a1-84d6-4fc858eb3f73 admin admin] PATH_INFO: `/v3/projects/17fe3104257740cdbf74776448a35897/users/06ff5cd7d81149679f5f75ba66c6043e/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:12.519052 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8e54b-4792-49a1-84d6-4fc858eb3f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17fe3104257740cdbf74776448a35897, user_id=06ff5cd7d81149679f5f75ba66c6043e, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:12.522060 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8e54b-4792-49a1-84d6-4fc858eb3f73 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:12.535839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1223/2454] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:13:12 2022] PUT /identity/v3/projects/17fe3104257740cdbf74776448a35897/users/06ff5cd7d81149679f5f75ba66c6043e/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:12.552635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c2262-64d6-4f6b-b856-3a803713e0ea None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:12.553033 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c2262-64d6-4f6b-b856-3a803713e0ea None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:12.553394 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c2262-64d6-4f6b-b856-3a803713e0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:12.595248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0d5c2262-64d6-4f6b-b856-3a803713e0ea None None] MFA Rules not processed for user `06ff5cd7d81149679f5f75ba66c6043e`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:12.596690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0d5c2262-64d6-4f6b-b856-3a803713e0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:12.643020 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:12.712525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1232/2455] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:12.727770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8e54b-4792-49a1-84d6-4fc858eb3f73 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:12.730581 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a7a8e54b-4792-49a1-84d6-4fc858eb3f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:12.824154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8e54b-4792-49a1-84d6-4fc858eb3f73 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:12.835512 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce9200-c58a-4548-928a-50ec5caf7ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:12.836200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce9200-c58a-4548-928a-50ec5caf7ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:12.836486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce9200-c58a-4548-928a-50ec5caf7ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:12.836763 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce9200-c58a-4548-928a-50ec5caf7ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:12.848180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce9200-c58a-4548-928a-50ec5caf7ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:12.849635 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce9200-c58a-4548-928a-50ec5caf7ac5 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:12.860630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1224/2456] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:13.336544 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c2262-64d6-4f6b-b856-3a803713e0ea None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:13.414164 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c2262-64d6-4f6b-b856-3a803713e0ea None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:13.419375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35689eff-4712-49cf-8d8e-d08cfdc72c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:13.420440 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35689eff-4712-49cf-8d8e-d08cfdc72c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:13.420772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35689eff-4712-49cf-8d8e-d08cfdc72c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:13.421092 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35689eff-4712-49cf-8d8e-d08cfdc72c71 admin admin] PATH_INFO: `/v3/users/2b2c96a4e9aa4418bfa59bd4122f854a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:13.422461 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35689eff-4712-49cf-8d8e-d08cfdc72c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2c96a4e9aa4418bfa59bd4122f854a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:13.425494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35689eff-4712-49cf-8d8e-d08cfdc72c71 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:13.480172 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-35689eff-4712-49cf-8d8e-d08cfdc72c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2c96a4e9aa4418bfa59bd4122f854a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:13.494929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-35689eff-4712-49cf-8d8e-d08cfdc72c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2c96a4e9aa4418bfa59bd4122f854a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:13.495763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-35689eff-4712-49cf-8d8e-d08cfdc72c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2c96a4e9aa4418bfa59bd4122f854a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:13.505536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-35689eff-4712-49cf-8d8e-d08cfdc72c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2c96a4e9aa4418bfa59bd4122f854a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:13.514033 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-35689eff-4712-49cf-8d8e-d08cfdc72c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2c96a4e9aa4418bfa59bd4122f854a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:13.521344 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1233/2457] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:13:13 2022] DELETE /identity/v3/users/2b2c96a4e9aa4418bfa59bd4122f854a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:13.526955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73a5a9-a5b7-4313-90f0-a9a923befa8a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:13.527486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73a5a9-a5b7-4313-90f0-a9a923befa8a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:13.527591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73a5a9-a5b7-4313-90f0-a9a923befa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:13.551899 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7e73a5a9-a5b7-4313-90f0-a9a923befa8a None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:13.553707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7e73a5a9-a5b7-4313-90f0-a9a923befa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:13.619630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:13.648177 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1225/2458] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:13:13.660795 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35689eff-4712-49cf-8d8e-d08cfdc72c71 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:13.663730 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-35689eff-4712-49cf-8d8e-d08cfdc72c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:13.732712 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:13.739582 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35689eff-4712-49cf-8d8e-d08cfdc72c71 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:13.745409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e960d-ed18-45b4-9979-c905ccdec742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:13.746264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e960d-ed18-45b4-9979-c905ccdec742 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:13.747325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e960d-ed18-45b4-9979-c905ccdec742 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:13.747737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e960d-ed18-45b4-9979-c905ccdec742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:13.759750 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e960d-ed18-45b4-9979-c905ccdec742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:13.761313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e960d-ed18-45b4-9979-c905ccdec742 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:13.773608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1234/2459] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:14.166538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73a5a9-a5b7-4313-90f0-a9a923befa8a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:14.168552 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7e73a5a9-a5b7-4313-90f0-a9a923befa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:14.193027 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73a5a9-a5b7-4313-90f0-a9a923befa8a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:14.198302 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c2357-da2e-4ea5-96d9-f52c6af986e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:14.199274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c2357-da2e-4ea5-96d9-f52c6af986e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:14.199588 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c2357-da2e-4ea5-96d9-f52c6af986e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:14.199857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c2357-da2e-4ea5-96d9-f52c6af986e3 admin admin] PATH_INFO: `/v3/projects/cc2ecc36f5b34604be7116bf4acd7999` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:14.201122 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c2357-da2e-4ea5-96d9-f52c6af986e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2ecc36f5b34604be7116bf4acd7999)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:14.203549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c2357-da2e-4ea5-96d9-f52c6af986e3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:14.269926 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c61c2357-da2e-4ea5-96d9-f52c6af986e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2ecc36f5b34604be7116bf4acd7999', 'request_id': 'req-c61c2357-da2e-4ea5-96d9-f52c6af986e3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:14.279174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c61c2357-da2e-4ea5-96d9-f52c6af986e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2ecc36f5b34604be7116bf4acd7999', 'request_id': 'req-c61c2357-da2e-4ea5-96d9-f52c6af986e3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:14.287594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c61c2357-da2e-4ea5-96d9-f52c6af986e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2ecc36f5b34604be7116bf4acd7999', 'request_id': 'req-c61c2357-da2e-4ea5-96d9-f52c6af986e3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:14.299614 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c61c2357-da2e-4ea5-96d9-f52c6af986e3 admin admin] The token cache is being invalidate because project cc2ecc36f5b34604be7116bf4acd7999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:13:14.300013 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c61c2357-da2e-4ea5-96d9-f52c6af986e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:14.300990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c61c2357-da2e-4ea5-96d9-f52c6af986e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:14.302821 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1226/2460] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:13:14 2022] DELETE /identity/v3/projects/cc2ecc36f5b34604be7116bf4acd7999 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:14.307758 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e960d-ed18-45b4-9979-c905ccdec742 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:14.317986 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e960d-ed18-45b4-9979-c905ccdec742 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:14.404178 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c0c4d-a7b2-4bfe-9b4b-b1bd2e4bfe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:14.405096 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c0c4d-a7b2-4bfe-9b4b-b1bd2e4bfe62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:14.405382 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c0c4d-a7b2-4bfe-9b4b-b1bd2e4bfe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:14.405658 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c0c4d-a7b2-4bfe-9b4b-b1bd2e4bfe62 admin admin] PATH_INFO: `/v3/users/06ff5cd7d81149679f5f75ba66c6043e` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:14.407124 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c0c4d-a7b2-4bfe-9b4b-b1bd2e4bfe62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ff5cd7d81149679f5f75ba66c6043e)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:14.409496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c0c4d-a7b2-4bfe-9b4b-b1bd2e4bfe62 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:14.474532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-997c0c4d-a7b2-4bfe-9b4b-b1bd2e4bfe62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ff5cd7d81149679f5f75ba66c6043e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:14.492507 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-997c0c4d-a7b2-4bfe-9b4b-b1bd2e4bfe62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ff5cd7d81149679f5f75ba66c6043e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:14.493284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-997c0c4d-a7b2-4bfe-9b4b-b1bd2e4bfe62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ff5cd7d81149679f5f75ba66c6043e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:14.504415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-997c0c4d-a7b2-4bfe-9b4b-b1bd2e4bfe62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ff5cd7d81149679f5f75ba66c6043e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:14.514668 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-997c0c4d-a7b2-4bfe-9b4b-b1bd2e4bfe62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ff5cd7d81149679f5f75ba66c6043e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:14.523879 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1235/2461] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:13:14 2022] DELETE /identity/v3/users/06ff5cd7d81149679f5f75ba66c6043e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:14.856599 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c2357-da2e-4ea5-96d9-f52c6af986e3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:14.858231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c61c2357-da2e-4ea5-96d9-f52c6af986e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:14.874609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c2357-da2e-4ea5-96d9-f52c6af986e3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:14.956230 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fbec2-e74e-4630-a836-dfb0edb6fcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:14.957130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fbec2-e74e-4630-a836-dfb0edb6fcc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:14.957416 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fbec2-e74e-4630-a836-dfb0edb6fcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:14.957701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fbec2-e74e-4630-a836-dfb0edb6fcc1 admin admin] PATH_INFO: `/v3/projects/17fe3104257740cdbf74776448a35897` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:14.959036 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fbec2-e74e-4630-a836-dfb0edb6fcc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17fe3104257740cdbf74776448a35897)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:14.961000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fbec2-e74e-4630-a836-dfb0edb6fcc1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:15.029877 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-423fbec2-e74e-4630-a836-dfb0edb6fcc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17fe3104257740cdbf74776448a35897', 'request_id': 'req-423fbec2-e74e-4630-a836-dfb0edb6fcc1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:15.043924 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-423fbec2-e74e-4630-a836-dfb0edb6fcc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17fe3104257740cdbf74776448a35897', 'request_id': 'req-423fbec2-e74e-4630-a836-dfb0edb6fcc1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:15.051967 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-423fbec2-e74e-4630-a836-dfb0edb6fcc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17fe3104257740cdbf74776448a35897', 'request_id': 'req-423fbec2-e74e-4630-a836-dfb0edb6fcc1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:15.063277 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-423fbec2-e74e-4630-a836-dfb0edb6fcc1 admin admin] The token cache is being invalidate because project 17fe3104257740cdbf74776448a35897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:13:15.063719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-423fbec2-e74e-4630-a836-dfb0edb6fcc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:15.065583 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-423fbec2-e74e-4630-a836-dfb0edb6fcc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:15.067354 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1227/2462] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:13:14 2022] DELETE /identity/v3/projects/17fe3104257740cdbf74776448a35897 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:15.072765 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24584-45a2-448b-8a5b-fb05a732e218 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:15.073037 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24584-45a2-448b-8a5b-fb05a732e218 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:15.073313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24584-45a2-448b-8a5b-fb05a732e218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:15.099599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1bf24584-45a2-448b-8a5b-fb05a732e218 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:15.100825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1bf24584-45a2-448b-8a5b-fb05a732e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:15.188364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1236/2463] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:15.199701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617116f-599b-4c4a-b0c8-623056ab63ec None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:15.200314 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617116f-599b-4c4a-b0c8-623056ab63ec None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:15.200918 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617116f-599b-4c4a-b0c8-623056ab63ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:15.212910 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:15.228745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2617116f-599b-4c4a-b0c8-623056ab63ec None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:15.230634 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2617116f-599b-4c4a-b0c8-623056ab63ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:15.243255 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1228/2464] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:15.253201 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf24584-45a2-448b-8a5b-fb05a732e218 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:15.258586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf24584-45a2-448b-8a5b-fb05a732e218 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:15.264501 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f29e8-5e78-4eee-99b0-ae020cb7450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:15.264939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f29e8-5e78-4eee-99b0-ae020cb7450f admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:15.265223 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f29e8-5e78-4eee-99b0-ae020cb7450f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:15.267221 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f29e8-5e78-4eee-99b0-ae020cb7450f admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:15.267221 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f29e8-5e78-4eee-99b0-ae020cb7450f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:13:15.267221 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f29e8-5e78-4eee-99b0-ae020cb7450f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:15.269183 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f29e8-5e78-4eee-99b0-ae020cb7450f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:15.279266 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:15.288423 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1237/2465] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:13:15.296717 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617116f-599b-4c4a-b0c8-623056ab63ec None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:15.308868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617116f-599b-4c4a-b0c8-623056ab63ec None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:15.314103 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba7d59-cb8c-4f20-8842-11be8bc20938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:15.314989 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba7d59-cb8c-4f20-8842-11be8bc20938 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:15.315333 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba7d59-cb8c-4f20-8842-11be8bc20938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:15.315673 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba7d59-cb8c-4f20-8842-11be8bc20938 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:15.316513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba7d59-cb8c-4f20-8842-11be8bc20938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:15.318586 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba7d59-cb8c-4f20-8842-11be8bc20938 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:15.354206 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1229/2466] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:13:15 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:13:15.358795 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f29e8-5e78-4eee-99b0-ae020cb7450f admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:15.370263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f29e8-5e78-4eee-99b0-ae020cb7450f admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:15.432897 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe16e95-cae8-4199-ba16-81ecff35c6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:15.433583 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe16e95-cae8-4199-ba16-81ecff35c6ae admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:15.433891 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe16e95-cae8-4199-ba16-81ecff35c6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:15.434166 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe16e95-cae8-4199-ba16-81ecff35c6ae admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:15.434887 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe16e95-cae8-4199-ba16-81ecff35c6ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:15.436965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe16e95-cae8-4199-ba16-81ecff35c6ae admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:15.460525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1238/2467] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:13:15 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:13:15.465266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba7d59-cb8c-4f20-8842-11be8bc20938 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:15.476539 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba7d59-cb8c-4f20-8842-11be8bc20938 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:15.481488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a50d1-11fc-4f02-a313-8da27a8ac85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:15.482209 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a50d1-11fc-4f02-a313-8da27a8ac85a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:15.482496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a50d1-11fc-4f02-a313-8da27a8ac85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:15.482772 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a50d1-11fc-4f02-a313-8da27a8ac85a admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:15.483515 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a50d1-11fc-4f02-a313-8da27a8ac85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:15.485157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a50d1-11fc-4f02-a313-8da27a8ac85a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:15.497181 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1230/2468] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:13:15.501593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe16e95-cae8-4199-ba16-81ecff35c6ae admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:15.516417 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe16e95-cae8-4199-ba16-81ecff35c6ae admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:15.523025 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dca942-cd6e-4704-bb05-dc5d6e3a10a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:15.523785 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dca942-cd6e-4704-bb05-dc5d6e3a10a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:15.524075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dca942-cd6e-4704-bb05-dc5d6e3a10a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:15.524353 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dca942-cd6e-4704-bb05-dc5d6e3a10a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:15.525146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dca942-cd6e-4704-bb05-dc5d6e3a10a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:15.526973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dca942-cd6e-4704-bb05-dc5d6e3a10a3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:15.538821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1239/2469] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:13:15.543124 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a50d1-11fc-4f02-a313-8da27a8ac85a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:15.556341 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a50d1-11fc-4f02-a313-8da27a8ac85a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:15.563720 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481541bc-00dd-4b8d-8c18-bd84a5a6d9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:15.565058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481541bc-00dd-4b8d-8c18-bd84a5a6d9f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:15.565560 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481541bc-00dd-4b8d-8c18-bd84a5a6d9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:15.565934 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481541bc-00dd-4b8d-8c18-bd84a5a6d9f9 admin admin] PATH_INFO: `/v3/projects/36e848e8ec4b43b0af7295f7383e28ba/users/e1557569b55b4c09b5a34f51717bb620/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:15.591188 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481541bc-00dd-4b8d-8c18-bd84a5a6d9f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e848e8ec4b43b0af7295f7383e28ba, user_id=e1557569b55b4c09b5a34f51717bb620, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:15.594431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481541bc-00dd-4b8d-8c18-bd84a5a6d9f9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:15.616069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1231/2470] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:13:15 2022] PUT /identity/v3/projects/36e848e8ec4b43b0af7295f7383e28ba/users/e1557569b55b4c09b5a34f51717bb620/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:15.626766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649143cb-e789-460b-8c10-d407e7193b5f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:15.627050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649143cb-e789-460b-8c10-d407e7193b5f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:15.627328 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649143cb-e789-460b-8c10-d407e7193b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:15.660492 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-649143cb-e789-460b-8c10-d407e7193b5f None None] MFA Rules not processed for user `e1557569b55b4c09b5a34f51717bb620`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:15.662027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-649143cb-e789-460b-8c10-d407e7193b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:15.749669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1240/2471] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:15.754718 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481541bc-00dd-4b8d-8c18-bd84a5a6d9f9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:15.846494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481541bc-00dd-4b8d-8c18-bd84a5a6d9f9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:15.855074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0706cd7-042b-49ae-bcd9-35d0fc339d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:15.856212 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0706cd7-042b-49ae-bcd9-35d0fc339d8e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:15.856704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0706cd7-042b-49ae-bcd9-35d0fc339d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:15.857283 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0706cd7-042b-49ae-bcd9-35d0fc339d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:15.858021 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0706cd7-042b-49ae-bcd9-35d0fc339d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:15.860111 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0706cd7-042b-49ae-bcd9-35d0fc339d8e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:15.894904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1232/2472] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:13:15 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:13:15.900548 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649143cb-e789-460b-8c10-d407e7193b5f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:15.913514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649143cb-e789-460b-8c10-d407e7193b5f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:15.990700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af07f11-e082-49bb-9cea-191e00d14ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:15.991411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af07f11-e082-49bb-9cea-191e00d14ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:15.991692 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af07f11-e082-49bb-9cea-191e00d14ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:15.991970 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af07f11-e082-49bb-9cea-191e00d14ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:15.992760 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af07f11-e082-49bb-9cea-191e00d14ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:15.994796 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af07f11-e082-49bb-9cea-191e00d14ae2 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:16.006069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:16.037514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1241/2473] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:13:15 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:13:16.038979 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0706cd7-042b-49ae-bcd9-35d0fc339d8e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:16.051102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0706cd7-042b-49ae-bcd9-35d0fc339d8e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:16.056214 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7fbcb-da9f-46d9-b908-64ac81bb4b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:16.056920 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7fbcb-da9f-46d9-b908-64ac81bb4b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:16.057201 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7fbcb-da9f-46d9-b908-64ac81bb4b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:16.057494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7fbcb-da9f-46d9-b908-64ac81bb4b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:16.058257 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7fbcb-da9f-46d9-b908-64ac81bb4b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:16.059884 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7fbcb-da9f-46d9-b908-64ac81bb4b15 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:16.071391 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1233/2474] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:13:16.076498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af07f11-e082-49bb-9cea-191e00d14ae2 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:16.088087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af07f11-e082-49bb-9cea-191e00d14ae2 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:16.093492 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7946af-a342-4c0f-8b40-881f5f7763d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:16.094299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7946af-a342-4c0f-8b40-881f5f7763d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:16.094661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7946af-a342-4c0f-8b40-881f5f7763d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:16.094933 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7946af-a342-4c0f-8b40-881f5f7763d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:16.096641 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7946af-a342-4c0f-8b40-881f5f7763d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:16.098388 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7946af-a342-4c0f-8b40-881f5f7763d8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:16.111261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1242/2475] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:13:16.116457 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7fbcb-da9f-46d9-b908-64ac81bb4b15 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:16.131259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7fbcb-da9f-46d9-b908-64ac81bb4b15 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:16.138643 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973dfb69-4350-4255-b90e-d155a8288cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:16.139904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dfb69-4350-4255-b90e-d155a8288cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:16.140363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dfb69-4350-4255-b90e-d155a8288cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:16.140797 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dfb69-4350-4255-b90e-d155a8288cf7 admin admin] PATH_INFO: `/v3/projects/8fb76430324344eaaf98fa0d97ac959a/users/c84ace108aea41e7a3101930a7a1c6b9/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:16.167433 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973dfb69-4350-4255-b90e-d155a8288cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb76430324344eaaf98fa0d97ac959a, user_id=c84ace108aea41e7a3101930a7a1c6b9, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:16.172665 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973dfb69-4350-4255-b90e-d155a8288cf7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:16.194800 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1234/2476] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:13:16 2022] PUT /identity/v3/projects/8fb76430324344eaaf98fa0d97ac959a/users/c84ace108aea41e7a3101930a7a1c6b9/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:16.210493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14872f84-3668-428e-bd71-9e7e7aa94642 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:16.211147 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14872f84-3668-428e-bd71-9e7e7aa94642 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:16.211739 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14872f84-3668-428e-bd71-9e7e7aa94642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:16.248390 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-14872f84-3668-428e-bd71-9e7e7aa94642 None None] MFA Rules not processed for user `c84ace108aea41e7a3101930a7a1c6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:16.249615 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-14872f84-3668-428e-bd71-9e7e7aa94642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:16.320971 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1243/2477] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:16.326614 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973dfb69-4350-4255-b90e-d155a8288cf7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:16.386847 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:16.410797 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973dfb69-4350-4255-b90e-d155a8288cf7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:16.418188 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d241f-4fca-4870-8864-95dd6f8e0f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:16.418906 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d241f-4fca-4870-8864-95dd6f8e0f2b admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:16.419375 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d241f-4fca-4870-8864-95dd6f8e0f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:16.419520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d241f-4fca-4870-8864-95dd6f8e0f2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:16.420328 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d241f-4fca-4870-8864-95dd6f8e0f2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:16.422316 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d241f-4fca-4870-8864-95dd6f8e0f2b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:16.459216 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1235/2478] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:13:16 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:13:16.467269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14872f84-3668-428e-bd71-9e7e7aa94642 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:16.481246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14872f84-3668-428e-bd71-9e7e7aa94642 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:16.563686 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b5b1f-8f95-413a-b109-556d3cdcdb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:16.564754 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b5b1f-8f95-413a-b109-556d3cdcdb03 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:16.565206 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b5b1f-8f95-413a-b109-556d3cdcdb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:16.565604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b5b1f-8f95-413a-b109-556d3cdcdb03 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:16.566464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b5b1f-8f95-413a-b109-556d3cdcdb03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:16.568531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b5b1f-8f95-413a-b109-556d3cdcdb03 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:16.599165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1244/2479] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:13:16 2022] POST /identity/v3/users => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:13:16.603416 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d241f-4fca-4870-8864-95dd6f8e0f2b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:16.616439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d241f-4fca-4870-8864-95dd6f8e0f2b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:16.621416 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d0f11-5ab4-4974-a6f1-d0d0d92a4c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:16.622162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d0f11-5ab4-4974-a6f1-d0d0d92a4c39 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:16.622456 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d0f11-5ab4-4974-a6f1-d0d0d92a4c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:16.622755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d0f11-5ab4-4974-a6f1-d0d0d92a4c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:16.623514 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d0f11-5ab4-4974-a6f1-d0d0d92a4c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:16.625184 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d0f11-5ab4-4974-a6f1-d0d0d92a4c39 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:16.637643 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1236/2480] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:13:16.642155 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b5b1f-8f95-413a-b109-556d3cdcdb03 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:16.653367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b5b1f-8f95-413a-b109-556d3cdcdb03 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:16.658782 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f3078-ae39-4aca-8b2c-ef6b5e85afd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:16.659704 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f3078-ae39-4aca-8b2c-ef6b5e85afd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:16.659990 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f3078-ae39-4aca-8b2c-ef6b5e85afd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:16.660269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f3078-ae39-4aca-8b2c-ef6b5e85afd5 admin admin] PATH_INFO: `/v3/projects/9ae5e07b222a4546a59508220e0e90a8/users/d75bd12d810141d98a71d51f56df177c/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:16.684135 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f3078-ae39-4aca-8b2c-ef6b5e85afd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ae5e07b222a4546a59508220e0e90a8, user_id=d75bd12d810141d98a71d51f56df177c, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:16.687235 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f3078-ae39-4aca-8b2c-ef6b5e85afd5 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:16.705254 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1245/2481] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:13:16 2022] PUT /identity/v3/projects/9ae5e07b222a4546a59508220e0e90a8/users/d75bd12d810141d98a71d51f56df177c/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:16.710853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d0f11-5ab4-4974-a6f1-d0d0d92a4c39 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:16.722132 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d0f11-5ab4-4974-a6f1-d0d0d92a4c39 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:16.792054 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d1932-204c-4356-8fdf-689c9a457b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:16.792749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1932-204c-4356-8fdf-689c9a457b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:16.793024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1932-204c-4356-8fdf-689c9a457b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:16.793293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1932-204c-4356-8fdf-689c9a457b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:16.794077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d1932-204c-4356-8fdf-689c9a457b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:16.795739 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d1932-204c-4356-8fdf-689c9a457b22 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:16.806964 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1237/2482] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:13:16.811279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f3078-ae39-4aca-8b2c-ef6b5e85afd5 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:16.822189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f3078-ae39-4aca-8b2c-ef6b5e85afd5 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:16.827394 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b1383-ee6c-4d8f-97df-f31515387818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:16.828300 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b1383-ee6c-4d8f-97df-f31515387818 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:16.828608 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b1383-ee6c-4d8f-97df-f31515387818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:16.828982 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b1383-ee6c-4d8f-97df-f31515387818 admin admin] PATH_INFO: `/v3/projects/9ae5e07b222a4546a59508220e0e90a8/users/d75bd12d810141d98a71d51f56df177c/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:16.831161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b1383-ee6c-4d8f-97df-f31515387818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ae5e07b222a4546a59508220e0e90a8, user_id=d75bd12d810141d98a71d51f56df177c, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:16.834215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b1383-ee6c-4d8f-97df-f31515387818 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:16.845932 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1246/2483] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:13:16 2022] PUT /identity/v3/projects/9ae5e07b222a4546a59508220e0e90a8/users/d75bd12d810141d98a71d51f56df177c/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:16.857300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ccc00-0fb5-42f4-908c-3f21a291c31d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:16.857872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ccc00-0fb5-42f4-908c-3f21a291c31d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:16.857872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ccc00-0fb5-42f4-908c-3f21a291c31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:16.896476 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f38ccc00-0fb5-42f4-908c-3f21a291c31d None None] MFA Rules not processed for user `d75bd12d810141d98a71d51f56df177c`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:16.897658 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f38ccc00-0fb5-42f4-908c-3f21a291c31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:16.983063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1238/2484] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:16.996169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b1383-ee6c-4d8f-97df-f31515387818 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:16.998462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ed3b1383-ee6c-4d8f-97df-f31515387818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:17.045957 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:17.088504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b1383-ee6c-4d8f-97df-f31515387818 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:17.098189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea401ee5-c816-43f1-ba72-cefacb356b87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:17.098954 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea401ee5-c816-43f1-ba72-cefacb356b87 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:17.099273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea401ee5-c816-43f1-ba72-cefacb356b87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:17.099585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea401ee5-c816-43f1-ba72-cefacb356b87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:17.110896 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea401ee5-c816-43f1-ba72-cefacb356b87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:17.112518 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea401ee5-c816-43f1-ba72-cefacb356b87 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:17.123220 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1247/2485] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:17.761063 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ccc00-0fb5-42f4-908c-3f21a291c31d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:17.763382 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f38ccc00-0fb5-42f4-908c-3f21a291c31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:17.782006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ccc00-0fb5-42f4-908c-3f21a291c31d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:17.788341 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af73062-0f3b-4859-ae2a-a4dc132260d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:17.789491 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af73062-0f3b-4859-ae2a-a4dc132260d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:17.790042 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af73062-0f3b-4859-ae2a-a4dc132260d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:17.790532 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af73062-0f3b-4859-ae2a-a4dc132260d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:17.855539 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:17.876397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af73062-0f3b-4859-ae2a-a4dc132260d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:17.878100 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af73062-0f3b-4859-ae2a-a4dc132260d3 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:17.889161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1239/2486] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:21.069304 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac8e26-5f72-4a80-8d33-4580caff5b10 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:21.070138 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac8e26-5f72-4a80-8d33-4580caff5b10 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:21.070138 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac8e26-5f72-4a80-8d33-4580caff5b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:21.091503 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d7ac8e26-5f72-4a80-8d33-4580caff5b10 None None] MFA Rules not processed for user `3953b14656774edb92da1ecdb4bbbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:21.093117 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d7ac8e26-5f72-4a80-8d33-4580caff5b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:21.170154 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1248/2487] 10.222.0.61 () {58 vars in 1009 bytes} [Thu May 26 21:13:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:21.185669 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af73062-0f3b-4859-ae2a-a4dc132260d3 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:21.187663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9af73062-0f3b-4859-ae2a-a4dc132260d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:21.297524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af73062-0f3b-4859-ae2a-a4dc132260d3 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:21.305524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba9d8d-798a-4879-b641-0fdc84948629 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a63879ec1242d08bba1ccad6212788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:21.306204 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba9d8d-798a-4879-b641-0fdc84948629 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:21.306528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba9d8d-798a-4879-b641-0fdc84948629 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:21.306846 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba9d8d-798a-4879-b641-0fdc84948629 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:21.317505 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba9d8d-798a-4879-b641-0fdc84948629 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:21.319151 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba9d8d-798a-4879-b641-0fdc84948629 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:21.329086 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1240/2488] 10.222.0.61 () {60 vars in 1384 bytes} [Thu May 26 21:13:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:13:22.300832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac8e26-5f72-4a80-8d33-4580caff5b10 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:22.316735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac8e26-5f72-4a80-8d33-4580caff5b10 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:22.321014 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4f61e-cbc1-468e-b5fb-059a39ba0b88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:22.321690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4f61e-cbc1-468e-b5fb-059a39ba0b88 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:22.321999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4f61e-cbc1-468e-b5fb-059a39ba0b88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:22.322278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4f61e-cbc1-468e-b5fb-059a39ba0b88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:22.460484 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4f61e-cbc1-468e-b5fb-059a39ba0b88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:22.462069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4f61e-cbc1-468e-b5fb-059a39ba0b88 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:22.477556 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1249/2489] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:25.590845 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba9d8d-798a-4879-b641-0fdc84948629 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:25.788200 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba9d8d-798a-4879-b641-0fdc84948629 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:25.796639 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cb6f7-0448-4d05-a626-9dc9b3327e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:25.798609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cb6f7-0448-4d05-a626-9dc9b3327e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:25.799635 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cb6f7-0448-4d05-a626-9dc9b3327e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:25.799635 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cb6f7-0448-4d05-a626-9dc9b3327e33 admin admin] PATH_INFO: `/v3/users/e1557569b55b4c09b5a34f51717bb620` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:25.802439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cb6f7-0448-4d05-a626-9dc9b3327e33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1557569b55b4c09b5a34f51717bb620)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:25.806684 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cb6f7-0448-4d05-a626-9dc9b3327e33 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:25.894620 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-894cb6f7-0448-4d05-a626-9dc9b3327e33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1557569b55b4c09b5a34f51717bb620'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:25.895722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-894cb6f7-0448-4d05-a626-9dc9b3327e33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1557569b55b4c09b5a34f51717bb620'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:25.910279 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-894cb6f7-0448-4d05-a626-9dc9b3327e33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1557569b55b4c09b5a34f51717bb620'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:25.947562 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-894cb6f7-0448-4d05-a626-9dc9b3327e33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1557569b55b4c09b5a34f51717bb620'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:25.952660 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:25.989465 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-894cb6f7-0448-4d05-a626-9dc9b3327e33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1557569b55b4c09b5a34f51717bb620'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:25.999661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1241/2490] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:13:25 2022] DELETE /identity/v3/users/e1557569b55b4c09b5a34f51717bb620 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:26.005154 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1610c62-e302-4e93-adf8-c3d1163f1e74 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:26.007339 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1610c62-e302-4e93-adf8-c3d1163f1e74 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:26.008062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1610c62-e302-4e93-adf8-c3d1163f1e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:26.054703 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e1610c62-e302-4e93-adf8-c3d1163f1e74 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:26.062780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e1610c62-e302-4e93-adf8-c3d1163f1e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:26.197850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1250/2491] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:26.213662 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cb6f7-0448-4d05-a626-9dc9b3327e33 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:26.216547 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-894cb6f7-0448-4d05-a626-9dc9b3327e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:26.396193 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cb6f7-0448-4d05-a626-9dc9b3327e33 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:26.403035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e098da8-267f-4b24-8004-0ef7bf742fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:26.403951 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e098da8-267f-4b24-8004-0ef7bf742fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:26.404676 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e098da8-267f-4b24-8004-0ef7bf742fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:26.405133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e098da8-267f-4b24-8004-0ef7bf742fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:26.421683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e098da8-267f-4b24-8004-0ef7bf742fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:26.423461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e098da8-267f-4b24-8004-0ef7bf742fd4 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:26.444921 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1242/2492] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:27.150407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1610c62-e302-4e93-adf8-c3d1163f1e74 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:27.155676 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e1610c62-e302-4e93-adf8-c3d1163f1e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:27.203093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1610c62-e302-4e93-adf8-c3d1163f1e74 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:27.233098 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f21b7-995d-40af-b623-f596416aafef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:27.234825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f21b7-995d-40af-b623-f596416aafef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:27.235364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f21b7-995d-40af-b623-f596416aafef admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:27.236328 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f21b7-995d-40af-b623-f596416aafef admin admin] PATH_INFO: `/v3/projects/36e848e8ec4b43b0af7295f7383e28ba` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:27.238619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f21b7-995d-40af-b623-f596416aafef admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e848e8ec4b43b0af7295f7383e28ba)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:27.241427 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f21b7-995d-40af-b623-f596416aafef admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:27.255061 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:27.321402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f64f21b7-995d-40af-b623-f596416aafef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e848e8ec4b43b0af7295f7383e28ba', 'request_id': 'req-f64f21b7-995d-40af-b623-f596416aafef'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:27.334045 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f64f21b7-995d-40af-b623-f596416aafef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e848e8ec4b43b0af7295f7383e28ba', 'request_id': 'req-f64f21b7-995d-40af-b623-f596416aafef'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:27.348439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f64f21b7-995d-40af-b623-f596416aafef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e848e8ec4b43b0af7295f7383e28ba', 'request_id': 'req-f64f21b7-995d-40af-b623-f596416aafef'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:27.372473 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f64f21b7-995d-40af-b623-f596416aafef admin admin] The token cache is being invalidate because project 36e848e8ec4b43b0af7295f7383e28ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:13:27.372898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f64f21b7-995d-40af-b623-f596416aafef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:27.373963 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f64f21b7-995d-40af-b623-f596416aafef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:27.376768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1251/2493] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:13:27 2022] DELETE /identity/v3/projects/36e848e8ec4b43b0af7295f7383e28ba => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:27.381414 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e098da8-267f-4b24-8004-0ef7bf742fd4 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:27.400828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e098da8-267f-4b24-8004-0ef7bf742fd4 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:27.503758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6fb1-7b47-495e-8fb5-0b1e694eef02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:27.505488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6fb1-7b47-495e-8fb5-0b1e694eef02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:27.505826 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6fb1-7b47-495e-8fb5-0b1e694eef02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:27.506089 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6fb1-7b47-495e-8fb5-0b1e694eef02 admin admin] PATH_INFO: `/v3/users/c84ace108aea41e7a3101930a7a1c6b9` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:27.507508 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce6fb1-7b47-495e-8fb5-0b1e694eef02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84ace108aea41e7a3101930a7a1c6b9)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:27.509601 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce6fb1-7b47-495e-8fb5-0b1e694eef02 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:27.604521 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b1ce6fb1-7b47-495e-8fb5-0b1e694eef02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84ace108aea41e7a3101930a7a1c6b9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:27.605275 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b1ce6fb1-7b47-495e-8fb5-0b1e694eef02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84ace108aea41e7a3101930a7a1c6b9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:27.624870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b1ce6fb1-7b47-495e-8fb5-0b1e694eef02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84ace108aea41e7a3101930a7a1c6b9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:27.656902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b1ce6fb1-7b47-495e-8fb5-0b1e694eef02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84ace108aea41e7a3101930a7a1c6b9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:27.672711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b1ce6fb1-7b47-495e-8fb5-0b1e694eef02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84ace108aea41e7a3101930a7a1c6b9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:27.688448 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1243/2494] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:13:27 2022] DELETE /identity/v3/users/c84ace108aea41e7a3101930a7a1c6b9 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:13:28.258706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f21b7-995d-40af-b623-f596416aafef admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:28.260445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f64f21b7-995d-40af-b623-f596416aafef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:28.282433 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f21b7-995d-40af-b623-f596416aafef admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:28.381395 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124a739-9bd1-4902-9ee7-8ec78669904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:28.382510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a739-9bd1-4902-9ee7-8ec78669904d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:28.382816 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a739-9bd1-4902-9ee7-8ec78669904d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:28.383096 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a739-9bd1-4902-9ee7-8ec78669904d admin admin] PATH_INFO: `/v3/projects/8fb76430324344eaaf98fa0d97ac959a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:28.384423 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124a739-9bd1-4902-9ee7-8ec78669904d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fb76430324344eaaf98fa0d97ac959a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:28.386706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124a739-9bd1-4902-9ee7-8ec78669904d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:28.468169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2124a739-9bd1-4902-9ee7-8ec78669904d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fb76430324344eaaf98fa0d97ac959a', 'request_id': 'req-2124a739-9bd1-4902-9ee7-8ec78669904d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:28.480062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2124a739-9bd1-4902-9ee7-8ec78669904d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fb76430324344eaaf98fa0d97ac959a', 'request_id': 'req-2124a739-9bd1-4902-9ee7-8ec78669904d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:28.494554 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2124a739-9bd1-4902-9ee7-8ec78669904d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fb76430324344eaaf98fa0d97ac959a', 'request_id': 'req-2124a739-9bd1-4902-9ee7-8ec78669904d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:28.519908 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2124a739-9bd1-4902-9ee7-8ec78669904d admin admin] The token cache is being invalidate because project 8fb76430324344eaaf98fa0d97ac959a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:13:28.520367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2124a739-9bd1-4902-9ee7-8ec78669904d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:28.521301 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2124a739-9bd1-4902-9ee7-8ec78669904d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:28.523643 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1252/2495] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:13:28 2022] DELETE /identity/v3/projects/8fb76430324344eaaf98fa0d97ac959a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:28.529663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6fb1-7b47-495e-8fb5-0b1e694eef02 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:28.532422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b1ce6fb1-7b47-495e-8fb5-0b1e694eef02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:28.554837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6fb1-7b47-495e-8fb5-0b1e694eef02 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:28.573613 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:28.691564 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eda882-fda6-4022-8e61-1f60e289b08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:28.692495 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eda882-fda6-4022-8e61-1f60e289b08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:28.692777 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eda882-fda6-4022-8e61-1f60e289b08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:28.693050 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eda882-fda6-4022-8e61-1f60e289b08c admin admin] PATH_INFO: `/v3/users/d75bd12d810141d98a71d51f56df177c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:28.694341 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eda882-fda6-4022-8e61-1f60e289b08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75bd12d810141d98a71d51f56df177c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:28.696833 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eda882-fda6-4022-8e61-1f60e289b08c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:28.785695 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-42eda882-fda6-4022-8e61-1f60e289b08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75bd12d810141d98a71d51f56df177c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:28.786904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-42eda882-fda6-4022-8e61-1f60e289b08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75bd12d810141d98a71d51f56df177c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:28.809183 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-42eda882-fda6-4022-8e61-1f60e289b08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75bd12d810141d98a71d51f56df177c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:28.843367 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-42eda882-fda6-4022-8e61-1f60e289b08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75bd12d810141d98a71d51f56df177c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:28.858537 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-42eda882-fda6-4022-8e61-1f60e289b08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75bd12d810141d98a71d51f56df177c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:28.871431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1244/2496] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:13:28 2022] DELETE /identity/v3/users/d75bd12d810141d98a71d51f56df177c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:29.383242 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124a739-9bd1-4902-9ee7-8ec78669904d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:29.385630 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2124a739-9bd1-4902-9ee7-8ec78669904d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:29.419040 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eda882-fda6-4022-8e61-1f60e289b08c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:29.421199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-42eda882-fda6-4022-8e61-1f60e289b08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:29.424635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124a739-9bd1-4902-9ee7-8ec78669904d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:29.489288 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:29.583362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3f2ec-8066-4bfe-8ffe-21d0b48bd121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:29.585253 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eda882-fda6-4022-8e61-1f60e289b08c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:29.586261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f2ec-8066-4bfe-8ffe-21d0b48bd121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:29.586795 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f2ec-8066-4bfe-8ffe-21d0b48bd121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:29.587454 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3f2ec-8066-4bfe-8ffe-21d0b48bd121 admin admin] PATH_INFO: `/v3/projects/9ae5e07b222a4546a59508220e0e90a8` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:29.590199 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3f2ec-8066-4bfe-8ffe-21d0b48bd121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ae5e07b222a4546a59508220e0e90a8)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:29.591225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030cea5-cf26-45e8-b09f-03be1fbcc691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:29.592013 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030cea5-cf26-45e8-b09f-03be1fbcc691 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:29.592301 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030cea5-cf26-45e8-b09f-03be1fbcc691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:29.592580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030cea5-cf26-45e8-b09f-03be1fbcc691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:29.593991 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3f2ec-8066-4bfe-8ffe-21d0b48bd121 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:29.595360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7030cea5-cf26-45e8-b09f-03be1fbcc691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:29.709656 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:29.723827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-05b3f2ec-8066-4bfe-8ffe-21d0b48bd121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ae5e07b222a4546a59508220e0e90a8', 'request_id': 'req-05b3f2ec-8066-4bfe-8ffe-21d0b48bd121'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:29.733536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-05b3f2ec-8066-4bfe-8ffe-21d0b48bd121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ae5e07b222a4546a59508220e0e90a8', 'request_id': 'req-05b3f2ec-8066-4bfe-8ffe-21d0b48bd121'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:29.743513 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-05b3f2ec-8066-4bfe-8ffe-21d0b48bd121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ae5e07b222a4546a59508220e0e90a8', 'request_id': 'req-05b3f2ec-8066-4bfe-8ffe-21d0b48bd121'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:29.777023 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030cea5-cf26-45e8-b09f-03be1fbcc691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:29.780041 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030cea5-cf26-45e8-b09f-03be1fbcc691 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:29.784480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-05b3f2ec-8066-4bfe-8ffe-21d0b48bd121 admin admin] The token cache is being invalidate because project 9ae5e07b222a4546a59508220e0e90a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:13:29.784990 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-05b3f2ec-8066-4bfe-8ffe-21d0b48bd121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:29.786797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-05b3f2ec-8066-4bfe-8ffe-21d0b48bd121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:29.795679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1253/2497] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:13:29 2022] DELETE /identity/v3/projects/9ae5e07b222a4546a59508220e0e90a8 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:13:29.799837 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89ef84-a5e1-4f01-b916-d8359cae844f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:29.800779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89ef84-a5e1-4f01-b916-d8359cae844f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:29.800916 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1245/2498] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:13:29.802181 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89ef84-a5e1-4f01-b916-d8359cae844f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:29.828738 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-4d89ef84-a5e1-4f01-b916-d8359cae844f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:29.830474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-4d89ef84-a5e1-4f01-b916-d8359cae844f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:29.945951 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1254/2499] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:13:29.955198 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95195e38-6c22-4849-9fb8-1d011b741f51 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:29.955966 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95195e38-6c22-4849-9fb8-1d011b741f51 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:29.956818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95195e38-6c22-4849-9fb8-1d011b741f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:29.987869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-95195e38-6c22-4849-9fb8-1d011b741f51 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:29.989462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-95195e38-6c22-4849-9fb8-1d011b741f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:30.004442 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1246/2500] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:13:30.010612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89ef84-a5e1-4f01-b916-d8359cae844f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:30.034405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89ef84-a5e1-4f01-b916-d8359cae844f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:30.042943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d4e83-710a-4d4b-a835-519d599b3610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:30.044230 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d4e83-710a-4d4b-a835-519d599b3610 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:30.044621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d4e83-710a-4d4b-a835-519d599b3610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:30.045024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d4e83-710a-4d4b-a835-519d599b3610 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:30.046005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d4e83-710a-4d4b-a835-519d599b3610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:13:30.046452 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d4e83-710a-4d4b-a835-519d599b3610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:30.048376 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d4e83-710a-4d4b-a835-519d599b3610 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:30.069855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1255/2501] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:13:30.073594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95195e38-6c22-4849-9fb8-1d011b741f51 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:30.085271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95195e38-6c22-4849-9fb8-1d011b741f51 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:30.090321 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5b22e-7c3d-4653-ad15-06a608865ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:30.091000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5b22e-7c3d-4653-ad15-06a608865ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:30.091290 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5b22e-7c3d-4653-ad15-06a608865ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:30.091589 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5b22e-7c3d-4653-ad15-06a608865ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:30.092257 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5b22e-7c3d-4653-ad15-06a608865ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:30.094383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5b22e-7c3d-4653-ad15-06a608865ec0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:30.134927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1247/2502] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:13:30 2022] POST /identity/v3/projects => generated 399 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:13:30.140197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d4e83-710a-4d4b-a835-519d599b3610 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:30.158265 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d4e83-710a-4d4b-a835-519d599b3610 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:30.260189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:30.298118 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad0873-9f0e-4a7d-8ead-7686a5d1c032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:30.299181 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad0873-9f0e-4a7d-8ead-7686a5d1c032 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:30.299629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad0873-9f0e-4a7d-8ead-7686a5d1c032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:30.300029 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad0873-9f0e-4a7d-8ead-7686a5d1c032 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:30.303237 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad0873-9f0e-4a7d-8ead-7686a5d1c032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:30.305910 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad0873-9f0e-4a7d-8ead-7686a5d1c032 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:30.345916 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1256/2503] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:13:30 2022] POST /identity/v3/users => generated 300 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:13:30.352499 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5b22e-7c3d-4653-ad15-06a608865ec0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:30.369221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5b22e-7c3d-4653-ad15-06a608865ec0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:30.378411 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06c195-b7a3-41c8-92e5-c597981c129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:30.379612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06c195-b7a3-41c8-92e5-c597981c129e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:30.380126 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06c195-b7a3-41c8-92e5-c597981c129e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:30.380844 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06c195-b7a3-41c8-92e5-c597981c129e admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:30.382625 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06c195-b7a3-41c8-92e5-c597981c129e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:30.388024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06c195-b7a3-41c8-92e5-c597981c129e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:30.410416 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1248/2504] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:13:30.415936 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad0873-9f0e-4a7d-8ead-7686a5d1c032 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:30.429913 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad0873-9f0e-4a7d-8ead-7686a5d1c032 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:30.438449 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cee00-dea9-4912-ac9b-cb0e6222d22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:30.439169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cee00-dea9-4912-ac9b-cb0e6222d22f admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:30.439506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cee00-dea9-4912-ac9b-cb0e6222d22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:30.439790 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cee00-dea9-4912-ac9b-cb0e6222d22f admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:30.440481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cee00-dea9-4912-ac9b-cb0e6222d22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:30.442341 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cee00-dea9-4912-ac9b-cb0e6222d22f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:30.456708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1257/2505] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:13:30.462574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06c195-b7a3-41c8-92e5-c597981c129e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:30.480491 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06c195-b7a3-41c8-92e5-c597981c129e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:30.489457 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f579f9-7da5-4511-bf86-97c30bd3cc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:30.490752 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f579f9-7da5-4511-bf86-97c30bd3cc46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:30.491128 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f579f9-7da5-4511-bf86-97c30bd3cc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:30.491474 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f579f9-7da5-4511-bf86-97c30bd3cc46 admin admin] PATH_INFO: `/v3/projects/b6eb7b1086104420a464dee83ad0fb25/users/b7ca5c98895b4fa49e0281911b58b158/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:30.515799 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f579f9-7da5-4511-bf86-97c30bd3cc46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6eb7b1086104420a464dee83ad0fb25, user_id=b7ca5c98895b4fa49e0281911b58b158, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:30.521508 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f579f9-7da5-4511-bf86-97c30bd3cc46 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:30.544298 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1249/2506] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:13:30 2022] PUT /identity/v3/projects/b6eb7b1086104420a464dee83ad0fb25/users/b7ca5c98895b4fa49e0281911b58b158/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:30.562003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983826e-a791-4fd0-a42c-d45b022cc4c8 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:30.562328 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983826e-a791-4fd0-a42c-d45b022cc4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:30.562630 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983826e-a791-4fd0-a42c-d45b022cc4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:30.610326 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e983826e-a791-4fd0-a42c-d45b022cc4c8 None None] MFA Rules not processed for user `b7ca5c98895b4fa49e0281911b58b158`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:30.611786 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e983826e-a791-4fd0-a42c-d45b022cc4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:30.756086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1258/2507] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:13:30.767258 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f579f9-7da5-4511-bf86-97c30bd3cc46 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:30.905909 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f579f9-7da5-4511-bf86-97c30bd3cc46 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:30.917504 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3587718-b1f7-4865-8bf2-4481505c7b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:30.918922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3587718-b1f7-4865-8bf2-4481505c7b8e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:30.919587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3587718-b1f7-4865-8bf2-4481505c7b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:30.920145 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3587718-b1f7-4865-8bf2-4481505c7b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:30.921108 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3587718-b1f7-4865-8bf2-4481505c7b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:30.926122 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3587718-b1f7-4865-8bf2-4481505c7b8e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:30.986232 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1250/2508] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:13:30 2022] POST /identity/v3/projects => generated 401 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:13:30.991405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983826e-a791-4fd0-a42c-d45b022cc4c8 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:31.018044 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983826e-a791-4fd0-a42c-d45b022cc4c8 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:31.124236 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3587718-b1f7-4865-8bf2-4481505c7b8e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:31.128135 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a3587718-b1f7-4865-8bf2-4481505c7b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:31.151443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84c70b-0b0d-4437-ab4d-23f461901312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:31.152580 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84c70b-0b0d-4437-ab4d-23f461901312 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:31.153131 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84c70b-0b0d-4437-ab4d-23f461901312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:31.153632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84c70b-0b0d-4437-ab4d-23f461901312 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:31.154499 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84c70b-0b0d-4437-ab4d-23f461901312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:31.156505 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84c70b-0b0d-4437-ab4d-23f461901312 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:31.198197 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1259/2509] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:13:30 2022] POST /identity/v3/users => generated 307 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:13:31.200062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84c70b-0b0d-4437-ab4d-23f461901312 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:31.214505 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84c70b-0b0d-4437-ab4d-23f461901312 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:31.222452 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e606d-cb18-4358-bd6b-07dab3839b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:31.223671 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e606d-cb18-4358-bd6b-07dab3839b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:31.223989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e606d-cb18-4358-bd6b-07dab3839b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:31.224287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e606d-cb18-4358-bd6b-07dab3839b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:31.225193 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e606d-cb18-4358-bd6b-07dab3839b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:31.229072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e606d-cb18-4358-bd6b-07dab3839b67 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:31.250078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1260/2510] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:13:31.251872 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e606d-cb18-4358-bd6b-07dab3839b67 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:31.263226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3587718-b1f7-4865-8bf2-4481505c7b8e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:31.270423 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbd8a4-7b34-48bc-aea8-be4e06c0b35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:31.271525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbd8a4-7b34-48bc-aea8-be4e06c0b35c service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:31.272068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbd8a4-7b34-48bc-aea8-be4e06c0b35c service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:31.272595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbd8a4-7b34-48bc-aea8-be4e06c0b35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:31.272953 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e606d-cb18-4358-bd6b-07dab3839b67 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:31.275881 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-07cbd8a4-7b34-48bc-aea8-be4e06c0b35c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:31.281029 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f44046-95dd-4a62-a4c8-1a1ab9466a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:31.282758 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f44046-95dd-4a62-a4c8-1a1ab9466a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:31.283248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f44046-95dd-4a62-a4c8-1a1ab9466a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:31.283707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f44046-95dd-4a62-a4c8-1a1ab9466a4e admin admin] PATH_INFO: `/v3/projects/a49746b4bd29421dacdec47eba807a5b/users/58d34dfc312a4e7bb60065aa1207fb43/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:31.297041 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:31.318830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f44046-95dd-4a62-a4c8-1a1ab9466a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49746b4bd29421dacdec47eba807a5b, user_id=58d34dfc312a4e7bb60065aa1207fb43, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:31.324217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f44046-95dd-4a62-a4c8-1a1ab9466a4e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:31.349086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1261/2511] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:13:31 2022] PUT /identity/v3/projects/a49746b4bd29421dacdec47eba807a5b/users/58d34dfc312a4e7bb60065aa1207fb43/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:31.355158 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f44046-95dd-4a62-a4c8-1a1ab9466a4e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:31.381312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:31.410838 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbd8a4-7b34-48bc-aea8-be4e06c0b35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:31.412980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbd8a4-7b34-48bc-aea8-be4e06c0b35c service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:31.434246 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1251/2512] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:31.450801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f44046-95dd-4a62-a4c8-1a1ab9466a4e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:31.461004 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3446c-0222-4bfc-aeb9-b620b88933e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:31.463588 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3446c-0222-4bfc-aeb9-b620b88933e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:31.464317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3446c-0222-4bfc-aeb9-b620b88933e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:31.465280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3446c-0222-4bfc-aeb9-b620b88933e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:31.468183 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3446c-0222-4bfc-aeb9-b620b88933e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:31.473177 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3446c-0222-4bfc-aeb9-b620b88933e6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:31.486055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1262/2513] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:13:31.491453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbd8a4-7b34-48bc-aea8-be4e06c0b35c service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:31.508362 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbd8a4-7b34-48bc-aea8-be4e06c0b35c service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:31.517229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bfd81-808c-45b8-ad9d-e6fcb28aa601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:31.518470 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bfd81-808c-45b8-ad9d-e6fcb28aa601 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:31.519675 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bfd81-808c-45b8-ad9d-e6fcb28aa601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:31.520036 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bfd81-808c-45b8-ad9d-e6fcb28aa601 admin admin] PATH_INFO: `/v3/projects/a49746b4bd29421dacdec47eba807a5b/users/58d34dfc312a4e7bb60065aa1207fb43/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:31.522434 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bfd81-808c-45b8-ad9d-e6fcb28aa601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49746b4bd29421dacdec47eba807a5b, user_id=58d34dfc312a4e7bb60065aa1207fb43, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:31.525304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bfd81-808c-45b8-ad9d-e6fcb28aa601 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:31.542016 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1252/2514] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:13:31 2022] PUT /identity/v3/projects/a49746b4bd29421dacdec47eba807a5b/users/58d34dfc312a4e7bb60065aa1207fb43/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:13:31.552506 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d66c9e-dc2d-4757-9667-19bacab89f6c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:31.552797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d66c9e-dc2d-4757-9667-19bacab89f6c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:31.553051 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d66c9e-dc2d-4757-9667-19bacab89f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:31.611832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d5d66c9e-dc2d-4757-9667-19bacab89f6c None None] MFA Rules not processed for user `58d34dfc312a4e7bb60065aa1207fb43`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:31.614727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d5d66c9e-dc2d-4757-9667-19bacab89f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:31.743076 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1263/2515] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:31 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:31.756679 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bfd81-808c-45b8-ad9d-e6fcb28aa601 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:31.766162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-746bfd81-808c-45b8-ad9d-e6fcb28aa601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:31.850168 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bfd81-808c-45b8-ad9d-e6fcb28aa601 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:31.857274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54420aa4-c015-405d-afec-3556a9ebe251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:31.861376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54420aa4-c015-405d-afec-3556a9ebe251 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:31.865781 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54420aa4-c015-405d-afec-3556a9ebe251 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:31.868092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54420aa4-c015-405d-afec-3556a9ebe251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:31.895096 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54420aa4-c015-405d-afec-3556a9ebe251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:31.897485 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54420aa4-c015-405d-afec-3556a9ebe251 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:31.917561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1253/2516] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:31 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:32.063843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d66c9e-dc2d-4757-9667-19bacab89f6c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:32.079464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d66c9e-dc2d-4757-9667-19bacab89f6c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:32.085626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42321304-b40a-4cb6-bd7f-790af03dde76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:32.087141 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42321304-b40a-4cb6-bd7f-790af03dde76 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:32.087957 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42321304-b40a-4cb6-bd7f-790af03dde76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:32.089303 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42321304-b40a-4cb6-bd7f-790af03dde76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:32.217367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42321304-b40a-4cb6-bd7f-790af03dde76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:32.221120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42321304-b40a-4cb6-bd7f-790af03dde76 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:32.244821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1264/2517] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:36.846841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54420aa4-c015-405d-afec-3556a9ebe251 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:36.946994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54420aa4-c015-405d-afec-3556a9ebe251 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:36.955407 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fe10a-4446-4fd1-9ed6-25b4941803fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:36.956743 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fe10a-4446-4fd1-9ed6-25b4941803fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:36.961097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fe10a-4446-4fd1-9ed6-25b4941803fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:36.961097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fe10a-4446-4fd1-9ed6-25b4941803fb admin admin] PATH_INFO: `/v3/users/b7ca5c98895b4fa49e0281911b58b158` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:36.961097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198fe10a-4446-4fd1-9ed6-25b4941803fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ca5c98895b4fa49e0281911b58b158)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:36.963244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198fe10a-4446-4fd1-9ed6-25b4941803fb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:37.009169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:37.032674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-198fe10a-4446-4fd1-9ed6-25b4941803fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ca5c98895b4fa49e0281911b58b158'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:37.033410 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-198fe10a-4446-4fd1-9ed6-25b4941803fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ca5c98895b4fa49e0281911b58b158'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:37.043203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-198fe10a-4446-4fd1-9ed6-25b4941803fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ca5c98895b4fa49e0281911b58b158'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:37.057708 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-198fe10a-4446-4fd1-9ed6-25b4941803fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ca5c98895b4fa49e0281911b58b158'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:37.066021 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-198fe10a-4446-4fd1-9ed6-25b4941803fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ca5c98895b4fa49e0281911b58b158'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:37.073317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1254/2518] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:13:36 2022] DELETE /identity/v3/users/b7ca5c98895b4fa49e0281911b58b158 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:13:37.079431 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457b876-bdb3-4e0a-b540-a6810e7bb6d5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:37.080002 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457b876-bdb3-4e0a-b540-a6810e7bb6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:37.080143 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457b876-bdb3-4e0a-b540-a6810e7bb6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:37.105935 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a457b876-bdb3-4e0a-b540-a6810e7bb6d5 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:37.107698 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a457b876-bdb3-4e0a-b540-a6810e7bb6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:37.141016 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:37.194895 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1265/2519] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:37.207888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fe10a-4446-4fd1-9ed6-25b4941803fb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:37.209614 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-198fe10a-4446-4fd1-9ed6-25b4941803fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:37.296224 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fe10a-4446-4fd1-9ed6-25b4941803fb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:37.301150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620019f0-a5bd-42f4-b01a-5ca589d35374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:37.302550 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620019f0-a5bd-42f4-b01a-5ca589d35374 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:37.302742 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620019f0-a5bd-42f4-b01a-5ca589d35374 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:37.302968 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620019f0-a5bd-42f4-b01a-5ca589d35374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:37.321497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620019f0-a5bd-42f4-b01a-5ca589d35374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:37.324056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620019f0-a5bd-42f4-b01a-5ca589d35374 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:37.341981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1255/2520] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:13:37.678947 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457b876-bdb3-4e0a-b540-a6810e7bb6d5 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:37.680785 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a457b876-bdb3-4e0a-b540-a6810e7bb6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:37.694039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457b876-bdb3-4e0a-b540-a6810e7bb6d5 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:37.701478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d420a1f-06ad-4319-be96-50963144eee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:37.702919 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d420a1f-06ad-4319-be96-50963144eee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:37.703450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d420a1f-06ad-4319-be96-50963144eee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:37.703962 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d420a1f-06ad-4319-be96-50963144eee7 admin admin] PATH_INFO: `/v3/projects/b6eb7b1086104420a464dee83ad0fb25` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:37.706615 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d420a1f-06ad-4319-be96-50963144eee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6eb7b1086104420a464dee83ad0fb25)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:37.709005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d420a1f-06ad-4319-be96-50963144eee7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:37.794207 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5d420a1f-06ad-4319-be96-50963144eee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6eb7b1086104420a464dee83ad0fb25', 'request_id': 'req-5d420a1f-06ad-4319-be96-50963144eee7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:37.801937 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5d420a1f-06ad-4319-be96-50963144eee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6eb7b1086104420a464dee83ad0fb25', 'request_id': 'req-5d420a1f-06ad-4319-be96-50963144eee7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:37.809651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5d420a1f-06ad-4319-be96-50963144eee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6eb7b1086104420a464dee83ad0fb25', 'request_id': 'req-5d420a1f-06ad-4319-be96-50963144eee7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:37.832008 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5d420a1f-06ad-4319-be96-50963144eee7 admin admin] The token cache is being invalidate because project b6eb7b1086104420a464dee83ad0fb25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:13:37.832470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5d420a1f-06ad-4319-be96-50963144eee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:37.833039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5d420a1f-06ad-4319-be96-50963144eee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:37.834985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1266/2521] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:13:37 2022] DELETE /identity/v3/projects/b6eb7b1086104420a464dee83ad0fb25 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:37.839332 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620019f0-a5bd-42f4-b01a-5ca589d35374 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:37.854625 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620019f0-a5bd-42f4-b01a-5ca589d35374 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:37.973627 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d7ff6-3600-4a28-96a9-7af99f56e8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:37.975593 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d7ff6-3600-4a28-96a9-7af99f56e8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:37.976222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d7ff6-3600-4a28-96a9-7af99f56e8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:37.977171 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d7ff6-3600-4a28-96a9-7af99f56e8f0 admin admin] PATH_INFO: `/v3/users/58d34dfc312a4e7bb60065aa1207fb43` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:37.979447 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d7ff6-3600-4a28-96a9-7af99f56e8f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d34dfc312a4e7bb60065aa1207fb43)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:37.983837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d7ff6-3600-4a28-96a9-7af99f56e8f0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:38.084332 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-611d7ff6-3600-4a28-96a9-7af99f56e8f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d34dfc312a4e7bb60065aa1207fb43'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:38.085585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-611d7ff6-3600-4a28-96a9-7af99f56e8f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d34dfc312a4e7bb60065aa1207fb43'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:38.092238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:38.114835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-611d7ff6-3600-4a28-96a9-7af99f56e8f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d34dfc312a4e7bb60065aa1207fb43'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:38.131477 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-611d7ff6-3600-4a28-96a9-7af99f56e8f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d34dfc312a4e7bb60065aa1207fb43'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:38.142722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-611d7ff6-3600-4a28-96a9-7af99f56e8f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d34dfc312a4e7bb60065aa1207fb43'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:38.151678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1256/2522] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:13:37 2022] DELETE /identity/v3/users/58d34dfc312a4e7bb60065aa1207fb43 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:38.505128 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d420a1f-06ad-4319-be96-50963144eee7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:38.506733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5d420a1f-06ad-4319-be96-50963144eee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:38.533681 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d420a1f-06ad-4319-be96-50963144eee7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:38.644696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372e98e-359e-4b02-b376-6a4b44462053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:38.646054 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372e98e-359e-4b02-b376-6a4b44462053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:38.646471 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372e98e-359e-4b02-b376-6a4b44462053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:38.646875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372e98e-359e-4b02-b376-6a4b44462053 admin admin] PATH_INFO: `/v3/projects/a49746b4bd29421dacdec47eba807a5b` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:38.649155 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372e98e-359e-4b02-b376-6a4b44462053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a49746b4bd29421dacdec47eba807a5b)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:38.652694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372e98e-359e-4b02-b376-6a4b44462053 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:38.725500 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7372e98e-359e-4b02-b376-6a4b44462053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a49746b4bd29421dacdec47eba807a5b', 'request_id': 'req-7372e98e-359e-4b02-b376-6a4b44462053'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:38.730145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:38.740306 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7372e98e-359e-4b02-b376-6a4b44462053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a49746b4bd29421dacdec47eba807a5b', 'request_id': 'req-7372e98e-359e-4b02-b376-6a4b44462053'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:38.748936 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7372e98e-359e-4b02-b376-6a4b44462053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a49746b4bd29421dacdec47eba807a5b', 'request_id': 'req-7372e98e-359e-4b02-b376-6a4b44462053'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:38.766086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7372e98e-359e-4b02-b376-6a4b44462053 admin admin] The token cache is being invalidate because project a49746b4bd29421dacdec47eba807a5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:13:38.766288 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7372e98e-359e-4b02-b376-6a4b44462053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:38.767081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7372e98e-359e-4b02-b376-6a4b44462053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:38.768743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1267/2523] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:13:38 2022] DELETE /identity/v3/projects/a49746b4bd29421dacdec47eba807a5b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:38.775834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be9028-4700-4c60-b37d-353cbf6126e6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:38.776313 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be9028-4700-4c60-b37d-353cbf6126e6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:38.776677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be9028-4700-4c60-b37d-353cbf6126e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:38.807061 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c6be9028-4700-4c60-b37d-353cbf6126e6 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:38.808746 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c6be9028-4700-4c60-b37d-353cbf6126e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:38.891834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1257/2524] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:13:38.894494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47634900-1d73-4d8d-ad30-fbce533089a1 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:38.894988 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47634900-1d73-4d8d-ad30-fbce533089a1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:38.895414 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47634900-1d73-4d8d-ad30-fbce533089a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:38.922118 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-47634900-1d73-4d8d-ad30-fbce533089a1 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:38.924666 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-47634900-1d73-4d8d-ad30-fbce533089a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:38.939918 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1268/2525] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:38.945405 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be9028-4700-4c60-b37d-353cbf6126e6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:38.957158 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be9028-4700-4c60-b37d-353cbf6126e6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:38.962219 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e5509-9316-49cc-a2e0-f878a4621a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:38.962915 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e5509-9316-49cc-a2e0-f878a4621a76 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:38.963231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e5509-9316-49cc-a2e0-f878a4621a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:38.963516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e5509-9316-49cc-a2e0-f878a4621a76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:38.964263 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e5509-9316-49cc-a2e0-f878a4621a76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:13:38.964572 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e5509-9316-49cc-a2e0-f878a4621a76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:38.966285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e5509-9316-49cc-a2e0-f878a4621a76 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:38.980427 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1258/2526] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:13:38.985954 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47634900-1d73-4d8d-ad30-fbce533089a1 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:38.997231 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47634900-1d73-4d8d-ad30-fbce533089a1 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:39.006322 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ddea0-0835-484b-90e3-d2a716b906e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:39.007452 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ddea0-0835-484b-90e3-d2a716b906e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:39.007926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ddea0-0835-484b-90e3-d2a716b906e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:39.008393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ddea0-0835-484b-90e3-d2a716b906e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:39.009641 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ddea0-0835-484b-90e3-d2a716b906e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:39.013255 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ddea0-0835-484b-90e3-d2a716b906e9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:39.066219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1269/2527] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:13:38 2022] POST /identity/v3/projects => generated 403 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:13:39.070748 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e5509-9316-49cc-a2e0-f878a4621a76 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:39.098706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e5509-9316-49cc-a2e0-f878a4621a76 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:39.105230 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ddea0-0835-484b-90e3-d2a716b906e9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:39.107710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0b4ddea0-0835-484b-90e3-d2a716b906e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:39.181229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ddea0-0835-484b-90e3-d2a716b906e9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:39.183846 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe1082-a3ab-4398-aa4c-2ba5c962bb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:39.186679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229d427-7ec5-4fd6-8456-7ceb1ed07ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:39.187237 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe1082-a3ab-4398-aa4c-2ba5c962bb79 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:39.187703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe1082-a3ab-4398-aa4c-2ba5c962bb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:39.187822 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229d427-7ec5-4fd6-8456-7ceb1ed07ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:39.188155 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229d427-7ec5-4fd6-8456-7ceb1ed07ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:39.188506 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe1082-a3ab-4398-aa4c-2ba5c962bb79 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:39.188615 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229d427-7ec5-4fd6-8456-7ceb1ed07ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:39.189698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe1082-a3ab-4398-aa4c-2ba5c962bb79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:39.191501 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e229d427-7ec5-4fd6-8456-7ceb1ed07ee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:39.193183 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe1082-a3ab-4398-aa4c-2ba5c962bb79 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:39.208596 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229d427-7ec5-4fd6-8456-7ceb1ed07ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:39.211535 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229d427-7ec5-4fd6-8456-7ceb1ed07ee5 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:39.224853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1259/2528] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:13:39 2022] POST /identity/v3/users => generated 302 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:13:39.231394 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1270/2529] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:39.235380 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe1082-a3ab-4398-aa4c-2ba5c962bb79 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:39.247263 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe1082-a3ab-4398-aa4c-2ba5c962bb79 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:39.252250 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ee644-921f-4840-b6e1-dac7fb28359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:39.253105 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ee644-921f-4840-b6e1-dac7fb28359a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:39.253385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ee644-921f-4840-b6e1-dac7fb28359a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:39.253696 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ee644-921f-4840-b6e1-dac7fb28359a admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:39.254465 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ee644-921f-4840-b6e1-dac7fb28359a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:39.256108 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ee644-921f-4840-b6e1-dac7fb28359a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:39.267100 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1260/2530] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:13:39.271386 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229d427-7ec5-4fd6-8456-7ceb1ed07ee5 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:39.284526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229d427-7ec5-4fd6-8456-7ceb1ed07ee5 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:39.289605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4b51a-a070-43c1-9fca-4641328bcec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:39.290336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4b51a-a070-43c1-9fca-4641328bcec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:39.290660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4b51a-a070-43c1-9fca-4641328bcec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:39.291225 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4b51a-a070-43c1-9fca-4641328bcec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:39.291828 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4b51a-a070-43c1-9fca-4641328bcec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:39.293558 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4b51a-a070-43c1-9fca-4641328bcec0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:39.315342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1271/2531] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:13:39.318405 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ee644-921f-4840-b6e1-dac7fb28359a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:39.334520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ee644-921f-4840-b6e1-dac7fb28359a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:39.357035 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dccc4-7ca3-445c-b713-16b0a1d54c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:39.358171 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dccc4-7ca3-445c-b713-16b0a1d54c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:39.358436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dccc4-7ca3-445c-b713-16b0a1d54c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:39.358719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dccc4-7ca3-445c-b713-16b0a1d54c5f admin admin] PATH_INFO: `/v3/projects/ae1a0666af0641f1950256f9fc20b315/users/c157b40f668f4b16b96c672152769a34/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:39.404330 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7dccc4-7ca3-445c-b713-16b0a1d54c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1a0666af0641f1950256f9fc20b315, user_id=c157b40f668f4b16b96c672152769a34, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:39.405637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535d83b-7bec-4cdc-b9d6-a8a6d07eb82d None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:39.406883 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535d83b-7bec-4cdc-b9d6-a8a6d07eb82d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:39.407498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535d83b-7bec-4cdc-b9d6-a8a6d07eb82d None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:39.410208 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1272/2532] 10.222.0.61 () {54 vars in 921 bytes} [Thu May 26 21:13:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:39.411096 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7dccc4-7ca3-445c-b713-16b0a1d54c5f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:39.419470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407d031-a67a-4155-9f32-dc91f3e34e75 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:39.419823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407d031-a67a-4155-9f32-dc91f3e34e75 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:39.420100 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407d031-a67a-4155-9f32-dc91f3e34e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:39.436888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1261/2533] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:13:39 2022] PUT /identity/v3/projects/ae1a0666af0641f1950256f9fc20b315/users/c157b40f668f4b16b96c672152769a34/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:39.455021 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e955c32-0914-4724-8857-ce5650186011 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:39.457188 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e955c32-0914-4724-8857-ce5650186011 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:39.457594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e955c32-0914-4724-8857-ce5650186011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:39.459593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e407d031-a67a-4155-9f32-dc91f3e34e75 None None] MFA Rules not processed for user `a99b767501244338bc48fb5428a589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:39.461833 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e407d031-a67a-4155-9f32-dc91f3e34e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:39.498498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:39.516344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2e955c32-0914-4724-8857-ce5650186011 None None] MFA Rules not processed for user `c157b40f668f4b16b96c672152769a34`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:39.519169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2e955c32-0914-4724-8857-ce5650186011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:39.600552 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1273/2534] 10.222.0.61 () {58 vars in 1018 bytes} [Thu May 26 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:39.621251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407d031-a67a-4155-9f32-dc91f3e34e75 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:39.623772 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e407d031-a67a-4155-9f32-dc91f3e34e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:39.657309 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1262/2535] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:39.663481 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e955c32-0914-4724-8857-ce5650186011 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:39.681747 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:39.709014 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407d031-a67a-4155-9f32-dc91f3e34e75 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:39.715336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e6bdc-21a6-40b1-92d0-dbaef0f95bfe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7e1c8c42cd4f6dab8b27829e5fc5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:39.716476 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e6bdc-21a6-40b1-92d0-dbaef0f95bfe service glance] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:39.716985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e6bdc-21a6-40b1-92d0-dbaef0f95bfe service glance] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:39.717456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e6bdc-21a6-40b1-92d0-dbaef0f95bfe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:39.738043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e6bdc-21a6-40b1-92d0-dbaef0f95bfe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:39.740612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e6bdc-21a6-40b1-92d0-dbaef0f95bfe service glance] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:39.762484 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1274/2536] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:39.773012 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e955c32-0914-4724-8857-ce5650186011 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:39.778694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e6bdc-21a6-40b1-92d0-dbaef0f95bfe service glance] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:39.784360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea4d7b-8f39-4d65-9509-b0cafecf926e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:39.786665 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea4d7b-8f39-4d65-9509-b0cafecf926e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:39.787020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea4d7b-8f39-4d65-9509-b0cafecf926e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:39.787359 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea4d7b-8f39-4d65-9509-b0cafecf926e admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:39.788141 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea4d7b-8f39-4d65-9509-b0cafecf926e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:39.790371 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea4d7b-8f39-4d65-9509-b0cafecf926e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:39.791696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e6bdc-21a6-40b1-92d0-dbaef0f95bfe service glance] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:39.797756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef145c29-8563-46fb-ba86-2a77fea4b8bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7e1c8c42cd4f6dab8b27829e5fc5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:39.802524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef145c29-8563-46fb-ba86-2a77fea4b8bc service glance] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:39.802524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef145c29-8563-46fb-ba86-2a77fea4b8bc service glance] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:39.802524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef145c29-8563-46fb-ba86-2a77fea4b8bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:39.804095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ef145c29-8563-46fb-ba86-2a77fea4b8bc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:39.828119 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1263/2537] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:13:39 2022] POST /identity/v3/projects => generated 407 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:13:39.832675 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea4d7b-8f39-4d65-9509-b0cafecf926e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:39.891101 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef145c29-8563-46fb-ba86-2a77fea4b8bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:39.893105 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef145c29-8563-46fb-ba86-2a77fea4b8bc service glance] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:39.904551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1275/2538] 10.222.0.61 () {60 vars in 1396 bytes} [Thu May 26 21:13:39 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:39.919059 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea4d7b-8f39-4d65-9509-b0cafecf926e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:39.925555 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53038a4-5ce9-46aa-81ac-5fea7a35009e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:39.926616 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53038a4-5ce9-46aa-81ac-5fea7a35009e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:39.927008 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53038a4-5ce9-46aa-81ac-5fea7a35009e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:39.927374 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53038a4-5ce9-46aa-81ac-5fea7a35009e admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:39.928302 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53038a4-5ce9-46aa-81ac-5fea7a35009e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:39.930716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53038a4-5ce9-46aa-81ac-5fea7a35009e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:39.963436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1264/2539] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:13:39 2022] POST /identity/v3/users => generated 310 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:13:39.967519 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef145c29-8563-46fb-ba86-2a77fea4b8bc service glance] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:39.981011 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef145c29-8563-46fb-ba86-2a77fea4b8bc service glance] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:39.988526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e77449-dc0a-49d8-ac4c-07e82e24d96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:39.990397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e77449-dc0a-49d8-ac4c-07e82e24d96e admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:39.990743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e77449-dc0a-49d8-ac4c-07e82e24d96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:39.991165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e77449-dc0a-49d8-ac4c-07e82e24d96e admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:39.992966 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8cd95-a4e5-4f5d-916e-e212d2dcfcc9 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:39.993320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8cd95-a4e5-4f5d-916e-e212d2dcfcc9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:39.993631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8cd95-a4e5-4f5d-916e-e212d2dcfcc9 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:39.994660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e77449-dc0a-49d8-ac4c-07e82e24d96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:39.995284 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1265/2540] 10.222.0.61 () {54 vars in 921 bytes} [Thu May 26 21:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:39.996356 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e77449-dc0a-49d8-ac4c-07e82e24d96e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:40.003523 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfc6dd-d8f7-41e8-8201-4b435c91a573 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:40.003977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfc6dd-d8f7-41e8-8201-4b435c91a573 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:40.004301 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfc6dd-d8f7-41e8-8201-4b435c91a573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:40.009275 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1276/2541] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:13:40.015431 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e77449-dc0a-49d8-ac4c-07e82e24d96e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:40.024249 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a2cfc6dd-d8f7-41e8-8201-4b435c91a573 None None] MFA Rules not processed for user `e3514a1833104114894abe6c41ea30a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:40.025478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a2cfc6dd-d8f7-41e8-8201-4b435c91a573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:40.033984 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e77449-dc0a-49d8-ac4c-07e82e24d96e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:40.039698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:40.042624 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9f127-0f34-44b8-bfff-8882fc2410a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:40.043564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9f127-0f34-44b8-bfff-8882fc2410a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:40.043852 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9f127-0f34-44b8-bfff-8882fc2410a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:40.044797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9f127-0f34-44b8-bfff-8882fc2410a1 admin admin] PATH_INFO: `/v3/projects/b15511ab599e4dffbe32511fa6528b98/users/c01f66a793da409a9a62302d1ae983f5/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:40.064970 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9f127-0f34-44b8-bfff-8882fc2410a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b15511ab599e4dffbe32511fa6528b98, user_id=c01f66a793da409a9a62302d1ae983f5, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:40.067759 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9f127-0f34-44b8-bfff-8882fc2410a1 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:40.083581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1277/2542] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:13:40 2022] PUT /identity/v3/projects/b15511ab599e4dffbe32511fa6528b98/users/c01f66a793da409a9a62302d1ae983f5/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:13:40.088894 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9f127-0f34-44b8-bfff-8882fc2410a1 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:40.111559 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1266/2543] 10.222.0.61 () {58 vars in 1018 bytes} [Thu May 26 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:13:40.126520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfc6dd-d8f7-41e8-8201-4b435c91a573 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:40.129972 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a2cfc6dd-d8f7-41e8-8201-4b435c91a573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:40.145465 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfc6dd-d8f7-41e8-8201-4b435c91a573 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:40.170672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9f127-0f34-44b8-bfff-8882fc2410a1 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:40.177283 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd36c5-f794-43ac-8d88-4aece6ca6345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:40.178011 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd36c5-f794-43ac-8d88-4aece6ca6345 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:40.178829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd36c5-f794-43ac-8d88-4aece6ca6345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:40.178829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd36c5-f794-43ac-8d88-4aece6ca6345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:40.179426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd36c5-f794-43ac-8d88-4aece6ca6345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:40.181080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd36c5-f794-43ac-8d88-4aece6ca6345 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:40.196392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1278/2544] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:13:40.201922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd36c5-f794-43ac-8d88-4aece6ca6345 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:40.214751 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202a7bf-ade9-42f6-9cb9-7c461e5dd3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:40.215017 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd36c5-f794-43ac-8d88-4aece6ca6345 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:40.215894 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202a7bf-ade9-42f6-9cb9-7c461e5dd3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:40.216988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202a7bf-ade9-42f6-9cb9-7c461e5dd3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:40.216988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202a7bf-ade9-42f6-9cb9-7c461e5dd3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:40.222468 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea97e38-1692-4717-979a-7c50caccc585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:40.223578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea97e38-1692-4717-979a-7c50caccc585 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:40.223949 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea97e38-1692-4717-979a-7c50caccc585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:40.224375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea97e38-1692-4717-979a-7c50caccc585 admin admin] PATH_INFO: `/v3/projects/b15511ab599e4dffbe32511fa6528b98/users/c01f66a793da409a9a62302d1ae983f5/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:40.226925 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea97e38-1692-4717-979a-7c50caccc585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b15511ab599e4dffbe32511fa6528b98, user_id=c01f66a793da409a9a62302d1ae983f5, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:40.227320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202a7bf-ade9-42f6-9cb9-7c461e5dd3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:40.228869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202a7bf-ade9-42f6-9cb9-7c461e5dd3f4 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:40.229818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea97e38-1692-4717-979a-7c50caccc585 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:40.238734 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1267/2545] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:40.242581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1279/2546] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:13:40 2022] PUT /identity/v3/projects/b15511ab599e4dffbe32511fa6528b98/users/c01f66a793da409a9a62302d1ae983f5/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:13:40.253178 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab2d7e-9610-45e3-8d31-2257a0dd5ade None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:40.253486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab2d7e-9610-45e3-8d31-2257a0dd5ade None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:40.253723 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab2d7e-9610-45e3-8d31-2257a0dd5ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:40.292403 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ceab2d7e-9610-45e3-8d31-2257a0dd5ade None None] MFA Rules not processed for user `c01f66a793da409a9a62302d1ae983f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:40.293666 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ceab2d7e-9610-45e3-8d31-2257a0dd5ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:40.338062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4e834-d32f-499a-915f-b4ac01b0e7b2 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:40.338456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4e834-d32f-499a-915f-b4ac01b0e7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:40.338862 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4e834-d32f-499a-915f-b4ac01b0e7b2 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:40.340375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1280/2547] 10.222.0.61 () {54 vars in 921 bytes} [Thu May 26 21:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 21:13:40.347309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1594e0-5e12-4356-994e-4952e5f20ca2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:40.347617 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1594e0-5e12-4356-994e-4952e5f20ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:40.347850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1594e0-5e12-4356-994e-4952e5f20ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:40.368236 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-7f1594e0-5e12-4356-994e-4952e5f20ca2 None None] MFA Rules not processed for user `a99b767501244338bc48fb5428a589a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:40.369668 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7f1594e0-5e12-4356-994e-4952e5f20ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:40.392854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:40.406369 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1268/2548] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:40.419669 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab2d7e-9610-45e3-8d31-2257a0dd5ade None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:40.422020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ceab2d7e-9610-45e3-8d31-2257a0dd5ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:40.468087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1281/2549] 10.222.0.61 () {58 vars in 1018 bytes} [Thu May 26 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:13:40.483414 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1594e0-5e12-4356-994e-4952e5f20ca2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:40.502598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab2d7e-9610-45e3-8d31-2257a0dd5ade None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:40.507099 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2a828-bb81-40af-afd2-402f34a57a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:40.507943 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2a828-bb81-40af-afd2-402f34a57a80 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:40.508231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2a828-bb81-40af-afd2-402f34a57a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:40.508654 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2a828-bb81-40af-afd2-402f34a57a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:40.516318 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:40.522356 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2a828-bb81-40af-afd2-402f34a57a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:40.523824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2a828-bb81-40af-afd2-402f34a57a80 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:40.535949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1269/2550] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:40 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:13:40.554786 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1594e0-5e12-4356-994e-4952e5f20ca2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:40.562150 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b795a9c-f9f6-400c-b974-f0fc7ce993db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:40.563268 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b795a9c-f9f6-400c-b974-f0fc7ce993db service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:40.563644 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b795a9c-f9f6-400c-b974-f0fc7ce993db service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:40.564032 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b795a9c-f9f6-400c-b974-f0fc7ce993db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:40.577451 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b795a9c-f9f6-400c-b974-f0fc7ce993db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:40.580318 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b795a9c-f9f6-400c-b974-f0fc7ce993db service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:40.594999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1282/2551] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:13:40.672269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2a828-bb81-40af-afd2-402f34a57a80 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:40.674745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-33c2a828-bb81-40af-afd2-402f34a57a80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:40.787990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2a828-bb81-40af-afd2-402f34a57a80 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:40.798636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaeac5-8a7b-489d-8fc1-1ba2840fafa7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8952f35c21c4a2eaf1fbc601fe76242', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:40.799736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaeac5-8a7b-489d-8fc1-1ba2840fafa7 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:40.800007 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaeac5-8a7b-489d-8fc1-1ba2840fafa7 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:40.800293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaeac5-8a7b-489d-8fc1-1ba2840fafa7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:40.802719 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1aaaeac5-8a7b-489d-8fc1-1ba2840fafa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:40.805557 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b795a9c-f9f6-400c-b974-f0fc7ce993db service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:40.819217 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaaeac5-8a7b-489d-8fc1-1ba2840fafa7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:40.821027 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaaeac5-8a7b-489d-8fc1-1ba2840fafa7 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:40.822551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b795a9c-f9f6-400c-b974-f0fc7ce993db service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:40.829285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816b9fc-ad47-424a-906d-53c1721c36ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:40.830024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816b9fc-ad47-424a-906d-53c1721c36ac service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:40.830329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816b9fc-ad47-424a-906d-53c1721c36ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:40.830595 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816b9fc-ad47-424a-906d-53c1721c36ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:40.832758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1270/2552] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:40.927443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816b9fc-ad47-424a-906d-53c1721c36ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:40.930126 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816b9fc-ad47-424a-906d-53c1721c36ac service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:40.946152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1283/2553] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:42.856846 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faa864-3f24-4ceb-95bc-6f56909881e4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:42.857423 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faa864-3f24-4ceb-95bc-6f56909881e4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:42.857423 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faa864-3f24-4ceb-95bc-6f56909881e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:42.876937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b0faa864-3f24-4ceb-95bc-6f56909881e4 None None] MFA Rules not processed for user `3953b14656774edb92da1ecdb4bbbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:42.878201 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b0faa864-3f24-4ceb-95bc-6f56909881e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:42.963946 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1271/2554] 10.222.0.61 () {58 vars in 1009 bytes} [Thu May 26 21:13:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:13:42.980379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816b9fc-ad47-424a-906d-53c1721c36ac service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:42.982013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9816b9fc-ad47-424a-906d-53c1721c36ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:43.063402 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:43.088305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816b9fc-ad47-424a-906d-53c1721c36ac service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:43.094127 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed893aa0-9bea-4849-a8cc-7c839c6316c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a63879ec1242d08bba1ccad6212788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:43.095021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed893aa0-9bea-4849-a8cc-7c839c6316c7 service swift] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:43.095310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed893aa0-9bea-4849-a8cc-7c839c6316c7 service swift] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:43.095597 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed893aa0-9bea-4849-a8cc-7c839c6316c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:43.106603 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed893aa0-9bea-4849-a8cc-7c839c6316c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:43.109556 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed893aa0-9bea-4849-a8cc-7c839c6316c7 service swift] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:43.123485 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1284/2555] 10.222.0.61 () {60 vars in 1384 bytes} [Thu May 26 21:13:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:13:47.025646 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0faa864-3f24-4ceb-95bc-6f56909881e4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:47.030767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b0faa864-3f24-4ceb-95bc-6f56909881e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:47.069278 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0faa864-3f24-4ceb-95bc-6f56909881e4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:47.077019 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca81c55-6f0f-4e5a-86b4-cb6a7f77ba76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:47.078313 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca81c55-6f0f-4e5a-86b4-cb6a7f77ba76 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:47.078864 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca81c55-6f0f-4e5a-86b4-cb6a7f77ba76 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:47.079439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca81c55-6f0f-4e5a-86b4-cb6a7f77ba76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:47.082081 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7ca81c55-6f0f-4e5a-86b4-cb6a7f77ba76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:47.143500 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed893aa0-9bea-4849-a8cc-7c839c6316c7 service swift] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:47.247873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca81c55-6f0f-4e5a-86b4-cb6a7f77ba76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:47.251277 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca81c55-6f0f-4e5a-86b4-cb6a7f77ba76 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:47.297041 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1272/2556] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:47.333518 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed893aa0-9bea-4849-a8cc-7c839c6316c7 service swift] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:47.360830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f92ec-922f-494a-9b06-9699f9a8c11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:47.360830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f92ec-922f-494a-9b06-9699f9a8c11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:47.360830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f92ec-922f-494a-9b06-9699f9a8c11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:47.360830 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f92ec-922f-494a-9b06-9699f9a8c11a admin admin] PATH_INFO: `/v3/users/c157b40f668f4b16b96c672152769a34` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:47.362303 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f92ec-922f-494a-9b06-9699f9a8c11a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c157b40f668f4b16b96c672152769a34)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:47.368265 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f92ec-922f-494a-9b06-9699f9a8c11a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:47.547516 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ff9f92ec-922f-494a-9b06-9699f9a8c11a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c157b40f668f4b16b96c672152769a34'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:47.599846 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ff9f92ec-922f-494a-9b06-9699f9a8c11a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c157b40f668f4b16b96c672152769a34'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:47.601468 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ff9f92ec-922f-494a-9b06-9699f9a8c11a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c157b40f668f4b16b96c672152769a34'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:47.616887 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ff9f92ec-922f-494a-9b06-9699f9a8c11a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c157b40f668f4b16b96c672152769a34'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:47.636648 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ff9f92ec-922f-494a-9b06-9699f9a8c11a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c157b40f668f4b16b96c672152769a34'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:47.648595 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1285/2557] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:13:47 2022] DELETE /identity/v3/users/c157b40f668f4b16b96c672152769a34 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:47.654387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd3a2a-a624-4e54-8347-51d92ecb91e0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:47.654701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd3a2a-a624-4e54-8347-51d92ecb91e0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:47.654948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd3a2a-a624-4e54-8347-51d92ecb91e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:47.691000 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c8cd3a2a-a624-4e54-8347-51d92ecb91e0 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:47.697565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c8cd3a2a-a624-4e54-8347-51d92ecb91e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:47.757715 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:47.870337 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1273/2558] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:13:47.887331 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f92ec-922f-494a-9b06-9699f9a8c11a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:47.889651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ff9f92ec-922f-494a-9b06-9699f9a8c11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:48.044067 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f92ec-922f-494a-9b06-9699f9a8c11a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:48.052859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67ef19-02a5-4a14-99fe-70d69f7a783f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:48.054537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67ef19-02a5-4a14-99fe-70d69f7a783f service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:48.055232 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67ef19-02a5-4a14-99fe-70d69f7a783f service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:48.055797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67ef19-02a5-4a14-99fe-70d69f7a783f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:48.096635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67ef19-02a5-4a14-99fe-70d69f7a783f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:48.102332 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67ef19-02a5-4a14-99fe-70d69f7a783f service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:48.133050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1286/2559] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:13:48.684633 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd3a2a-a624-4e54-8347-51d92ecb91e0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:48.687898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c8cd3a2a-a624-4e54-8347-51d92ecb91e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:48.727157 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd3a2a-a624-4e54-8347-51d92ecb91e0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:48.737165 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c568f-49cd-4578-bde0-f0089e2e2f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:48.738786 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c568f-49cd-4578-bde0-f0089e2e2f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:48.739271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c568f-49cd-4578-bde0-f0089e2e2f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:48.739784 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c568f-49cd-4578-bde0-f0089e2e2f5b admin admin] PATH_INFO: `/v3/projects/ae1a0666af0641f1950256f9fc20b315` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:48.741538 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c568f-49cd-4578-bde0-f0089e2e2f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae1a0666af0641f1950256f9fc20b315)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:48.743832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c568f-49cd-4578-bde0-f0089e2e2f5b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:48.907887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c83c568f-49cd-4578-bde0-f0089e2e2f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae1a0666af0641f1950256f9fc20b315', 'request_id': 'req-c83c568f-49cd-4578-bde0-f0089e2e2f5b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:48.929628 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c83c568f-49cd-4578-bde0-f0089e2e2f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae1a0666af0641f1950256f9fc20b315', 'request_id': 'req-c83c568f-49cd-4578-bde0-f0089e2e2f5b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:48.940110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c83c568f-49cd-4578-bde0-f0089e2e2f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae1a0666af0641f1950256f9fc20b315', 'request_id': 'req-c83c568f-49cd-4578-bde0-f0089e2e2f5b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:48.957553 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c83c568f-49cd-4578-bde0-f0089e2e2f5b admin admin] The token cache is being invalidate because project ae1a0666af0641f1950256f9fc20b315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:13:48.958083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c83c568f-49cd-4578-bde0-f0089e2e2f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:48.959095 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c83c568f-49cd-4578-bde0-f0089e2e2f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:48.965326 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1274/2560] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:13:48 2022] DELETE /identity/v3/projects/ae1a0666af0641f1950256f9fc20b315 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:13:48.966754 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67ef19-02a5-4a14-99fe-70d69f7a783f service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:48.979569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67ef19-02a5-4a14-99fe-70d69f7a783f service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:48.987836 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:49.072296 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8514a-ff1b-4922-a991-94817fbdf3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:49.073630 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8514a-ff1b-4922-a991-94817fbdf3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:49.074170 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8514a-ff1b-4922-a991-94817fbdf3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:49.074637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8514a-ff1b-4922-a991-94817fbdf3cc admin admin] PATH_INFO: `/v3/users/c01f66a793da409a9a62302d1ae983f5` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:49.077247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8514a-ff1b-4922-a991-94817fbdf3cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c01f66a793da409a9a62302d1ae983f5)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:49.080404 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8514a-ff1b-4922-a991-94817fbdf3cc admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:49.212220 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-86b8514a-ff1b-4922-a991-94817fbdf3cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c01f66a793da409a9a62302d1ae983f5'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:49.270358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-86b8514a-ff1b-4922-a991-94817fbdf3cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c01f66a793da409a9a62302d1ae983f5'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:49.271628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-86b8514a-ff1b-4922-a991-94817fbdf3cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c01f66a793da409a9a62302d1ae983f5'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:49.289850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-86b8514a-ff1b-4922-a991-94817fbdf3cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c01f66a793da409a9a62302d1ae983f5'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:49.308853 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-86b8514a-ff1b-4922-a991-94817fbdf3cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c01f66a793da409a9a62302d1ae983f5'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:49.327216 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1287/2561] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:13:48 2022] DELETE /identity/v3/users/c01f66a793da409a9a62302d1ae983f5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:13:49.906223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c568f-49cd-4578-bde0-f0089e2e2f5b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:49.909746 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c83c568f-49cd-4578-bde0-f0089e2e2f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:49.951103 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c568f-49cd-4578-bde0-f0089e2e2f5b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:50.115543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c83d0-1050-4512-9b7b-1e6a093635ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:50.117490 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c83d0-1050-4512-9b7b-1e6a093635ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:50.118127 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c83d0-1050-4512-9b7b-1e6a093635ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:50.118630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c83d0-1050-4512-9b7b-1e6a093635ea admin admin] PATH_INFO: `/v3/projects/b15511ab599e4dffbe32511fa6528b98` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:50.133453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c83d0-1050-4512-9b7b-1e6a093635ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=b15511ab599e4dffbe32511fa6528b98)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:50.133453 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c83d0-1050-4512-9b7b-1e6a093635ea admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:50.293002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2b8c83d0-1050-4512-9b7b-1e6a093635ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b15511ab599e4dffbe32511fa6528b98', 'request_id': 'req-2b8c83d0-1050-4512-9b7b-1e6a093635ea'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:50.302103 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:50.321378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2b8c83d0-1050-4512-9b7b-1e6a093635ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b15511ab599e4dffbe32511fa6528b98', 'request_id': 'req-2b8c83d0-1050-4512-9b7b-1e6a093635ea'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:50.329944 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2b8c83d0-1050-4512-9b7b-1e6a093635ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b15511ab599e4dffbe32511fa6528b98', 'request_id': 'req-2b8c83d0-1050-4512-9b7b-1e6a093635ea'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:50.359615 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2b8c83d0-1050-4512-9b7b-1e6a093635ea admin admin] The token cache is being invalidate because project b15511ab599e4dffbe32511fa6528b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:13:50.360306 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2b8c83d0-1050-4512-9b7b-1e6a093635ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:50.362136 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2b8c83d0-1050-4512-9b7b-1e6a093635ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:50.365776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1275/2562] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:13:49 2022] DELETE /identity/v3/projects/b15511ab599e4dffbe32511fa6528b98 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:50.371894 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39f092-99df-4aca-8e60-018d51807304 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:50.372458 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39f092-99df-4aca-8e60-018d51807304 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:50.372645 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39f092-99df-4aca-8e60-018d51807304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:50.436732 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-4d39f092-99df-4aca-8e60-018d51807304 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:50.439456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-4d39f092-99df-4aca-8e60-018d51807304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:50.602872 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1288/2563] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:50.620051 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5bba8-e1b7-419e-95fd-7def1a0922a9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:50.620698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5bba8-e1b7-419e-95fd-7def1a0922a9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:50.621362 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5bba8-e1b7-419e-95fd-7def1a0922a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:50.669316 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-90f5bba8-e1b7-419e-95fd-7def1a0922a9 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:50.671421 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-90f5bba8-e1b7-419e-95fd-7def1a0922a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:50.688194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1276/2564] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:50.702545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39f092-99df-4aca-8e60-018d51807304 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:50.707411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39f092-99df-4aca-8e60-018d51807304 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:50.723362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48382a3-949b-40cf-865d-20e5a4c881c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:50.725291 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48382a3-949b-40cf-865d-20e5a4c881c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:50.726322 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48382a3-949b-40cf-865d-20e5a4c881c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:50.727311 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48382a3-949b-40cf-865d-20e5a4c881c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:50.729562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48382a3-949b-40cf-865d-20e5a4c881c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:13:50.731263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48382a3-949b-40cf-865d-20e5a4c881c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:50.736898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48382a3-949b-40cf-865d-20e5a4c881c5 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:50.785736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1289/2565] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:13:50.791938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5bba8-e1b7-419e-95fd-7def1a0922a9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:50.813704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5bba8-e1b7-419e-95fd-7def1a0922a9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:50.827316 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23099db8-2fe4-4386-a38f-b306b2af4f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:50.828285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23099db8-2fe4-4386-a38f-b306b2af4f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:50.828791 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23099db8-2fe4-4386-a38f-b306b2af4f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:50.829255 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23099db8-2fe4-4386-a38f-b306b2af4f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:50.830479 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23099db8-2fe4-4386-a38f-b306b2af4f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:50.833896 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23099db8-2fe4-4386-a38f-b306b2af4f8a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:50.905014 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1277/2566] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:13:50 2022] POST /identity/v3/projects => generated 359 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:13:50.911521 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48382a3-949b-40cf-865d-20e5a4c881c5 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:50.929759 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48382a3-949b-40cf-865d-20e5a4c881c5 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:50.954609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:51.064564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebda5a5-705c-4218-826f-8a8ed9dc4906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:51.065776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebda5a5-705c-4218-826f-8a8ed9dc4906 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:51.066285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebda5a5-705c-4218-826f-8a8ed9dc4906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:51.066897 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebda5a5-705c-4218-826f-8a8ed9dc4906 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:51.068254 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebda5a5-705c-4218-826f-8a8ed9dc4906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:51.072432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebda5a5-705c-4218-826f-8a8ed9dc4906 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:51.134762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1290/2567] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:13:50 2022] POST /identity/v3/users => generated 280 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:13:51.143038 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23099db8-2fe4-4386-a38f-b306b2af4f8a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:51.160274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23099db8-2fe4-4386-a38f-b306b2af4f8a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:51.172358 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b396a-31da-4952-bd8d-ca3b7baf4967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:51.173962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b396a-31da-4952-bd8d-ca3b7baf4967 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:51.174652 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b396a-31da-4952-bd8d-ca3b7baf4967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:51.175654 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b396a-31da-4952-bd8d-ca3b7baf4967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:51.178423 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b396a-31da-4952-bd8d-ca3b7baf4967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:51.183494 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b396a-31da-4952-bd8d-ca3b7baf4967 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:51.217241 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1278/2568] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:13:51.222103 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebda5a5-705c-4218-826f-8a8ed9dc4906 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:51.242120 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebda5a5-705c-4218-826f-8a8ed9dc4906 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:51.251275 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f5d85-d078-4ab4-8674-781eb8fd914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:51.252837 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f5d85-d078-4ab4-8674-781eb8fd914c admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:51.253631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f5d85-d078-4ab4-8674-781eb8fd914c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:51.254537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f5d85-d078-4ab4-8674-781eb8fd914c admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:51.256186 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f5d85-d078-4ab4-8674-781eb8fd914c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:51.259494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f5d85-d078-4ab4-8674-781eb8fd914c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:51.282263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1291/2569] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:13:51.288281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b396a-31da-4952-bd8d-ca3b7baf4967 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:51.309390 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b396a-31da-4952-bd8d-ca3b7baf4967 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:51.317125 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e9a0d-13e8-4e6e-825e-acedfe01b0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:51.318386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e9a0d-13e8-4e6e-825e-acedfe01b0e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:51.318758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e9a0d-13e8-4e6e-825e-acedfe01b0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:51.318935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e9a0d-13e8-4e6e-825e-acedfe01b0e8 admin admin] PATH_INFO: `/v3/projects/5bfb2621904943fab0fad9ba33d65a36/users/c4924deaecac4200bfb15a844a08ece2/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:51.340683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e9a0d-13e8-4e6e-825e-acedfe01b0e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bfb2621904943fab0fad9ba33d65a36, user_id=c4924deaecac4200bfb15a844a08ece2, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:51.350010 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e9a0d-13e8-4e6e-825e-acedfe01b0e8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:51.378321 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1279/2570] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:13:51 2022] PUT /identity/v3/projects/5bfb2621904943fab0fad9ba33d65a36/users/c4924deaecac4200bfb15a844a08ece2/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:51.394480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d770e-6b1f-475f-8f92-92b2e9bd4c2b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:51.395537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d770e-6b1f-475f-8f92-92b2e9bd4c2b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:51.395984 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d770e-6b1f-475f-8f92-92b2e9bd4c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:51.445970 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-576d770e-6b1f-475f-8f92-92b2e9bd4c2b None None] MFA Rules not processed for user `c4924deaecac4200bfb15a844a08ece2`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:51.448808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-576d770e-6b1f-475f-8f92-92b2e9bd4c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:51.569937 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1292/2571] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:51.614809 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e9a0d-13e8-4e6e-825e-acedfe01b0e8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:51.616732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-924e9a0d-13e8-4e6e-825e-acedfe01b0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:51.732648 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e9a0d-13e8-4e6e-825e-acedfe01b0e8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:51.737049 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6569d7-e280-4c85-b92d-5a9b71999dd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:51.737750 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6569d7-e280-4c85-b92d-5a9b71999dd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:51.738097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6569d7-e280-4c85-b92d-5a9b71999dd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:51.738373 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6569d7-e280-4c85-b92d-5a9b71999dd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:51.752812 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6569d7-e280-4c85-b92d-5a9b71999dd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:51.754318 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6569d7-e280-4c85-b92d-5a9b71999dd6 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:51.773444 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1280/2572] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:51 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:13:51.792741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d770e-6b1f-475f-8f92-92b2e9bd4c2b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:51.891690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d770e-6b1f-475f-8f92-92b2e9bd4c2b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:51.897119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07733254-cfb1-48ee-90c2-f802ec2a127c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:51.898759 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07733254-cfb1-48ee-90c2-f802ec2a127c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:51.899156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07733254-cfb1-48ee-90c2-f802ec2a127c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:51.899422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07733254-cfb1-48ee-90c2-f802ec2a127c admin admin] PATH_INFO: `/v3/users/c4924deaecac4200bfb15a844a08ece2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:51.900808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07733254-cfb1-48ee-90c2-f802ec2a127c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4924deaecac4200bfb15a844a08ece2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:51.902867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07733254-cfb1-48ee-90c2-f802ec2a127c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:51.945318 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:51.974797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-07733254-cfb1-48ee-90c2-f802ec2a127c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4924deaecac4200bfb15a844a08ece2'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:51.996544 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-07733254-cfb1-48ee-90c2-f802ec2a127c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4924deaecac4200bfb15a844a08ece2'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:51.997632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-07733254-cfb1-48ee-90c2-f802ec2a127c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4924deaecac4200bfb15a844a08ece2'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:52.009562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-07733254-cfb1-48ee-90c2-f802ec2a127c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4924deaecac4200bfb15a844a08ece2'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:52.023764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-07733254-cfb1-48ee-90c2-f802ec2a127c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4924deaecac4200bfb15a844a08ece2'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:52.035305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1293/2573] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:13:51 2022] DELETE /identity/v3/users/c4924deaecac4200bfb15a844a08ece2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:52.042597 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3621f-26a4-40ce-a582-33f26d9a59b9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:52.042979 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3621f-26a4-40ce-a582-33f26d9a59b9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:52.043264 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3621f-26a4-40ce-a582-33f26d9a59b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:52.062668 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3fe3621f-26a4-40ce-a582-33f26d9a59b9 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:52.063968 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3fe3621f-26a4-40ce-a582-33f26d9a59b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:52.153595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1281/2574] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:52.167359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07733254-cfb1-48ee-90c2-f802ec2a127c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:52.169054 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-07733254-cfb1-48ee-90c2-f802ec2a127c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:52.270073 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07733254-cfb1-48ee-90c2-f802ec2a127c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:52.275574 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050caa44-f01d-4a98-8c98-5df782c1e6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:52.276690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050caa44-f01d-4a98-8c98-5df782c1e6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:52.277157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050caa44-f01d-4a98-8c98-5df782c1e6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:52.277622 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050caa44-f01d-4a98-8c98-5df782c1e6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:52.294792 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050caa44-f01d-4a98-8c98-5df782c1e6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:52.297489 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050caa44-f01d-4a98-8c98-5df782c1e6b5 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:52.313601 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1294/2575] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:13:52.697008 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3621f-26a4-40ce-a582-33f26d9a59b9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:52.699563 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3fe3621f-26a4-40ce-a582-33f26d9a59b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:52.714980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3621f-26a4-40ce-a582-33f26d9a59b9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:52.720533 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb12d8-a4d2-44f9-aa36-ebd22134fa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:52.721443 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb12d8-a4d2-44f9-aa36-ebd22134fa90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:52.721716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb12d8-a4d2-44f9-aa36-ebd22134fa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:52.722050 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb12d8-a4d2-44f9-aa36-ebd22134fa90 admin admin] PATH_INFO: `/v3/projects/5bfb2621904943fab0fad9ba33d65a36` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:52.723395 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb12d8-a4d2-44f9-aa36-ebd22134fa90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bfb2621904943fab0fad9ba33d65a36)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:52.725308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb12d8-a4d2-44f9-aa36-ebd22134fa90 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:52.754585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:52.801724 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cecb12d8-a4d2-44f9-aa36-ebd22134fa90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bfb2621904943fab0fad9ba33d65a36', 'request_id': 'req-cecb12d8-a4d2-44f9-aa36-ebd22134fa90'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:52.813047 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cecb12d8-a4d2-44f9-aa36-ebd22134fa90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bfb2621904943fab0fad9ba33d65a36', 'request_id': 'req-cecb12d8-a4d2-44f9-aa36-ebd22134fa90'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:52.821645 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cecb12d8-a4d2-44f9-aa36-ebd22134fa90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bfb2621904943fab0fad9ba33d65a36', 'request_id': 'req-cecb12d8-a4d2-44f9-aa36-ebd22134fa90'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:52.837863 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cecb12d8-a4d2-44f9-aa36-ebd22134fa90 admin admin] The token cache is being invalidate because project 5bfb2621904943fab0fad9ba33d65a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:13:52.838567 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cecb12d8-a4d2-44f9-aa36-ebd22134fa90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:52.839648 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cecb12d8-a4d2-44f9-aa36-ebd22134fa90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:13:52.842882 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1282/2576] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:13:52 2022] DELETE /identity/v3/projects/5bfb2621904943fab0fad9ba33d65a36 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:52.848516 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72559d8-9fb0-4cbe-a022-b739726634d9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:52.849086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72559d8-9fb0-4cbe-a022-b739726634d9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:52.849086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72559d8-9fb0-4cbe-a022-b739726634d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:52.875933 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d72559d8-9fb0-4cbe-a022-b739726634d9 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:52.878038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d72559d8-9fb0-4cbe-a022-b739726634d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:52.978353 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1295/2577] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:52.991691 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122f8c9-74fb-47a0-a3b0-ef22e99acaca None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:52.992092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122f8c9-74fb-47a0-a3b0-ef22e99acaca None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:52.992578 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122f8c9-74fb-47a0-a3b0-ef22e99acaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:53.022240 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b122f8c9-74fb-47a0-a3b0-ef22e99acaca None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:53.023661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b122f8c9-74fb-47a0-a3b0-ef22e99acaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:53.035322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1283/2578] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:53.041247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72559d8-9fb0-4cbe-a022-b739726634d9 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:53.057129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72559d8-9fb0-4cbe-a022-b739726634d9 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:53.063399 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee9d50-dc45-4ad2-ad6e-b5023912eae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:53.064330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee9d50-dc45-4ad2-ad6e-b5023912eae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:53.064723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee9d50-dc45-4ad2-ad6e-b5023912eae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:53.065062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee9d50-dc45-4ad2-ad6e-b5023912eae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:53.066350 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee9d50-dc45-4ad2-ad6e-b5023912eae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:13:53.066810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee9d50-dc45-4ad2-ad6e-b5023912eae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:53.069033 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee9d50-dc45-4ad2-ad6e-b5023912eae2 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:53.086026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1296/2579] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:13:53.091094 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122f8c9-74fb-47a0-a3b0-ef22e99acaca None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:53.101908 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122f8c9-74fb-47a0-a3b0-ef22e99acaca None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:53.107047 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c88558-4918-47c9-a305-a59c16a7ddab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:53.107756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c88558-4918-47c9-a305-a59c16a7ddab admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:53.108226 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c88558-4918-47c9-a305-a59c16a7ddab admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:53.108575 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c88558-4918-47c9-a305-a59c16a7ddab admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:53.109349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c88558-4918-47c9-a305-a59c16a7ddab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:53.111331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c88558-4918-47c9-a305-a59c16a7ddab admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:53.146722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1284/2580] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:13:53 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:13:53.151865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee9d50-dc45-4ad2-ad6e-b5023912eae2 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:53.170228 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee9d50-dc45-4ad2-ad6e-b5023912eae2 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:53.217102 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:53.267862 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704d90f-ce89-4dc6-94f7-8965e8f3be96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:53.268929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704d90f-ce89-4dc6-94f7-8965e8f3be96 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:53.269125 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704d90f-ce89-4dc6-94f7-8965e8f3be96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:53.269456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704d90f-ce89-4dc6-94f7-8965e8f3be96 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:53.270283 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704d90f-ce89-4dc6-94f7-8965e8f3be96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:53.272416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704d90f-ce89-4dc6-94f7-8965e8f3be96 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:53.308048 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1297/2581] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:13:53 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:13:53.312349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c88558-4918-47c9-a305-a59c16a7ddab admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:53.331701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c88558-4918-47c9-a305-a59c16a7ddab admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:53.341114 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a9e17-acc9-4c83-928f-965fa68833ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:53.342085 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a9e17-acc9-4c83-928f-965fa68833ff admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:53.342476 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a9e17-acc9-4c83-928f-965fa68833ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:53.342889 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a9e17-acc9-4c83-928f-965fa68833ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:53.344434 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a9e17-acc9-4c83-928f-965fa68833ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:53.346374 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a9e17-acc9-4c83-928f-965fa68833ff admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:53.358442 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1285/2582] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:13:53.366013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704d90f-ce89-4dc6-94f7-8965e8f3be96 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:53.380526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704d90f-ce89-4dc6-94f7-8965e8f3be96 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:53.385930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea0f74-ff2c-4920-846a-781fe705bcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:53.386733 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea0f74-ff2c-4920-846a-781fe705bcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:53.387130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea0f74-ff2c-4920-846a-781fe705bcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:53.387491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea0f74-ff2c-4920-846a-781fe705bcf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:53.388298 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea0f74-ff2c-4920-846a-781fe705bcf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:53.390061 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea0f74-ff2c-4920-846a-781fe705bcf9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:53.402576 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1298/2583] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:13:53.407221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a9e17-acc9-4c83-928f-965fa68833ff admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:53.418185 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a9e17-acc9-4c83-928f-965fa68833ff admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:53.425487 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6f4da-5da4-4b82-b1a8-465e4e2c1a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:53.426510 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6f4da-5da4-4b82-b1a8-465e4e2c1a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:53.426758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6f4da-5da4-4b82-b1a8-465e4e2c1a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:53.427021 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6f4da-5da4-4b82-b1a8-465e4e2c1a10 admin admin] PATH_INFO: `/v3/projects/1e100d493507464ca9af4604fbd8aa66/users/a2bb05cbe5cc4cb4a5bf0f527904bd0c/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:53.443787 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6f4da-5da4-4b82-b1a8-465e4e2c1a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e100d493507464ca9af4604fbd8aa66, user_id=a2bb05cbe5cc4cb4a5bf0f527904bd0c, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:53.446558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6f4da-5da4-4b82-b1a8-465e4e2c1a10 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:53.467155 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1286/2584] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:13:53 2022] PUT /identity/v3/projects/1e100d493507464ca9af4604fbd8aa66/users/a2bb05cbe5cc4cb4a5bf0f527904bd0c/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:13:53.474442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df85bac-3297-40ac-9130-cef40681eab1 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:53.475028 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df85bac-3297-40ac-9130-cef40681eab1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:53.475361 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df85bac-3297-40ac-9130-cef40681eab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:53.502796 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0df85bac-3297-40ac-9130-cef40681eab1 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:53.504251 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0df85bac-3297-40ac-9130-cef40681eab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:53.612471 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1299/2585] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:53.620700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6f4da-5da4-4b82-b1a8-465e4e2c1a10 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:53.630221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a6b6f4da-5da4-4b82-b1a8-465e4e2c1a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:53.717201 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6f4da-5da4-4b82-b1a8-465e4e2c1a10 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:53.725492 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f7f38-4fa5-4351-a821-31501863d32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:53.726864 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f7f38-4fa5-4351-a821-31501863d32a service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:53.727446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f7f38-4fa5-4351-a821-31501863d32a service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:53.727963 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f7f38-4fa5-4351-a821-31501863d32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:53.741737 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f7f38-4fa5-4351-a821-31501863d32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:53.743284 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f7f38-4fa5-4351-a821-31501863d32a service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:53.755703 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1287/2586] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:13:55.276888 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8da7a-2a3b-4ecd-8319-781d39efe1e6 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:55.277537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8da7a-2a3b-4ecd-8319-781d39efe1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:55.278325 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8da7a-2a3b-4ecd-8319-781d39efe1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:55.327105 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f3a8da7a-2a3b-4ecd-8319-781d39efe1e6 None None] MFA Rules not processed for user `a2bb05cbe5cc4cb4a5bf0f527904bd0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:55.329489 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f3a8da7a-2a3b-4ecd-8319-781d39efe1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:55.497701 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1300/2587] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:55.510233 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f7f38-4fa5-4351-a821-31501863d32a service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:55.511880 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2e7f7f38-4fa5-4351-a821-31501863d32a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:55.620799 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:55.661577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f7f38-4fa5-4351-a821-31501863d32a service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:55.678632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eca020-eb99-482d-bdd7-163c87e43b0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:55.679350 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eca020-eb99-482d-bdd7-163c87e43b0e service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:55.679646 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eca020-eb99-482d-bdd7-163c87e43b0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:55.679922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eca020-eb99-482d-bdd7-163c87e43b0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:55.690857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eca020-eb99-482d-bdd7-163c87e43b0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:55.692469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eca020-eb99-482d-bdd7-163c87e43b0e service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:55.705150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1288/2588] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:57.188391 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eccd0-7a7f-4fed-ae2a-20b8f70301c0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:57.188980 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eccd0-7a7f-4fed-ae2a-20b8f70301c0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:57.189290 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eccd0-7a7f-4fed-ae2a-20b8f70301c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:57.213119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-997eccd0-7a7f-4fed-ae2a-20b8f70301c0 None None] MFA Rules not processed for user `a2bb05cbe5cc4cb4a5bf0f527904bd0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:57.214438 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-997eccd0-7a7f-4fed-ae2a-20b8f70301c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:57.228880 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1301/2589] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:13:57.531180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eca020-eb99-482d-bdd7-163c87e43b0e service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:57.542927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eca020-eb99-482d-bdd7-163c87e43b0e service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:57.547922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdaaa9-b02d-4f98-ad05-8d50c1d56c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:57.548700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdaaa9-b02d-4f98-ad05-8d50c1d56c23 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:57.549090 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdaaa9-b02d-4f98-ad05-8d50c1d56c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:57.549459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdaaa9-b02d-4f98-ad05-8d50c1d56c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:57.551683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-80cdaaa9-b02d-4f98-ad05-8d50c1d56c23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:57.563358 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdaaa9-b02d-4f98-ad05-8d50c1d56c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:57.564832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdaaa9-b02d-4f98-ad05-8d50c1d56c23 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:57.574132 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1289/2590] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:13:58.618843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eccd0-7a7f-4fed-ae2a-20b8f70301c0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:13:58.635784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eccd0-7a7f-4fed-ae2a-20b8f70301c0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:13:58.639910 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf8d54-2239-4229-9a33-259263b2a0f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:13:58.640660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf8d54-2239-4229-9a33-259263b2a0f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:58.640944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf8d54-2239-4229-9a33-259263b2a0f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:58.641716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf8d54-2239-4229-9a33-259263b2a0f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:58.651125 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-dabf8d54-2239-4229-9a33-259263b2a0f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:13:58.670638 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf8d54-2239-4229-9a33-259263b2a0f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:13:58.674225 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf8d54-2239-4229-9a33-259263b2a0f1 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:13:58.688734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1302/2591] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:13:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:13:59.909650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8da6e-a543-4665-a1f4-294c2f6ef5c5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:13:59.911500 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8da6e-a543-4665-a1f4-294c2f6ef5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:13:59.912171 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8da6e-a543-4665-a1f4-294c2f6ef5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:13:59.949471 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b1b8da6e-a543-4665-a1f4-294c2f6ef5c5 None None] MFA Rules not processed for user `3953b14656774edb92da1ecdb4bbbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:13:59.951740 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b1b8da6e-a543-4665-a1f4-294c2f6ef5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:00.041376 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1290/2592] 10.222.0.61 () {58 vars in 967 bytes} [Thu May 26 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:00.070487 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf8d54-2239-4229-9a33-259263b2a0f1 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:00.072649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-dabf8d54-2239-4229-9a33-259263b2a0f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:00.122165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:00.190495 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf8d54-2239-4229-9a33-259263b2a0f1 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:00.196915 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bb253-823a-4e38-8ceb-7fab7a595efe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a63879ec1242d08bba1ccad6212788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:00.197445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bb253-823a-4e38-8ceb-7fab7a595efe service swift] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:00.197732 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bb253-823a-4e38-8ceb-7fab7a595efe service swift] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:00.198191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bb253-823a-4e38-8ceb-7fab7a595efe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:00.209148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bb253-823a-4e38-8ceb-7fab7a595efe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:00.210900 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bb253-823a-4e38-8ceb-7fab7a595efe service swift] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:00.223107 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1303/2593] 10.222.0.61 () {60 vars in 1384 bytes} [Thu May 26 21:14:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:14:02.610026 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8da6e-a543-4665-a1f4-294c2f6ef5c5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:02.612452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b1b8da6e-a543-4665-a1f4-294c2f6ef5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:02.817194 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8da6e-a543-4665-a1f4-294c2f6ef5c5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:02.825952 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbdea9-0693-4868-aaf8-9b5a50efbd67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:02.826714 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbdea9-0693-4868-aaf8-9b5a50efbd67 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:02.827009 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbdea9-0693-4868-aaf8-9b5a50efbd67 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:02.827443 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbdea9-0693-4868-aaf8-9b5a50efbd67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:02.837651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-55dbdea9-0693-4868-aaf8-9b5a50efbd67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:02.862675 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbdea9-0693-4868-aaf8-9b5a50efbd67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:02.865773 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbdea9-0693-4868-aaf8-9b5a50efbd67 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:02.879102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1291/2594] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:10.218319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=22 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:12.874497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=72 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:13.041099 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bb253-823a-4e38-8ceb-7fab7a595efe service swift] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:13.052609 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bb253-823a-4e38-8ceb-7fab7a595efe service swift] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:13.057490 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761b86d-3140-470e-a147-300ae7db90bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:13.058278 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761b86d-3140-470e-a147-300ae7db90bc service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:13.058594 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761b86d-3140-470e-a147-300ae7db90bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:13.058914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761b86d-3140-470e-a147-300ae7db90bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:13.061225 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b761b86d-3140-470e-a147-300ae7db90bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:13.075572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761b86d-3140-470e-a147-300ae7db90bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:13.077139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761b86d-3140-470e-a147-300ae7db90bc service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:13.088996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1304/2595] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:17.119518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbdea9-0693-4868-aaf8-9b5a50efbd67 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:17.123399 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-55dbdea9-0693-4868-aaf8-9b5a50efbd67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:17.205438 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761b86d-3140-470e-a147-300ae7db90bc service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:17.207311 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b761b86d-3140-470e-a147-300ae7db90bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:17.224620 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761b86d-3140-470e-a147-300ae7db90bc service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:17.231014 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b501f2b-5c5b-4657-b583-d9a4907ecd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:17.232569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b501f2b-5c5b-4657-b583-d9a4907ecd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:17.233072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b501f2b-5c5b-4657-b583-d9a4907ecd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:17.234482 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b501f2b-5c5b-4657-b583-d9a4907ecd09 admin admin] PATH_INFO: `/v3/users/f215554a96e0461aa1dc78f930586cf3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:17.237150 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b501f2b-5c5b-4657-b583-d9a4907ecd09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f215554a96e0461aa1dc78f930586cf3)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:17.240149 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b501f2b-5c5b-4657-b583-d9a4907ecd09 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:17.251190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbdea9-0693-4868-aaf8-9b5a50efbd67 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:17.256788 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b7120-9133-44e7-8dc9-bb99f72ae72b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8952f35c21c4a2eaf1fbc601fe76242', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:17.257472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b7120-9133-44e7-8dc9-bb99f72ae72b service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:17.257872 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b7120-9133-44e7-8dc9-bb99f72ae72b service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:17.258461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b7120-9133-44e7-8dc9-bb99f72ae72b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:17.260895 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-903b7120-9133-44e7-8dc9-bb99f72ae72b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:17.277467 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b7120-9133-44e7-8dc9-bb99f72ae72b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:17.282162 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b7120-9133-44e7-8dc9-bb99f72ae72b service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:17.296967 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1292/2596] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:17.335614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5b501f2b-5c5b-4657-b583-d9a4907ecd09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f215554a96e0461aa1dc78f930586cf3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:17.360615 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5b501f2b-5c5b-4657-b583-d9a4907ecd09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f215554a96e0461aa1dc78f930586cf3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:17.361632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5b501f2b-5c5b-4657-b583-d9a4907ecd09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f215554a96e0461aa1dc78f930586cf3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:17.372384 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5b501f2b-5c5b-4657-b583-d9a4907ecd09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f215554a96e0461aa1dc78f930586cf3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:17.387389 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5b501f2b-5c5b-4657-b583-d9a4907ecd09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f215554a96e0461aa1dc78f930586cf3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:17.394591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1305/2597] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:14:17 2022] DELETE /identity/v3/users/f215554a96e0461aa1dc78f930586cf3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:17.617278 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b7120-9133-44e7-8dc9-bb99f72ae72b service placement] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:17.633611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b7120-9133-44e7-8dc9-bb99f72ae72b service placement] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:17.730913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143f238-c22a-4d4e-a45d-0583ab821afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:17.732442 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f238-c22a-4d4e-a45d-0583ab821afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:17.732926 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f238-c22a-4d4e-a45d-0583ab821afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:17.734525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f238-c22a-4d4e-a45d-0583ab821afe admin admin] PATH_INFO: `/v3/projects/0cca24842f134ae4943ce54aa1b65254` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:17.736406 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143f238-c22a-4d4e-a45d-0583ab821afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cca24842f134ae4943ce54aa1b65254)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:17.739726 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143f238-c22a-4d4e-a45d-0583ab821afe admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:17.821927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8143f238-c22a-4d4e-a45d-0583ab821afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cca24842f134ae4943ce54aa1b65254', 'request_id': 'req-8143f238-c22a-4d4e-a45d-0583ab821afe'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:17.837072 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8143f238-c22a-4d4e-a45d-0583ab821afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cca24842f134ae4943ce54aa1b65254', 'request_id': 'req-8143f238-c22a-4d4e-a45d-0583ab821afe'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:17.846312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8143f238-c22a-4d4e-a45d-0583ab821afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cca24842f134ae4943ce54aa1b65254', 'request_id': 'req-8143f238-c22a-4d4e-a45d-0583ab821afe'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:17.861300 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8143f238-c22a-4d4e-a45d-0583ab821afe admin admin] The token cache is being invalidate because project 0cca24842f134ae4943ce54aa1b65254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:14:17.861544 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8143f238-c22a-4d4e-a45d-0583ab821afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:17.862169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8143f238-c22a-4d4e-a45d-0583ab821afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:17.863780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1293/2598] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:14:17 2022] DELETE /identity/v3/projects/0cca24842f134ae4943ce54aa1b65254 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:14:17.871158 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa26368-3372-495b-99f7-a76a41b06b31 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:17.871693 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa26368-3372-495b-99f7-a76a41b06b31 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:17.872156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa26368-3372-495b-99f7-a76a41b06b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:17.900419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2aa26368-3372-495b-99f7-a76a41b06b31 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:17.901911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2aa26368-3372-495b-99f7-a76a41b06b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:17.984294 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1306/2599] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:17.993519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7832f6-0ebf-43e3-85b2-06935a8f716c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:17.993901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7832f6-0ebf-43e3-85b2-06935a8f716c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:17.994228 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7832f6-0ebf-43e3-85b2-06935a8f716c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:18.015503 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2c7832f6-0ebf-43e3-85b2-06935a8f716c None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:18.016847 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2c7832f6-0ebf-43e3-85b2-06935a8f716c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:18.025365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1294/2600] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:18.030272 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa26368-3372-495b-99f7-a76a41b06b31 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:18.040754 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa26368-3372-495b-99f7-a76a41b06b31 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:18.045946 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491358f4-70a8-497c-a553-df9d4322971b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:18.046390 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491358f4-70a8-497c-a553-df9d4322971b admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:18.046673 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491358f4-70a8-497c-a553-df9d4322971b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:18.046949 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491358f4-70a8-497c-a553-df9d4322971b admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:18.047702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491358f4-70a8-497c-a553-df9d4322971b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:14:18.048009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491358f4-70a8-497c-a553-df9d4322971b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:18.049717 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491358f4-70a8-497c-a553-df9d4322971b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:18.063319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1307/2601] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:14:18.068307 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7832f6-0ebf-43e3-85b2-06935a8f716c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:18.082372 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7832f6-0ebf-43e3-85b2-06935a8f716c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:18.087807 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb3048-f6f6-49fb-a928-94972ece03d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:18.088503 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb3048-f6f6-49fb-a928-94972ece03d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:18.088954 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb3048-f6f6-49fb-a928-94972ece03d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:18.089238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb3048-f6f6-49fb-a928-94972ece03d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:18.090007 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb3048-f6f6-49fb-a928-94972ece03d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:18.099096 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb3048-f6f6-49fb-a928-94972ece03d9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:18.114290 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:18.137320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1295/2602] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:14:18 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:14:18.142461 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491358f4-70a8-497c-a553-df9d4322971b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:18.154196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491358f4-70a8-497c-a553-df9d4322971b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:18.238769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:18.261358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ce4aa-4722-4f31-9551-6d215eaad4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:18.262099 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce4aa-4722-4f31-9551-6d215eaad4ac admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:18.262376 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce4aa-4722-4f31-9551-6d215eaad4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:18.262808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce4aa-4722-4f31-9551-6d215eaad4ac admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:18.264653 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ce4aa-4722-4f31-9551-6d215eaad4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:18.268225 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ce4aa-4722-4f31-9551-6d215eaad4ac admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:18.299831 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1308/2603] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:14:18 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:14:18.304439 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb3048-f6f6-49fb-a928-94972ece03d9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:18.326006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb3048-f6f6-49fb-a928-94972ece03d9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:18.336034 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea4078-2c83-4e00-8fb1-226893f65fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:18.336977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea4078-2c83-4e00-8fb1-226893f65fef admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:18.337363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea4078-2c83-4e00-8fb1-226893f65fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:18.337958 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea4078-2c83-4e00-8fb1-226893f65fef admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:18.339051 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea4078-2c83-4e00-8fb1-226893f65fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:18.341025 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea4078-2c83-4e00-8fb1-226893f65fef admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:18.354714 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1296/2604] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:14:18.362064 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ce4aa-4722-4f31-9551-6d215eaad4ac admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:18.379702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ce4aa-4722-4f31-9551-6d215eaad4ac admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:18.384574 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d32ed5-a189-4b6d-ad95-7427bb8f8218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:18.385269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d32ed5-a189-4b6d-ad95-7427bb8f8218 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:18.385550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d32ed5-a189-4b6d-ad95-7427bb8f8218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:18.385859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d32ed5-a189-4b6d-ad95-7427bb8f8218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:18.386620 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d32ed5-a189-4b6d-ad95-7427bb8f8218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:18.388501 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d32ed5-a189-4b6d-ad95-7427bb8f8218 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:18.408975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1309/2605] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:14:18.416981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea4078-2c83-4e00-8fb1-226893f65fef admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:18.435274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea4078-2c83-4e00-8fb1-226893f65fef admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:18.444602 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b0b14-54bd-4da1-b6fd-3101e087915c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:18.446262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b0b14-54bd-4da1-b6fd-3101e087915c admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:18.446748 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b0b14-54bd-4da1-b6fd-3101e087915c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:18.447233 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b0b14-54bd-4da1-b6fd-3101e087915c admin admin] PATH_INFO: `/v3/projects/dd37f783c5c047059d47bec690220d34/users/967b03a5eeb44792a3145b7bfe30528e/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:18.472148 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b0b14-54bd-4da1-b6fd-3101e087915c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd37f783c5c047059d47bec690220d34, user_id=967b03a5eeb44792a3145b7bfe30528e, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:18.477083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b0b14-54bd-4da1-b6fd-3101e087915c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:18.501254 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1297/2606] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:14:18 2022] PUT /identity/v3/projects/dd37f783c5c047059d47bec690220d34/users/967b03a5eeb44792a3145b7bfe30528e/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:18.513587 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae62b-494a-45f9-9420-f319000dcee8 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:18.514008 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae62b-494a-45f9-9420-f319000dcee8 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:18.514532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae62b-494a-45f9-9420-f319000dcee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:18.564610 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-35aae62b-494a-45f9-9420-f319000dcee8 None None] MFA Rules not processed for user `967b03a5eeb44792a3145b7bfe30528e`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:18.566875 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-35aae62b-494a-45f9-9420-f319000dcee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:18.691951 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1310/2607] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:14:18.698199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b0b14-54bd-4da1-b6fd-3101e087915c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:18.796228 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b0b14-54bd-4da1-b6fd-3101e087915c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:18.801663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4116e2-38a7-4f52-998c-346aaf7f7d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:18.802383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4116e2-38a7-4f52-998c-346aaf7f7d8d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:18.802701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4116e2-38a7-4f52-998c-346aaf7f7d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:18.802978 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4116e2-38a7-4f52-998c-346aaf7f7d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:18.803701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4116e2-38a7-4f52-998c-346aaf7f7d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:18.805915 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4116e2-38a7-4f52-998c-346aaf7f7d8d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:18.840083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1298/2608] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:14:18 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:14:18.845144 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aae62b-494a-45f9-9420-f319000dcee8 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:18.867905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aae62b-494a-45f9-9420-f319000dcee8 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:18.976215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745d96b-fc2a-40e8-98aa-b618717895ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:18.977346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745d96b-fc2a-40e8-98aa-b618717895ab admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:18.977864 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745d96b-fc2a-40e8-98aa-b618717895ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:18.978348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745d96b-fc2a-40e8-98aa-b618717895ab admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:18.979510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745d96b-fc2a-40e8-98aa-b618717895ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:18.983351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745d96b-fc2a-40e8-98aa-b618717895ab admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:19.017460 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1311/2609] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:14:18 2022] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:14:19.023018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4116e2-38a7-4f52-998c-346aaf7f7d8d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:19.041207 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4116e2-38a7-4f52-998c-346aaf7f7d8d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:19.049231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38528b4b-da87-4aa0-9649-367e69a77a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:19.050239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38528b4b-da87-4aa0-9649-367e69a77a2d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:19.050663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38528b4b-da87-4aa0-9649-367e69a77a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:19.050948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38528b4b-da87-4aa0-9649-367e69a77a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:19.051917 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38528b4b-da87-4aa0-9649-367e69a77a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:19.053568 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38528b4b-da87-4aa0-9649-367e69a77a2d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:19.067782 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1299/2610] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:14:19.072663 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745d96b-fc2a-40e8-98aa-b618717895ab admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:19.088756 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745d96b-fc2a-40e8-98aa-b618717895ab admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:19.097091 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66db412-490e-4a02-b041-0655b61eb5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:19.098753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66db412-490e-4a02-b041-0655b61eb5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:19.099196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66db412-490e-4a02-b041-0655b61eb5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:19.099623 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66db412-490e-4a02-b041-0655b61eb5b3 admin admin] PATH_INFO: `/v3/projects/7b511b7b827d4fbb99b6056a13d5ea5b/users/9c2817cc8f4044c4afe11dc10682ba72/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:19.125121 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66db412-490e-4a02-b041-0655b61eb5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b511b7b827d4fbb99b6056a13d5ea5b, user_id=9c2817cc8f4044c4afe11dc10682ba72, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:19.127869 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66db412-490e-4a02-b041-0655b61eb5b3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:19.154611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1312/2611] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:14:19 2022] PUT /identity/v3/projects/7b511b7b827d4fbb99b6056a13d5ea5b/users/9c2817cc8f4044c4afe11dc10682ba72/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:14:19.159179 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38528b4b-da87-4aa0-9649-367e69a77a2d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:19.171593 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38528b4b-da87-4aa0-9649-367e69a77a2d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:19.258807 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1bcb6-a052-4f18-88bc-3a696c532275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:19.259631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1bcb6-a052-4f18-88bc-3a696c532275 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:19.260026 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1bcb6-a052-4f18-88bc-3a696c532275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:19.260314 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1bcb6-a052-4f18-88bc-3a696c532275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:19.261471 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1bcb6-a052-4f18-88bc-3a696c532275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:19.264789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1bcb6-a052-4f18-88bc-3a696c532275 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:19.275681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1300/2612] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:14:19.283116 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66db412-490e-4a02-b041-0655b61eb5b3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:19.300169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66db412-490e-4a02-b041-0655b61eb5b3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:19.305394 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ee45e-193c-4684-8e2e-072cf1e2ccc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:19.306367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ee45e-193c-4684-8e2e-072cf1e2ccc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:19.306649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ee45e-193c-4684-8e2e-072cf1e2ccc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:19.306930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ee45e-193c-4684-8e2e-072cf1e2ccc3 admin admin] PATH_INFO: `/v3/projects/7b511b7b827d4fbb99b6056a13d5ea5b/users/9c2817cc8f4044c4afe11dc10682ba72/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:19.309040 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ee45e-193c-4684-8e2e-072cf1e2ccc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b511b7b827d4fbb99b6056a13d5ea5b, user_id=9c2817cc8f4044c4afe11dc10682ba72, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:19.311870 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ee45e-193c-4684-8e2e-072cf1e2ccc3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:19.324405 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1313/2613] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:14:19 2022] PUT /identity/v3/projects/7b511b7b827d4fbb99b6056a13d5ea5b/users/9c2817cc8f4044c4afe11dc10682ba72/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:19.337153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f286d85-3364-49ff-aac5-87428a6e86c1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:19.337483 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f286d85-3364-49ff-aac5-87428a6e86c1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:19.337880 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f286d85-3364-49ff-aac5-87428a6e86c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:19.372969 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2f286d85-3364-49ff-aac5-87428a6e86c1 None None] MFA Rules not processed for user `9c2817cc8f4044c4afe11dc10682ba72`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:19.375019 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2f286d85-3364-49ff-aac5-87428a6e86c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:19.392104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:19.476049 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1301/2614] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:14:19.491021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ee45e-193c-4684-8e2e-072cf1e2ccc3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:19.492989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-774ee45e-193c-4684-8e2e-072cf1e2ccc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:19.510522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:19.576428 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ee45e-193c-4684-8e2e-072cf1e2ccc3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:19.581956 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e2b2f-4fe5-4fef-9f93-7232118fbf9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:19.582690 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e2b2f-4fe5-4fef-9f93-7232118fbf9a service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:19.583085 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e2b2f-4fe5-4fef-9f93-7232118fbf9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:19.584188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e2b2f-4fe5-4fef-9f93-7232118fbf9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:19.596364 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e2b2f-4fe5-4fef-9f93-7232118fbf9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:19.599408 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e2b2f-4fe5-4fef-9f93-7232118fbf9a service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:19.617867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1314/2615] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:14:19.736290 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f286d85-3364-49ff-aac5-87428a6e86c1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:19.747765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f286d85-3364-49ff-aac5-87428a6e86c1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:19.753153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8deb3-e9ab-48e6-a3ad-65748652fad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:19.754091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8deb3-e9ab-48e6-a3ad-65748652fad6 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:19.754575 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8deb3-e9ab-48e6-a3ad-65748652fad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:19.755026 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8deb3-e9ab-48e6-a3ad-65748652fad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:19.859221 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8deb3-e9ab-48e6-a3ad-65748652fad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:19.861891 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8deb3-e9ab-48e6-a3ad-65748652fad6 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:19.872966 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1302/2616] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:27.551100 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e2b2f-4fe5-4fef-9f93-7232118fbf9a service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:27.657074 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e2b2f-4fe5-4fef-9f93-7232118fbf9a service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:27.662422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef570ae1-3eeb-41b4-9fb4-10f0399e70c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:27.663324 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef570ae1-3eeb-41b4-9fb4-10f0399e70c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:27.663606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef570ae1-3eeb-41b4-9fb4-10f0399e70c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:27.663886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef570ae1-3eeb-41b4-9fb4-10f0399e70c7 admin admin] PATH_INFO: `/v3/users/967b03a5eeb44792a3145b7bfe30528e` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:27.665126 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef570ae1-3eeb-41b4-9fb4-10f0399e70c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=967b03a5eeb44792a3145b7bfe30528e)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:27.667108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef570ae1-3eeb-41b4-9fb4-10f0399e70c7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:27.741209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ef570ae1-3eeb-41b4-9fb4-10f0399e70c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967b03a5eeb44792a3145b7bfe30528e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:27.757040 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ef570ae1-3eeb-41b4-9fb4-10f0399e70c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967b03a5eeb44792a3145b7bfe30528e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:27.757896 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ef570ae1-3eeb-41b4-9fb4-10f0399e70c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967b03a5eeb44792a3145b7bfe30528e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:27.775660 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ef570ae1-3eeb-41b4-9fb4-10f0399e70c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967b03a5eeb44792a3145b7bfe30528e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:27.784605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ef570ae1-3eeb-41b4-9fb4-10f0399e70c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967b03a5eeb44792a3145b7bfe30528e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:27.791105 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1315/2617] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:14:27 2022] DELETE /identity/v3/users/967b03a5eeb44792a3145b7bfe30528e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:27.797238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad46a58-4a77-4e21-9269-d6e75a0b65ff None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:27.798108 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad46a58-4a77-4e21-9269-d6e75a0b65ff None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:27.798108 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad46a58-4a77-4e21-9269-d6e75a0b65ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:27.818095 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7ad46a58-4a77-4e21-9269-d6e75a0b65ff None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:27.819255 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7ad46a58-4a77-4e21-9269-d6e75a0b65ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:27.908100 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1303/2618] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:27.914876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef570ae1-3eeb-41b4-9fb4-10f0399e70c7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:27.916695 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ef570ae1-3eeb-41b4-9fb4-10f0399e70c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:27.964770 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:28.014673 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef570ae1-3eeb-41b4-9fb4-10f0399e70c7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:28.020515 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36b05e-7455-482b-81f3-c61cb798a7cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:28.021229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36b05e-7455-482b-81f3-c61cb798a7cd service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:28.021586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36b05e-7455-482b-81f3-c61cb798a7cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:28.022050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36b05e-7455-482b-81f3-c61cb798a7cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:28.035193 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36b05e-7455-482b-81f3-c61cb798a7cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:28.036711 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36b05e-7455-482b-81f3-c61cb798a7cd service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:28.047850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1316/2619] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:28.329437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d70c75-50cc-4b08-b08f-fbda5dc51d4e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:28.329957 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d70c75-50cc-4b08-b08f-fbda5dc51d4e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:28.330420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d70c75-50cc-4b08-b08f-fbda5dc51d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:28.351556 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e8d70c75-50cc-4b08-b08f-fbda5dc51d4e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:28.353286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e8d70c75-50cc-4b08-b08f-fbda5dc51d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:28.367093 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1304/2620] 10.222.0.67 () {58 vars in 1016 bytes} [Thu May 26 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:28.384455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36b05e-7455-482b-81f3-c61cb798a7cd service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:28.386068 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6b36b05e-7455-482b-81f3-c61cb798a7cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:28.400655 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d70c75-50cc-4b08-b08f-fbda5dc51d4e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:28.403973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e8d70c75-50cc-4b08-b08f-fbda5dc51d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:28.407959 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36b05e-7455-482b-81f3-c61cb798a7cd service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:28.417572 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4386051-af39-4c31-a168-1e95843f0f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:28.419594 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4386051-af39-4c31-a168-1e95843f0f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:28.420385 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4386051-af39-4c31-a168-1e95843f0f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:28.421479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4386051-af39-4c31-a168-1e95843f0f3f admin admin] PATH_INFO: `/v3/projects/dd37f783c5c047059d47bec690220d34` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:28.424599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4386051-af39-4c31-a168-1e95843f0f3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd37f783c5c047059d47bec690220d34)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:28.429763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4386051-af39-4c31-a168-1e95843f0f3f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:28.481137 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:28.499093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a4386051-af39-4c31-a168-1e95843f0f3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd37f783c5c047059d47bec690220d34', 'request_id': 'req-a4386051-af39-4c31-a168-1e95843f0f3f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:28.504907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a4386051-af39-4c31-a168-1e95843f0f3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd37f783c5c047059d47bec690220d34', 'request_id': 'req-a4386051-af39-4c31-a168-1e95843f0f3f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:28.514270 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a4386051-af39-4c31-a168-1e95843f0f3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd37f783c5c047059d47bec690220d34', 'request_id': 'req-a4386051-af39-4c31-a168-1e95843f0f3f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:28.514929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d70c75-50cc-4b08-b08f-fbda5dc51d4e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:28.530621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a4386051-af39-4c31-a168-1e95843f0f3f admin admin] The token cache is being invalidate because project dd37f783c5c047059d47bec690220d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:14:28.531069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a4386051-af39-4c31-a168-1e95843f0f3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:28.531939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a4386051-af39-4c31-a168-1e95843f0f3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:28.534059 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1317/2621] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:14:28 2022] DELETE /identity/v3/projects/dd37f783c5c047059d47bec690220d34 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:28.537775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4386051-af39-4c31-a168-1e95843f0f3f admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:28.539383 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a4386051-af39-4c31-a168-1e95843f0f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:28.601880 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095e2a0-e572-4045-a1c2-bdead856dcd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:28.602574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095e2a0-e572-4045-a1c2-bdead856dcd7 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:28.602870 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095e2a0-e572-4045-a1c2-bdead856dcd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:28.603126 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095e2a0-e572-4045-a1c2-bdead856dcd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:28.605061 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9095e2a0-e572-4045-a1c2-bdead856dcd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:28.613973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4386051-af39-4c31-a168-1e95843f0f3f admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:28.618907 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095e2a0-e572-4045-a1c2-bdead856dcd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:28.619801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a05b30-80a9-4946-a2b4-5ee8ec88c38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:28.620786 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095e2a0-e572-4045-a1c2-bdead856dcd7 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:28.620978 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a05b30-80a9-4946-a2b4-5ee8ec88c38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:28.621280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a05b30-80a9-4946-a2b4-5ee8ec88c38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:28.621443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a05b30-80a9-4946-a2b4-5ee8ec88c38c admin admin] PATH_INFO: `/v3/users/9c2817cc8f4044c4afe11dc10682ba72` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:28.622957 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a05b30-80a9-4946-a2b4-5ee8ec88c38c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c2817cc8f4044c4afe11dc10682ba72)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:28.624999 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a05b30-80a9-4946-a2b4-5ee8ec88c38c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:28.633384 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1305/2622] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:28.701180 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-62a05b30-80a9-4946-a2b4-5ee8ec88c38c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c2817cc8f4044c4afe11dc10682ba72'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:28.712201 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:28.726710 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-62a05b30-80a9-4946-a2b4-5ee8ec88c38c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c2817cc8f4044c4afe11dc10682ba72'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:28.728279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-62a05b30-80a9-4946-a2b4-5ee8ec88c38c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c2817cc8f4044c4afe11dc10682ba72'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:28.740086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-62a05b30-80a9-4946-a2b4-5ee8ec88c38c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c2817cc8f4044c4afe11dc10682ba72'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:28.749876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-62a05b30-80a9-4946-a2b4-5ee8ec88c38c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c2817cc8f4044c4afe11dc10682ba72'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:28.760141 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1318/2623] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:14:28 2022] DELETE /identity/v3/users/9c2817cc8f4044c4afe11dc10682ba72 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:14:29.101598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095e2a0-e572-4045-a1c2-bdead856dcd7 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:29.114723 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095e2a0-e572-4045-a1c2-bdead856dcd7 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:29.203653 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804058a-f8b0-4aa6-ab5c-1d5af9d65322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:29.204551 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804058a-f8b0-4aa6-ab5c-1d5af9d65322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:29.204839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804058a-f8b0-4aa6-ab5c-1d5af9d65322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:29.205119 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804058a-f8b0-4aa6-ab5c-1d5af9d65322 admin admin] PATH_INFO: `/v3/projects/7b511b7b827d4fbb99b6056a13d5ea5b` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:29.206474 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804058a-f8b0-4aa6-ab5c-1d5af9d65322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b511b7b827d4fbb99b6056a13d5ea5b)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:29.208417 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804058a-f8b0-4aa6-ab5c-1d5af9d65322 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:29.261950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a804058a-f8b0-4aa6-ab5c-1d5af9d65322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b511b7b827d4fbb99b6056a13d5ea5b', 'request_id': 'req-a804058a-f8b0-4aa6-ab5c-1d5af9d65322'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:29.271902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a804058a-f8b0-4aa6-ab5c-1d5af9d65322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b511b7b827d4fbb99b6056a13d5ea5b', 'request_id': 'req-a804058a-f8b0-4aa6-ab5c-1d5af9d65322'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:29.279758 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a804058a-f8b0-4aa6-ab5c-1d5af9d65322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b511b7b827d4fbb99b6056a13d5ea5b', 'request_id': 'req-a804058a-f8b0-4aa6-ab5c-1d5af9d65322'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:29.289436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:29.302274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a804058a-f8b0-4aa6-ab5c-1d5af9d65322 admin admin] The token cache is being invalidate because project 7b511b7b827d4fbb99b6056a13d5ea5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:14:29.302899 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a804058a-f8b0-4aa6-ab5c-1d5af9d65322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:29.304008 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a804058a-f8b0-4aa6-ab5c-1d5af9d65322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:29.305746 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1306/2624] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:14:29 2022] DELETE /identity/v3/projects/7b511b7b827d4fbb99b6056a13d5ea5b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:29.312753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f02ba-8541-43d3-a9e1-bb43a424ebf2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:29.312753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f02ba-8541-43d3-a9e1-bb43a424ebf2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:29.312753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f02ba-8541-43d3-a9e1-bb43a424ebf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:29.332399 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-bb0f02ba-8541-43d3-a9e1-bb43a424ebf2 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:29.333782 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bb0f02ba-8541-43d3-a9e1-bb43a424ebf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:29.401714 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1319/2625] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:29.411061 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211ee26-7582-454b-8055-7cd7e57db25f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:29.411496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211ee26-7582-454b-8055-7cd7e57db25f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:29.411901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211ee26-7582-454b-8055-7cd7e57db25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:29.434272 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3211ee26-7582-454b-8055-7cd7e57db25f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:29.435525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3211ee26-7582-454b-8055-7cd7e57db25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:29.451173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1307/2626] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:29.456470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f02ba-8541-43d3-a9e1-bb43a424ebf2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:29.467170 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f02ba-8541-43d3-a9e1-bb43a424ebf2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:29.472212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086bb0a-39ec-4ea4-b46e-9ccbb7d35480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:29.472920 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086bb0a-39ec-4ea4-b46e-9ccbb7d35480 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:29.473205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086bb0a-39ec-4ea4-b46e-9ccbb7d35480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:29.473480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086bb0a-39ec-4ea4-b46e-9ccbb7d35480 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:29.474288 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086bb0a-39ec-4ea4-b46e-9ccbb7d35480 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:14:29.474587 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086bb0a-39ec-4ea4-b46e-9ccbb7d35480 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:29.476264 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086bb0a-39ec-4ea4-b46e-9ccbb7d35480 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:29.493507 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1320/2627] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:14:29.499208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211ee26-7582-454b-8055-7cd7e57db25f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:29.514405 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211ee26-7582-454b-8055-7cd7e57db25f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:29.519843 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2c5c3-8d49-49ef-8ac3-bae7d1e799bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:29.520537 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c5c3-8d49-49ef-8ac3-bae7d1e799bf admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:29.520848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c5c3-8d49-49ef-8ac3-bae7d1e799bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:29.521134 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c5c3-8d49-49ef-8ac3-bae7d1e799bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:29.521878 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2c5c3-8d49-49ef-8ac3-bae7d1e799bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:29.524110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2c5c3-8d49-49ef-8ac3-bae7d1e799bf admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:29.562383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1308/2628] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:14:29 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:14:29.567167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086bb0a-39ec-4ea4-b46e-9ccbb7d35480 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:29.578898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086bb0a-39ec-4ea4-b46e-9ccbb7d35480 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:29.645588 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c09e21-74a8-485d-89c2-42a5b582ad59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:29.646651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c09e21-74a8-485d-89c2-42a5b582ad59 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:29.646651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c09e21-74a8-485d-89c2-42a5b582ad59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:29.647023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c09e21-74a8-485d-89c2-42a5b582ad59 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:29.647627 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c09e21-74a8-485d-89c2-42a5b582ad59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:29.649583 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c09e21-74a8-485d-89c2-42a5b582ad59 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:29.679581 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1321/2629] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:14:29 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:14:29.684280 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2c5c3-8d49-49ef-8ac3-bae7d1e799bf admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:29.696216 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2c5c3-8d49-49ef-8ac3-bae7d1e799bf admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:29.701851 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1cc92-0efa-487b-a1bd-5477e15fca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:29.702652 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1cc92-0efa-487b-a1bd-5477e15fca7c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:29.702994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1cc92-0efa-487b-a1bd-5477e15fca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:29.703320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1cc92-0efa-487b-a1bd-5477e15fca7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:29.704124 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1cc92-0efa-487b-a1bd-5477e15fca7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:29.705937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1cc92-0efa-487b-a1bd-5477e15fca7c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:29.717930 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1309/2630] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:14:29.725371 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c09e21-74a8-485d-89c2-42a5b582ad59 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:29.741171 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c09e21-74a8-485d-89c2-42a5b582ad59 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:29.746163 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf753d-4605-4a87-8b45-b5b5216709f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:29.746852 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf753d-4605-4a87-8b45-b5b5216709f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:29.747138 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf753d-4605-4a87-8b45-b5b5216709f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:29.747414 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf753d-4605-4a87-8b45-b5b5216709f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:29.748207 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf753d-4605-4a87-8b45-b5b5216709f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:29.749996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf753d-4605-4a87-8b45-b5b5216709f0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:29.760669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1322/2631] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:14:29.765665 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1cc92-0efa-487b-a1bd-5477e15fca7c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:29.785922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1cc92-0efa-487b-a1bd-5477e15fca7c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:29.791066 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f11ee-d89c-470c-8ebe-439178fe8da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:29.792102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f11ee-d89c-470c-8ebe-439178fe8da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:29.792483 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f11ee-d89c-470c-8ebe-439178fe8da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:29.792860 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f11ee-d89c-470c-8ebe-439178fe8da7 admin admin] PATH_INFO: `/v3/projects/467b9d8023344bd797c44ebb75f4d817/users/95424355a4614106ab49a049fb01d30d/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:29.815589 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f11ee-d89c-470c-8ebe-439178fe8da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=467b9d8023344bd797c44ebb75f4d817, user_id=95424355a4614106ab49a049fb01d30d, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:29.818501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f11ee-d89c-470c-8ebe-439178fe8da7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:29.837766 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1310/2632] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:14:29 2022] PUT /identity/v3/projects/467b9d8023344bd797c44ebb75f4d817/users/95424355a4614106ab49a049fb01d30d/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:29.855994 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff1302-f5f5-47f0-92d4-e5b32145b393 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:29.856507 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff1302-f5f5-47f0-92d4-e5b32145b393 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:29.856965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff1302-f5f5-47f0-92d4-e5b32145b393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:29.892215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-4fff1302-f5f5-47f0-92d4-e5b32145b393 None None] MFA Rules not processed for user `95424355a4614106ab49a049fb01d30d`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:29.893612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-4fff1302-f5f5-47f0-92d4-e5b32145b393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:29.927860 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:29.972310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1323/2633] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:29.977409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f11ee-d89c-470c-8ebe-439178fe8da7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:30.068937 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f11ee-d89c-470c-8ebe-439178fe8da7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:30.076426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b693dec-1251-4b8b-bdea-9abfb55e4140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:30.077156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b693dec-1251-4b8b-bdea-9abfb55e4140 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:30.077780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b693dec-1251-4b8b-bdea-9abfb55e4140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:30.078192 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b693dec-1251-4b8b-bdea-9abfb55e4140 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:30.078940 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b693dec-1251-4b8b-bdea-9abfb55e4140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:30.080865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b693dec-1251-4b8b-bdea-9abfb55e4140 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:30.120028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1311/2634] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:14:29 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:14:30.125781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff1302-f5f5-47f0-92d4-e5b32145b393 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:30.137683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff1302-f5f5-47f0-92d4-e5b32145b393 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:30.209137 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c516078-7d38-4806-81c1-3846c426da75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:30.209871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c516078-7d38-4806-81c1-3846c426da75 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:30.210158 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c516078-7d38-4806-81c1-3846c426da75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:30.210439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c516078-7d38-4806-81c1-3846c426da75 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:30.211156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c516078-7d38-4806-81c1-3846c426da75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:30.213108 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c516078-7d38-4806-81c1-3846c426da75 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:30.234768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1324/2635] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:14:30 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:14:30.238909 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b693dec-1251-4b8b-bdea-9abfb55e4140 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:30.251215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b693dec-1251-4b8b-bdea-9abfb55e4140 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:30.256888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29796d1c-4ebc-44bf-aa20-56e3b8bfe228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:30.257587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29796d1c-4ebc-44bf-aa20-56e3b8bfe228 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:30.257909 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29796d1c-4ebc-44bf-aa20-56e3b8bfe228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:30.258190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29796d1c-4ebc-44bf-aa20-56e3b8bfe228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:30.259029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29796d1c-4ebc-44bf-aa20-56e3b8bfe228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:30.260897 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29796d1c-4ebc-44bf-aa20-56e3b8bfe228 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:30.282174 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1312/2636] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:14:30.287003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c516078-7d38-4806-81c1-3846c426da75 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:30.299848 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c516078-7d38-4806-81c1-3846c426da75 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:30.305130 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab3a20-e7d9-4259-a5ca-7e4380c249b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:30.306177 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab3a20-e7d9-4259-a5ca-7e4380c249b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:30.306355 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab3a20-e7d9-4259-a5ca-7e4380c249b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:30.306631 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab3a20-e7d9-4259-a5ca-7e4380c249b1 admin admin] PATH_INFO: `/v3/projects/45bfd3ce76e044f284d0fa5d406277fa/users/af26249709f44d17aee3bd989da0e022/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:30.323706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab3a20-e7d9-4259-a5ca-7e4380c249b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45bfd3ce76e044f284d0fa5d406277fa, user_id=af26249709f44d17aee3bd989da0e022, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:30.327615 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab3a20-e7d9-4259-a5ca-7e4380c249b1 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:30.344586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1325/2637] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:14:30 2022] PUT /identity/v3/projects/45bfd3ce76e044f284d0fa5d406277fa/users/af26249709f44d17aee3bd989da0e022/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:30.350495 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29796d1c-4ebc-44bf-aa20-56e3b8bfe228 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:30.362012 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29796d1c-4ebc-44bf-aa20-56e3b8bfe228 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:30.424691 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c74c4-87b8-43b8-87ee-3623f70e2195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:30.425389 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c74c4-87b8-43b8-87ee-3623f70e2195 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:30.425673 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c74c4-87b8-43b8-87ee-3623f70e2195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:30.425989 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c74c4-87b8-43b8-87ee-3623f70e2195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:30.426755 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c74c4-87b8-43b8-87ee-3623f70e2195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:30.428379 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c74c4-87b8-43b8-87ee-3623f70e2195 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:30.440102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1313/2638] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:14:30.445080 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab3a20-e7d9-4259-a5ca-7e4380c249b1 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:30.457075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab3a20-e7d9-4259-a5ca-7e4380c249b1 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:30.462905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a9af6-a19c-4973-bd69-8f473eda8ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:30.464230 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a9af6-a19c-4973-bd69-8f473eda8ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:30.464591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a9af6-a19c-4973-bd69-8f473eda8ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:30.464980 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a9af6-a19c-4973-bd69-8f473eda8ecd admin admin] PATH_INFO: `/v3/projects/45bfd3ce76e044f284d0fa5d406277fa/users/af26249709f44d17aee3bd989da0e022/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:30.467356 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a9af6-a19c-4973-bd69-8f473eda8ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=45bfd3ce76e044f284d0fa5d406277fa, user_id=af26249709f44d17aee3bd989da0e022, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:30.470101 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a9af6-a19c-4973-bd69-8f473eda8ecd admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:30.487291 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1326/2639] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:14:30 2022] PUT /identity/v3/projects/45bfd3ce76e044f284d0fa5d406277fa/users/af26249709f44d17aee3bd989da0e022/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:30.501259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c88fd-580a-46f9-9d06-cc61e3dbed30 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:30.501549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c88fd-580a-46f9-9d06-cc61e3dbed30 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:30.501871 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c88fd-580a-46f9-9d06-cc61e3dbed30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:30.513458 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:30.536840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a11c88fd-580a-46f9-9d06-cc61e3dbed30 None None] MFA Rules not processed for user `af26249709f44d17aee3bd989da0e022`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:30.538355 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a11c88fd-580a-46f9-9d06-cc61e3dbed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:30.619336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1314/2640] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:30.635568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a9af6-a19c-4973-bd69-8f473eda8ecd admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:30.638139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d77a9af6-a19c-4973-bd69-8f473eda8ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:30.708744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a9af6-a19c-4973-bd69-8f473eda8ecd admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:30.712652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c17a6c-128a-466c-b266-ab1054313471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:30.713333 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17a6c-128a-466c-b266-ab1054313471 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:30.713635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17a6c-128a-466c-b266-ab1054313471 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:30.713926 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17a6c-128a-466c-b266-ab1054313471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:30.753268 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:30.797324 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c17a6c-128a-466c-b266-ab1054313471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:30.800149 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c17a6c-128a-466c-b266-ab1054313471 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:30.813626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1327/2641] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:31.759472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b5fcf-99e4-402e-88ae-6f9a0e2e1a10 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:31.760218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b5fcf-99e4-402e-88ae-6f9a0e2e1a10 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:31.760467 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b5fcf-99e4-402e-88ae-6f9a0e2e1a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:31.788847 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-923b5fcf-99e4-402e-88ae-6f9a0e2e1a10 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:31.790614 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-923b5fcf-99e4-402e-88ae-6f9a0e2e1a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:31.855566 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1315/2642] 10.222.0.67 () {58 vars in 1016 bytes} [Thu May 26 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:31.886409 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c17a6c-128a-466c-b266-ab1054313471 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:31.888527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-51c17a6c-128a-466c-b266-ab1054313471 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:31.989137 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c17a6c-128a-466c-b266-ab1054313471 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:32.000050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504120f6-4cb1-4dfe-9519-f47d6f8e2269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:32.003929 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504120f6-4cb1-4dfe-9519-f47d6f8e2269 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:32.004560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504120f6-4cb1-4dfe-9519-f47d6f8e2269 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:32.004970 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504120f6-4cb1-4dfe-9519-f47d6f8e2269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:32.015455 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504120f6-4cb1-4dfe-9519-f47d6f8e2269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:32.018317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504120f6-4cb1-4dfe-9519-f47d6f8e2269 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:32.031131 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1328/2643] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:32.298682 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b5fcf-99e4-402e-88ae-6f9a0e2e1a10 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:32.312272 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b5fcf-99e4-402e-88ae-6f9a0e2e1a10 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:32.317449 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805e030-538e-4bfc-b73b-584b96e7a4ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:32.318397 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805e030-538e-4bfc-b73b-584b96e7a4ab service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:32.318844 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805e030-538e-4bfc-b73b-584b96e7a4ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:32.319266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805e030-538e-4bfc-b73b-584b96e7a4ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:32.332053 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805e030-538e-4bfc-b73b-584b96e7a4ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:32.334516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805e030-538e-4bfc-b73b-584b96e7a4ab service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:32.353094 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1316/2644] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:34.858009 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093a014-866f-4223-9e1a-9f105b664727 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:34.858901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093a014-866f-4223-9e1a-9f105b664727 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:34.858901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093a014-866f-4223-9e1a-9f105b664727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:34.883763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d093a014-866f-4223-9e1a-9f105b664727 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:34.885156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d093a014-866f-4223-9e1a-9f105b664727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:34.895321 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1329/2645] 10.222.0.67 () {58 vars in 1016 bytes} [Thu May 26 21:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:14:34.928408 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805e030-538e-4bfc-b73b-584b96e7a4ab service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:34.930116 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6805e030-538e-4bfc-b73b-584b96e7a4ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:34.955865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805e030-538e-4bfc-b73b-584b96e7a4ab service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:34.966574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324290d9-33c3-49b8-9dfb-50d92c10eb1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:34.967410 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324290d9-33c3-49b8-9dfb-50d92c10eb1b service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:34.967785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324290d9-33c3-49b8-9dfb-50d92c10eb1b service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:34.968183 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324290d9-33c3-49b8-9dfb-50d92c10eb1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:34.985974 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324290d9-33c3-49b8-9dfb-50d92c10eb1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:34.987963 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324290d9-33c3-49b8-9dfb-50d92c10eb1b service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:35.003823 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1317/2646] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:36.351088 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093a014-866f-4223-9e1a-9f105b664727 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:36.363650 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093a014-866f-4223-9e1a-9f105b664727 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:36.368514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f82860-d208-40ab-acc5-6e4da9f84c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:36.369422 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f82860-d208-40ab-acc5-6e4da9f84c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:36.369699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f82860-d208-40ab-acc5-6e4da9f84c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:36.370022 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f82860-d208-40ab-acc5-6e4da9f84c35 admin admin] PATH_INFO: `/v3/users/95424355a4614106ab49a049fb01d30d` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:36.371268 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f82860-d208-40ab-acc5-6e4da9f84c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95424355a4614106ab49a049fb01d30d)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:36.373524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f82860-d208-40ab-acc5-6e4da9f84c35 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:36.440545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c0f82860-d208-40ab-acc5-6e4da9f84c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95424355a4614106ab49a049fb01d30d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:36.456535 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c0f82860-d208-40ab-acc5-6e4da9f84c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95424355a4614106ab49a049fb01d30d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:36.457404 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c0f82860-d208-40ab-acc5-6e4da9f84c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95424355a4614106ab49a049fb01d30d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:36.466215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c0f82860-d208-40ab-acc5-6e4da9f84c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95424355a4614106ab49a049fb01d30d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:36.476028 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c0f82860-d208-40ab-acc5-6e4da9f84c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95424355a4614106ab49a049fb01d30d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:36.482762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1330/2647] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:14:36 2022] DELETE /identity/v3/users/95424355a4614106ab49a049fb01d30d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:36.487927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6b740-06b1-4219-9ce9-ceb9c43b0522 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:36.488673 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6b740-06b1-4219-9ce9-ceb9c43b0522 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:36.488673 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6b740-06b1-4219-9ce9-ceb9c43b0522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:36.512245 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-81b6b740-06b1-4219-9ce9-ceb9c43b0522 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:36.513541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-81b6b740-06b1-4219-9ce9-ceb9c43b0522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:36.584304 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1318/2648] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:14:36.595210 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f82860-d208-40ab-acc5-6e4da9f84c35 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:36.597066 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c0f82860-d208-40ab-acc5-6e4da9f84c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:36.646862 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:36.699472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f82860-d208-40ab-acc5-6e4da9f84c35 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:36.704439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21649cc5-8ae6-4dee-85d4-7a7d11441e39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:36.705109 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21649cc5-8ae6-4dee-85d4-7a7d11441e39 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:36.705393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21649cc5-8ae6-4dee-85d4-7a7d11441e39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:36.705672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21649cc5-8ae6-4dee-85d4-7a7d11441e39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:36.716117 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21649cc5-8ae6-4dee-85d4-7a7d11441e39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:36.718385 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21649cc5-8ae6-4dee-85d4-7a7d11441e39 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:36.728925 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1331/2649] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:37.066735 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6b740-06b1-4219-9ce9-ceb9c43b0522 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:37.068745 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-81b6b740-06b1-4219-9ce9-ceb9c43b0522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:37.079056 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:37.087071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6b740-06b1-4219-9ce9-ceb9c43b0522 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:37.093493 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ca8b1-4961-4955-9878-a11eb53e7077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:37.094320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ca8b1-4961-4955-9878-a11eb53e7077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:37.094610 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ca8b1-4961-4955-9878-a11eb53e7077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:37.094897 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ca8b1-4961-4955-9878-a11eb53e7077 admin admin] PATH_INFO: `/v3/projects/467b9d8023344bd797c44ebb75f4d817` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:37.096333 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ca8b1-4961-4955-9878-a11eb53e7077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=467b9d8023344bd797c44ebb75f4d817)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:37.098789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ca8b1-4961-4955-9878-a11eb53e7077 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:37.158086 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0c0ca8b1-4961-4955-9878-a11eb53e7077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '467b9d8023344bd797c44ebb75f4d817', 'request_id': 'req-0c0ca8b1-4961-4955-9878-a11eb53e7077'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:37.168104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0c0ca8b1-4961-4955-9878-a11eb53e7077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '467b9d8023344bd797c44ebb75f4d817', 'request_id': 'req-0c0ca8b1-4961-4955-9878-a11eb53e7077'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:37.176073 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0c0ca8b1-4961-4955-9878-a11eb53e7077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '467b9d8023344bd797c44ebb75f4d817', 'request_id': 'req-0c0ca8b1-4961-4955-9878-a11eb53e7077'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:37.189531 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0c0ca8b1-4961-4955-9878-a11eb53e7077 admin admin] The token cache is being invalidate because project 467b9d8023344bd797c44ebb75f4d817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:14:37.191185 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0c0ca8b1-4961-4955-9878-a11eb53e7077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:37.191185 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0c0ca8b1-4961-4955-9878-a11eb53e7077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:37.194935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1319/2650] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:14:37 2022] DELETE /identity/v3/projects/467b9d8023344bd797c44ebb75f4d817 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:37.196173 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21649cc5-8ae6-4dee-85d4-7a7d11441e39 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:37.207362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21649cc5-8ae6-4dee-85d4-7a7d11441e39 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:37.289889 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60696218-df3a-49b3-aaf0-2f2621befb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:37.291096 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60696218-df3a-49b3-aaf0-2f2621befb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:37.291435 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60696218-df3a-49b3-aaf0-2f2621befb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:37.291886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60696218-df3a-49b3-aaf0-2f2621befb83 admin admin] PATH_INFO: `/v3/users/af26249709f44d17aee3bd989da0e022` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:37.293818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60696218-df3a-49b3-aaf0-2f2621befb83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af26249709f44d17aee3bd989da0e022)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:37.297628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60696218-df3a-49b3-aaf0-2f2621befb83 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:37.378863 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-60696218-df3a-49b3-aaf0-2f2621befb83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af26249709f44d17aee3bd989da0e022'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:37.394549 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-60696218-df3a-49b3-aaf0-2f2621befb83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af26249709f44d17aee3bd989da0e022'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:37.395310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-60696218-df3a-49b3-aaf0-2f2621befb83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af26249709f44d17aee3bd989da0e022'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:37.405218 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-60696218-df3a-49b3-aaf0-2f2621befb83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af26249709f44d17aee3bd989da0e022'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:37.416260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-60696218-df3a-49b3-aaf0-2f2621befb83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af26249709f44d17aee3bd989da0e022'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:37.427301 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1332/2651] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:14:37 2022] DELETE /identity/v3/users/af26249709f44d17aee3bd989da0e022 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:37.787674 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ca8b1-4961-4955-9878-a11eb53e7077 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:37.790146 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0c0ca8b1-4961-4955-9878-a11eb53e7077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:37.807821 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ca8b1-4961-4955-9878-a11eb53e7077 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:37.892317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2549c8-ed32-4630-9ce0-2a4c6b09ae64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:37.893693 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2549c8-ed32-4630-9ce0-2a4c6b09ae64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:37.894258 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2549c8-ed32-4630-9ce0-2a4c6b09ae64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:37.894685 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2549c8-ed32-4630-9ce0-2a4c6b09ae64 admin admin] PATH_INFO: `/v3/projects/45bfd3ce76e044f284d0fa5d406277fa` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:37.896695 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2549c8-ed32-4630-9ce0-2a4c6b09ae64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45bfd3ce76e044f284d0fa5d406277fa)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:37.900046 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2549c8-ed32-4630-9ce0-2a4c6b09ae64 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:37.955432 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9e2549c8-ed32-4630-9ce0-2a4c6b09ae64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45bfd3ce76e044f284d0fa5d406277fa', 'request_id': 'req-9e2549c8-ed32-4630-9ce0-2a4c6b09ae64'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:37.963825 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9e2549c8-ed32-4630-9ce0-2a4c6b09ae64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45bfd3ce76e044f284d0fa5d406277fa', 'request_id': 'req-9e2549c8-ed32-4630-9ce0-2a4c6b09ae64'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:37.971804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9e2549c8-ed32-4630-9ce0-2a4c6b09ae64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45bfd3ce76e044f284d0fa5d406277fa', 'request_id': 'req-9e2549c8-ed32-4630-9ce0-2a4c6b09ae64'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:37.984490 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9e2549c8-ed32-4630-9ce0-2a4c6b09ae64 admin admin] The token cache is being invalidate because project 45bfd3ce76e044f284d0fa5d406277fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:14:37.984837 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9e2549c8-ed32-4630-9ce0-2a4c6b09ae64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:37.985535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9e2549c8-ed32-4630-9ce0-2a4c6b09ae64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:37.987379 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1320/2652] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:14:37 2022] DELETE /identity/v3/projects/45bfd3ce76e044f284d0fa5d406277fa => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:37.994159 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e93f9-25b1-4a76-8756-f1ba3759f4b5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:37.994457 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e93f9-25b1-4a76-8756-f1ba3759f4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:37.994787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e93f9-25b1-4a76-8756-f1ba3759f4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:38.019773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-792e93f9-25b1-4a76-8756-f1ba3759f4b5 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:38.021117 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-792e93f9-25b1-4a76-8756-f1ba3759f4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:38.077916 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:38.107755 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1333/2653] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:38.111595 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f355b-8d09-4550-9d6d-7e53a542573c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:38.112090 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f355b-8d09-4550-9d6d-7e53a542573c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:38.112543 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f355b-8d09-4550-9d6d-7e53a542573c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:38.144071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b41f355b-8d09-4550-9d6d-7e53a542573c None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:38.146596 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b41f355b-8d09-4550-9d6d-7e53a542573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:38.160071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1321/2654] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:38.164837 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e93f9-25b1-4a76-8756-f1ba3759f4b5 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:38.176098 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e93f9-25b1-4a76-8756-f1ba3759f4b5 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:38.181292 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856769a7-aa54-4192-a7bc-3f9ec9334601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:38.182076 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856769a7-aa54-4192-a7bc-3f9ec9334601 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:38.182399 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856769a7-aa54-4192-a7bc-3f9ec9334601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:38.182702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856769a7-aa54-4192-a7bc-3f9ec9334601 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:38.183501 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856769a7-aa54-4192-a7bc-3f9ec9334601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:14:38.183832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856769a7-aa54-4192-a7bc-3f9ec9334601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:38.185776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856769a7-aa54-4192-a7bc-3f9ec9334601 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:38.202525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1334/2655] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:14:38.208454 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f355b-8d09-4550-9d6d-7e53a542573c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:38.221884 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f355b-8d09-4550-9d6d-7e53a542573c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:38.228487 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0131ab0-4b11-4f33-99f5-b32600f102ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:38.229874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131ab0-4b11-4f33-99f5-b32600f102ce admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:38.230237 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131ab0-4b11-4f33-99f5-b32600f102ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:38.230573 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131ab0-4b11-4f33-99f5-b32600f102ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:38.231578 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0131ab0-4b11-4f33-99f5-b32600f102ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:38.234969 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0131ab0-4b11-4f33-99f5-b32600f102ce admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:38.250026 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:38.295541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1322/2656] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:14:38 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:14:38.303368 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856769a7-aa54-4192-a7bc-3f9ec9334601 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:38.318877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856769a7-aa54-4192-a7bc-3f9ec9334601 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:38.414619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094d5f2-6eef-430c-b31f-d9d235e24539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:38.415630 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094d5f2-6eef-430c-b31f-d9d235e24539 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:38.415630 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094d5f2-6eef-430c-b31f-d9d235e24539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:38.415906 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094d5f2-6eef-430c-b31f-d9d235e24539 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:38.417042 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094d5f2-6eef-430c-b31f-d9d235e24539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:38.419233 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094d5f2-6eef-430c-b31f-d9d235e24539 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:38.456829 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1335/2657] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:14:38 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:14:38.461278 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0131ab0-4b11-4f33-99f5-b32600f102ce admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:38.474760 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0131ab0-4b11-4f33-99f5-b32600f102ce admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:38.486971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88113769-f674-4d85-bd33-ec308fd00ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:38.487784 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88113769-f674-4d85-bd33-ec308fd00ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:38.488138 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88113769-f674-4d85-bd33-ec308fd00ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:38.488486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88113769-f674-4d85-bd33-ec308fd00ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:38.489369 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88113769-f674-4d85-bd33-ec308fd00ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:38.491161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88113769-f674-4d85-bd33-ec308fd00ef4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:38.510101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1323/2658] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:14:38.511743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094d5f2-6eef-430c-b31f-d9d235e24539 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:38.529838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094d5f2-6eef-430c-b31f-d9d235e24539 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:38.537848 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1f7df-f16b-4149-9f3f-4e5da4c05b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:38.538599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1f7df-f16b-4149-9f3f-4e5da4c05b5a admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:38.538809 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1f7df-f16b-4149-9f3f-4e5da4c05b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:38.539142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1f7df-f16b-4149-9f3f-4e5da4c05b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:38.539855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1f7df-f16b-4149-9f3f-4e5da4c05b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:38.541549 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1f7df-f16b-4149-9f3f-4e5da4c05b5a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:38.558218 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1336/2659] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:14:38.564686 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88113769-f674-4d85-bd33-ec308fd00ef4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:38.583036 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88113769-f674-4d85-bd33-ec308fd00ef4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:38.589087 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c14b78-449c-4021-9bf5-9549c1eadef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:38.590724 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c14b78-449c-4021-9bf5-9549c1eadef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:38.591408 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c14b78-449c-4021-9bf5-9549c1eadef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:38.592983 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c14b78-449c-4021-9bf5-9549c1eadef2 admin admin] PATH_INFO: `/v3/projects/8300616abec747dcbf33530908559923/users/68307176308e49e0b96d9683d9646e97/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:38.627753 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c14b78-449c-4021-9bf5-9549c1eadef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8300616abec747dcbf33530908559923, user_id=68307176308e49e0b96d9683d9646e97, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:38.630764 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c14b78-449c-4021-9bf5-9549c1eadef2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:38.650654 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1324/2660] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:14:38 2022] PUT /identity/v3/projects/8300616abec747dcbf33530908559923/users/68307176308e49e0b96d9683d9646e97/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:38.671215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5590a66-0908-4d8a-9e52-df0fcce59a63 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:38.671793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5590a66-0908-4d8a-9e52-df0fcce59a63 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:38.672179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5590a66-0908-4d8a-9e52-df0fcce59a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:38.720626 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e5590a66-0908-4d8a-9e52-df0fcce59a63 None None] MFA Rules not processed for user `68307176308e49e0b96d9683d9646e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:38.721923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e5590a66-0908-4d8a-9e52-df0fcce59a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:38.817978 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1337/2661] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:38.825861 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c14b78-449c-4021-9bf5-9549c1eadef2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:38.951284 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c14b78-449c-4021-9bf5-9549c1eadef2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:38.959731 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e283375-c1b4-4d43-97f0-4b98597a6320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:38.960909 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e283375-c1b4-4d43-97f0-4b98597a6320 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:38.961399 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e283375-c1b4-4d43-97f0-4b98597a6320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:38.961908 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e283375-c1b4-4d43-97f0-4b98597a6320 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:38.963232 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e283375-c1b4-4d43-97f0-4b98597a6320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:38.967299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e283375-c1b4-4d43-97f0-4b98597a6320 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:39.012769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bc4ad-7237-442f-a827-ae39790c5067 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:39.015606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bc4ad-7237-442f-a827-ae39790c5067 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:39.015606 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bc4ad-7237-442f-a827-ae39790c5067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:39.032880 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1325/2662] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:14:38 2022] POST /identity/v3/projects => generated 379 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:14:39.038957 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e283375-c1b4-4d43-97f0-4b98597a6320 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:39.040966 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b18bc4ad-7237-442f-a827-ae39790c5067 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:39.042430 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b18bc4ad-7237-442f-a827-ae39790c5067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:39.116721 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:39.149051 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e283375-c1b4-4d43-97f0-4b98597a6320 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:39.156822 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a22e1-9eab-477a-a398-e39c43aa1210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:39.158789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a22e1-9eab-477a-a398-e39c43aa1210 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:39.159664 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a22e1-9eab-477a-a398-e39c43aa1210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:39.160090 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a22e1-9eab-477a-a398-e39c43aa1210 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:39.161500 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a22e1-9eab-477a-a398-e39c43aa1210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:39.164102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a22e1-9eab-477a-a398-e39c43aa1210 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:39.189046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1338/2663] 10.222.0.67 () {58 vars in 1016 bytes} [Thu May 26 21:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:39.200841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1326/2664] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:14:39 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:14:39.203822 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bc4ad-7237-442f-a827-ae39790c5067 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:39.215777 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a22e1-9eab-477a-a398-e39c43aa1210 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:39.217148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bc4ad-7237-442f-a827-ae39790c5067 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:39.219084 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1f5a22e1-9eab-477a-a398-e39c43aa1210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:39.230694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcfdb3-33e1-4245-95a4-df532f60c787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:39.231412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcfdb3-33e1-4245-95a4-df532f60c787 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:39.231701 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcfdb3-33e1-4245-95a4-df532f60c787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:39.231963 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcfdb3-33e1-4245-95a4-df532f60c787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:39.232898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcfdb3-33e1-4245-95a4-df532f60c787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:39.236961 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcfdb3-33e1-4245-95a4-df532f60c787 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:39.266033 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:39.282646 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1339/2665] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:14:39.288111 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcfdb3-33e1-4245-95a4-df532f60c787 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:39.301341 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcfdb3-33e1-4245-95a4-df532f60c787 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:39.317605 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f13b0-8000-42cd-bc67-7cb712dbc1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:39.319924 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f13b0-8000-42cd-bc67-7cb712dbc1da admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:39.321175 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f13b0-8000-42cd-bc67-7cb712dbc1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:39.321928 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f13b0-8000-42cd-bc67-7cb712dbc1da admin admin] PATH_INFO: `/v3/projects/40ff1ded287c4e8d91fe58dab1afddd1/users/4bf76d28920c4040a65d517304978b14/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:39.344317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f13b0-8000-42cd-bc67-7cb712dbc1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ff1ded287c4e8d91fe58dab1afddd1, user_id=4bf76d28920c4040a65d517304978b14, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:39.364529 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f13b0-8000-42cd-bc67-7cb712dbc1da admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:39.394656 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1340/2666] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:14:39 2022] PUT /identity/v3/projects/40ff1ded287c4e8d91fe58dab1afddd1/users/4bf76d28920c4040a65d517304978b14/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:14:39.405622 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f13b0-8000-42cd-bc67-7cb712dbc1da admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:39.459110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a22e1-9eab-477a-a398-e39c43aa1210 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:39.524553 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f13b0-8000-42cd-bc67-7cb712dbc1da admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:39.532329 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4e4db-ede7-41d3-9428-11c577ef24c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:39.533256 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4e4db-ede7-41d3-9428-11c577ef24c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:39.533547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4e4db-ede7-41d3-9428-11c577ef24c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:39.533851 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4e4db-ede7-41d3-9428-11c577ef24c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:39.534618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4e4db-ede7-41d3-9428-11c577ef24c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:39.537038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4e4db-ede7-41d3-9428-11c577ef24c4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:39.549874 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1341/2667] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:14:39.554785 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4e4db-ede7-41d3-9428-11c577ef24c4 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:39.564043 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f75d9-76a8-4561-859f-e5196c232d76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:39.565236 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f75d9-76a8-4561-859f-e5196c232d76 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:39.565236 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f75d9-76a8-4561-859f-e5196c232d76 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:39.565236 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f75d9-76a8-4561-859f-e5196c232d76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:39.571811 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4e4db-ede7-41d3-9428-11c577ef24c4 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:39.576424 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f75d9-76a8-4561-859f-e5196c232d76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:39.578121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f75d9-76a8-4561-859f-e5196c232d76 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:39.580510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d59d6-d88b-46ee-b986-4f8643c19d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:39.581498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d59d6-d88b-46ee-b986-4f8643c19d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:39.581840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d59d6-d88b-46ee-b986-4f8643c19d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:39.582153 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d59d6-d88b-46ee-b986-4f8643c19d05 admin admin] PATH_INFO: `/v3/projects/40ff1ded287c4e8d91fe58dab1afddd1/users/4bf76d28920c4040a65d517304978b14/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:39.585474 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d59d6-d88b-46ee-b986-4f8643c19d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ff1ded287c4e8d91fe58dab1afddd1, user_id=4bf76d28920c4040a65d517304978b14, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:39.588292 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d59d6-d88b-46ee-b986-4f8643c19d05 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:39.590451 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1327/2668] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:14:39.620706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1342/2669] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:14:39 2022] PUT /identity/v3/projects/40ff1ded287c4e8d91fe58dab1afddd1/users/4bf76d28920c4040a65d517304978b14/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:14:39.622988 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9da37-66bd-44d4-b788-04203c960c9c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:39.623285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9da37-66bd-44d4-b788-04203c960c9c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:39.623562 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9da37-66bd-44d4-b788-04203c960c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:39.666764 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6aa9da37-66bd-44d4-b788-04203c960c9c None None] MFA Rules not processed for user `4bf76d28920c4040a65d517304978b14`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:39.668326 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6aa9da37-66bd-44d4-b788-04203c960c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:39.855392 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1328/2670] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:14:39.879815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d59d6-d88b-46ee-b986-4f8643c19d05 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:39.882025 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5e7d59d6-d88b-46ee-b986-4f8643c19d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:39.977357 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d59d6-d88b-46ee-b986-4f8643c19d05 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:39.981696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd473dc-26ea-4d50-b563-aa6dd5dbf2b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:39.982636 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd473dc-26ea-4d50-b563-aa6dd5dbf2b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:39.983081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd473dc-26ea-4d50-b563-aa6dd5dbf2b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:39.983371 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd473dc-26ea-4d50-b563-aa6dd5dbf2b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:39.995857 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd473dc-26ea-4d50-b563-aa6dd5dbf2b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:39.997673 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd473dc-26ea-4d50-b563-aa6dd5dbf2b5 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:40.009963 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1343/2671] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:40.459266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9da37-66bd-44d4-b788-04203c960c9c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:40.473350 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9da37-66bd-44d4-b788-04203c960c9c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:40.479213 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab38c1-8f03-4e8c-a5f8-b7624e411538 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf76d28920c4040a65d517304978b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ff1ded287c4e8d91fe58dab1afddd1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:40.479922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab38c1-8f03-4e8c-a5f8-b7624e411538 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:40.480211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab38c1-8f03-4e8c-a5f8-b7624e411538 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:40.480493 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab38c1-8f03-4e8c-a5f8-b7624e411538 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:40.481266 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab38c1-8f03-4e8c-a5f8-b7624e411538 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:14:40.481566 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab38c1-8f03-4e8c-a5f8-b7624e411538 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:40.483269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab38c1-8f03-4e8c-a5f8-b7624e411538 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:40.498154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1329/2672] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:14:40.502583 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd473dc-26ea-4d50-b563-aa6dd5dbf2b5 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:40.514855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd473dc-26ea-4d50-b563-aa6dd5dbf2b5 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:40.519345 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f0ccd-5849-4680-a5f9-94d6da4b4738 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf76d28920c4040a65d517304978b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ff1ded287c4e8d91fe58dab1afddd1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:40.520039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f0ccd-5849-4680-a5f9-94d6da4b4738 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:40.520321 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f0ccd-5849-4680-a5f9-94d6da4b4738 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:40.520755 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f0ccd-5849-4680-a5f9-94d6da4b4738 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:40.521485 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f0ccd-5849-4680-a5f9-94d6da4b4738 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:40.523488 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f0ccd-5849-4680-a5f9-94d6da4b4738 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:40.554113 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1344/2673] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:14:40 2022] POST /identity/v3/projects => generated 354 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:14:40.560049 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab38c1-8f03-4e8c-a5f8-b7624e411538 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:40.575640 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab38c1-8f03-4e8c-a5f8-b7624e411538 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:40.590199 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:40.677220 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd188f48-373a-4021-b430-83c9fd5cdf18 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf76d28920c4040a65d517304978b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ff1ded287c4e8d91fe58dab1afddd1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:40.678675 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd188f48-373a-4021-b430-83c9fd5cdf18 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:40.679044 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd188f48-373a-4021-b430-83c9fd5cdf18 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:40.679413 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd188f48-373a-4021-b430-83c9fd5cdf18 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:40.680472 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd188f48-373a-4021-b430-83c9fd5cdf18 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:14:40.680903 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd188f48-373a-4021-b430-83c9fd5cdf18 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:40.683912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd188f48-373a-4021-b430-83c9fd5cdf18 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:40.708787 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1330/2674] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:14:40.754035 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f0ccd-5849-4680-a5f9-94d6da4b4738 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:40.770107 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f0ccd-5849-4680-a5f9-94d6da4b4738 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:40.777500 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3017e49-b71a-4271-bb9c-4a87665c332c tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bf76d28920c4040a65d517304978b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40ff1ded287c4e8d91fe58dab1afddd1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:40.779012 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017e49-b71a-4271-bb9c-4a87665c332c tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:40.779429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017e49-b71a-4271-bb9c-4a87665c332c tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:40.779770 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017e49-b71a-4271-bb9c-4a87665c332c tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] PATH_INFO: `/v3/projects/d7cb25123ae14683a5cc351c50bb9626` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:40.782023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3017e49-b71a-4271-bb9c-4a87665c332c tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d7cb25123ae14683a5cc351c50bb9626)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:40.784833 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3017e49-b71a-4271-bb9c-4a87665c332c tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:40.799729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:40.871841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d3017e49-b71a-4271-bb9c-4a87665c332c tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7cb25123ae14683a5cc351c50bb9626', 'request_id': 'req-d3017e49-b71a-4271-bb9c-4a87665c332c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:40.877411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d3017e49-b71a-4271-bb9c-4a87665c332c tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7cb25123ae14683a5cc351c50bb9626', 'request_id': 'req-d3017e49-b71a-4271-bb9c-4a87665c332c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:40.890825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d3017e49-b71a-4271-bb9c-4a87665c332c tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7cb25123ae14683a5cc351c50bb9626', 'request_id': 'req-d3017e49-b71a-4271-bb9c-4a87665c332c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:40.910979 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d3017e49-b71a-4271-bb9c-4a87665c332c tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] The token cache is being invalidate because project d7cb25123ae14683a5cc351c50bb9626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:14:40.911260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d3017e49-b71a-4271-bb9c-4a87665c332c tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:40.911943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d3017e49-b71a-4271-bb9c-4a87665c332c tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:40.914382 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1345/2675] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:14:40 2022] DELETE /identity/v3/projects/d7cb25123ae14683a5cc351c50bb9626 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:41.243697 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd188f48-373a-4021-b430-83c9fd5cdf18 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:41.247540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fd188f48-373a-4021-b430-83c9fd5cdf18 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:41.349596 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd188f48-373a-4021-b430-83c9fd5cdf18 tempest-VolumeQuotaClassesTest-438400376 tempest-VolumeQuotaClassesTest-438400376-project-admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:41.430959 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403d321-9d82-422e-94a1-1d7c5908e71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:41.432272 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403d321-9d82-422e-94a1-1d7c5908e71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:41.432712 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403d321-9d82-422e-94a1-1d7c5908e71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:41.433152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403d321-9d82-422e-94a1-1d7c5908e71c admin admin] PATH_INFO: `/v3/users/68307176308e49e0b96d9683d9646e97` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:41.434980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403d321-9d82-422e-94a1-1d7c5908e71c admin admin] RBAC: Authorizing `identity:delete_user(user_id=68307176308e49e0b96d9683d9646e97)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:41.438517 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403d321-9d82-422e-94a1-1d7c5908e71c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:41.508215 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6403d321-9d82-422e-94a1-1d7c5908e71c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68307176308e49e0b96d9683d9646e97'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:41.508955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6403d321-9d82-422e-94a1-1d7c5908e71c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68307176308e49e0b96d9683d9646e97'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:41.520517 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6403d321-9d82-422e-94a1-1d7c5908e71c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68307176308e49e0b96d9683d9646e97'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:41.527609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:41.543931 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6403d321-9d82-422e-94a1-1d7c5908e71c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68307176308e49e0b96d9683d9646e97'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:41.553086 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6403d321-9d82-422e-94a1-1d7c5908e71c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68307176308e49e0b96d9683d9646e97'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:41.561466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1331/2676] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:14:41 2022] DELETE /identity/v3/users/68307176308e49e0b96d9683d9646e97 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:41.566362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b335f13-b9f9-4d17-bf3d-3e41fd84c6ca None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:41.566916 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b335f13-b9f9-4d17-bf3d-3e41fd84c6ca None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:41.566916 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b335f13-b9f9-4d17-bf3d-3e41fd84c6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:41.589810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6b335f13-b9f9-4d17-bf3d-3e41fd84c6ca None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:41.591094 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6b335f13-b9f9-4d17-bf3d-3e41fd84c6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:41.685012 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1346/2677] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:41.705399 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403d321-9d82-422e-94a1-1d7c5908e71c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:41.708262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6403d321-9d82-422e-94a1-1d7c5908e71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:41.806265 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403d321-9d82-422e-94a1-1d7c5908e71c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:41.819631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b051c3-b7ae-4f47-8423-06faa7ab652d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:41.820746 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b051c3-b7ae-4f47-8423-06faa7ab652d service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:41.821247 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b051c3-b7ae-4f47-8423-06faa7ab652d service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:41.821647 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b051c3-b7ae-4f47-8423-06faa7ab652d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:41.838762 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b051c3-b7ae-4f47-8423-06faa7ab652d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:41.840621 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b051c3-b7ae-4f47-8423-06faa7ab652d service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:41.858396 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1332/2678] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:42.232411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b335f13-b9f9-4d17-bf3d-3e41fd84c6ca None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:42.234221 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6b335f13-b9f9-4d17-bf3d-3e41fd84c6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:42.251905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b335f13-b9f9-4d17-bf3d-3e41fd84c6ca None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:42.257628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae224a91-c013-4d34-a863-acc132e22a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:42.258860 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae224a91-c013-4d34-a863-acc132e22a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:42.259375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae224a91-c013-4d34-a863-acc132e22a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:42.259708 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae224a91-c013-4d34-a863-acc132e22a11 admin admin] PATH_INFO: `/v3/projects/8300616abec747dcbf33530908559923` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:42.267461 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae224a91-c013-4d34-a863-acc132e22a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8300616abec747dcbf33530908559923)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:42.269415 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae224a91-c013-4d34-a863-acc132e22a11 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:42.278697 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e7756-8f85-45c2-bc1f-93187cf9e32f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:42.279658 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e7756-8f85-45c2-bc1f-93187cf9e32f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:42.280101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e7756-8f85-45c2-bc1f-93187cf9e32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:42.303650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f70e7756-8f85-45c2-bc1f-93187cf9e32f None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:42.305388 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f70e7756-8f85-45c2-bc1f-93187cf9e32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:42.318312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1333/2679] 10.222.0.67 () {58 vars in 1016 bytes} [Thu May 26 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:42.331261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ae224a91-c013-4d34-a863-acc132e22a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8300616abec747dcbf33530908559923', 'request_id': 'req-ae224a91-c013-4d34-a863-acc132e22a11'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:42.337787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ae224a91-c013-4d34-a863-acc132e22a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8300616abec747dcbf33530908559923', 'request_id': 'req-ae224a91-c013-4d34-a863-acc132e22a11'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:42.342832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e7756-8f85-45c2-bc1f-93187cf9e32f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:42.344760 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ae224a91-c013-4d34-a863-acc132e22a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8300616abec747dcbf33530908559923', 'request_id': 'req-ae224a91-c013-4d34-a863-acc132e22a11'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:42.345578 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f70e7756-8f85-45c2-bc1f-93187cf9e32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:42.361029 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ae224a91-c013-4d34-a863-acc132e22a11 admin admin] The token cache is being invalidate because project 8300616abec747dcbf33530908559923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:14:42.361406 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ae224a91-c013-4d34-a863-acc132e22a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:42.362107 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ae224a91-c013-4d34-a863-acc132e22a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:42.363707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1347/2680] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:14:42 2022] DELETE /identity/v3/projects/8300616abec747dcbf33530908559923 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:42.368085 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae224a91-c013-4d34-a863-acc132e22a11 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:42.369688 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ae224a91-c013-4d34-a863-acc132e22a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:42.399915 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:42.445267 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e7756-8f85-45c2-bc1f-93187cf9e32f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:42.465752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae224a91-c013-4d34-a863-acc132e22a11 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:42.471072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36f94a-5f16-458f-9e66-cd59b794a05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:42.472361 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36f94a-5f16-458f-9e66-cd59b794a05e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:42.472770 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36f94a-5f16-458f-9e66-cd59b794a05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:42.473230 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36f94a-5f16-458f-9e66-cd59b794a05e admin admin] PATH_INFO: `/v3/users/4bf76d28920c4040a65d517304978b14` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:42.475280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36f94a-5f16-458f-9e66-cd59b794a05e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf76d28920c4040a65d517304978b14)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:42.478535 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36f94a-5f16-458f-9e66-cd59b794a05e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:42.534227 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d0427-058c-425d-914c-4dd3c63b37e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:42.535028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d0427-058c-425d-914c-4dd3c63b37e3 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:42.535317 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d0427-058c-425d-914c-4dd3c63b37e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:42.535598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d0427-058c-425d-914c-4dd3c63b37e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:42.537501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e08d0427-058c-425d-914c-4dd3c63b37e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:42.544871 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4d36f94a-5f16-458f-9e66-cd59b794a05e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf76d28920c4040a65d517304978b14'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:42.548190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:42.552283 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d0427-058c-425d-914c-4dd3c63b37e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:42.558338 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d0427-058c-425d-914c-4dd3c63b37e3 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:42.567616 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4d36f94a-5f16-458f-9e66-cd59b794a05e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf76d28920c4040a65d517304978b14'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:42.568499 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4d36f94a-5f16-458f-9e66-cd59b794a05e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf76d28920c4040a65d517304978b14'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:42.574650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1334/2681] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:14:42.583833 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4d36f94a-5f16-458f-9e66-cd59b794a05e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf76d28920c4040a65d517304978b14'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:42.593014 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4d36f94a-5f16-458f-9e66-cd59b794a05e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf76d28920c4040a65d517304978b14'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:42.600284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1348/2682] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:14:42 2022] DELETE /identity/v3/users/4bf76d28920c4040a65d517304978b14 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:42.943260 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d0427-058c-425d-914c-4dd3c63b37e3 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:42.964623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d0427-058c-425d-914c-4dd3c63b37e3 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:43.081276 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046a838-45e3-4a07-ab1f-a50f111fa4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:43.082231 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046a838-45e3-4a07-ab1f-a50f111fa4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:43.082516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046a838-45e3-4a07-ab1f-a50f111fa4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:43.082792 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046a838-45e3-4a07-ab1f-a50f111fa4c9 admin admin] PATH_INFO: `/v3/projects/40ff1ded287c4e8d91fe58dab1afddd1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:43.084046 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046a838-45e3-4a07-ab1f-a50f111fa4c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40ff1ded287c4e8d91fe58dab1afddd1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:43.086019 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046a838-45e3-4a07-ab1f-a50f111fa4c9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:43.170990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a046a838-45e3-4a07-ab1f-a50f111fa4c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40ff1ded287c4e8d91fe58dab1afddd1', 'request_id': 'req-a046a838-45e3-4a07-ab1f-a50f111fa4c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:43.187631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a046a838-45e3-4a07-ab1f-a50f111fa4c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40ff1ded287c4e8d91fe58dab1afddd1', 'request_id': 'req-a046a838-45e3-4a07-ab1f-a50f111fa4c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:43.198520 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a046a838-45e3-4a07-ab1f-a50f111fa4c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40ff1ded287c4e8d91fe58dab1afddd1', 'request_id': 'req-a046a838-45e3-4a07-ab1f-a50f111fa4c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:43.214717 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a046a838-45e3-4a07-ab1f-a50f111fa4c9 admin admin] The token cache is being invalidate because project 40ff1ded287c4e8d91fe58dab1afddd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:14:43.215319 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a046a838-45e3-4a07-ab1f-a50f111fa4c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:43.216069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a046a838-45e3-4a07-ab1f-a50f111fa4c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:43.218891 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1335/2683] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:14:42 2022] DELETE /identity/v3/projects/40ff1ded287c4e8d91fe58dab1afddd1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:43.225090 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dedeb-1740-49e2-bd54-11a521c1c0fa None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:43.225442 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dedeb-1740-49e2-bd54-11a521c1c0fa None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:43.225940 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dedeb-1740-49e2-bd54-11a521c1c0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:43.254404 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e42dedeb-1740-49e2-bd54-11a521c1c0fa None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:43.255628 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e42dedeb-1740-49e2-bd54-11a521c1c0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:43.334204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1349/2684] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:43.343949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a03bc-57f1-4310-8684-0f75e986ce2b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:43.344667 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a03bc-57f1-4310-8684-0f75e986ce2b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:43.344973 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a03bc-57f1-4310-8684-0f75e986ce2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:43.368316 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-773a03bc-57f1-4310-8684-0f75e986ce2b None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:43.370172 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-773a03bc-57f1-4310-8684-0f75e986ce2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:43.381478 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1336/2685] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:43.386778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42dedeb-1740-49e2-bd54-11a521c1c0fa None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:43.399734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42dedeb-1740-49e2-bd54-11a521c1c0fa None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:43.406469 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527463fb-416e-41ab-8ccb-ddbd5d359e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:43.407234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527463fb-416e-41ab-8ccb-ddbd5d359e51 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:43.407560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527463fb-416e-41ab-8ccb-ddbd5d359e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:43.407876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527463fb-416e-41ab-8ccb-ddbd5d359e51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:43.408669 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527463fb-416e-41ab-8ccb-ddbd5d359e51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:14:43.409018 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527463fb-416e-41ab-8ccb-ddbd5d359e51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:43.410993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527463fb-416e-41ab-8ccb-ddbd5d359e51 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:43.424289 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1350/2686] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:14:43.429220 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a03bc-57f1-4310-8684-0f75e986ce2b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:43.439497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a03bc-57f1-4310-8684-0f75e986ce2b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:43.444697 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d95af0-4544-4e20-bc1b-64037ddfc5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:43.445368 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d95af0-4544-4e20-bc1b-64037ddfc5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:43.445650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d95af0-4544-4e20-bc1b-64037ddfc5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:43.445967 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d95af0-4544-4e20-bc1b-64037ddfc5b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:43.446682 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d95af0-4544-4e20-bc1b-64037ddfc5b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:43.448644 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d95af0-4544-4e20-bc1b-64037ddfc5b6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:43.481083 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1337/2687] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:14:43 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:14:43.487188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527463fb-416e-41ab-8ccb-ddbd5d359e51 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:43.498265 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527463fb-416e-41ab-8ccb-ddbd5d359e51 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:43.525727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:43.579490 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3882a4-4491-4e26-b252-7b05e161dc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:43.580169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3882a4-4491-4e26-b252-7b05e161dc4c admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:43.580445 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3882a4-4491-4e26-b252-7b05e161dc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:43.580720 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3882a4-4491-4e26-b252-7b05e161dc4c admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:43.581423 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3882a4-4491-4e26-b252-7b05e161dc4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:43.583476 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3882a4-4491-4e26-b252-7b05e161dc4c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:43.610521 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1351/2688] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:14:43 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:14:43.615501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d95af0-4544-4e20-bc1b-64037ddfc5b6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:43.626860 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d95af0-4544-4e20-bc1b-64037ddfc5b6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:43.632804 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fd9c2-0f95-4079-ad6c-35b5aa0790be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:43.633497 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fd9c2-0f95-4079-ad6c-35b5aa0790be admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:43.633780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fd9c2-0f95-4079-ad6c-35b5aa0790be admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:43.634086 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fd9c2-0f95-4079-ad6c-35b5aa0790be admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:43.634833 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fd9c2-0f95-4079-ad6c-35b5aa0790be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:43.636469 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fd9c2-0f95-4079-ad6c-35b5aa0790be admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:43.648875 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1338/2689] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:14:43.653229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3882a4-4491-4e26-b252-7b05e161dc4c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:43.665085 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3882a4-4491-4e26-b252-7b05e161dc4c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:43.670993 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72674357-7d47-4706-b13e-b86077a907f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:43.671855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72674357-7d47-4706-b13e-b86077a907f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:43.672246 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72674357-7d47-4706-b13e-b86077a907f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:43.672639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72674357-7d47-4706-b13e-b86077a907f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:43.673779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72674357-7d47-4706-b13e-b86077a907f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:43.675623 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72674357-7d47-4706-b13e-b86077a907f9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:43.689155 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1352/2690] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:14:43.693584 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fd9c2-0f95-4079-ad6c-35b5aa0790be admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:43.705164 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fd9c2-0f95-4079-ad6c-35b5aa0790be admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:43.710208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aba95c-9e84-4996-b727-2fbd3113ce06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:43.711208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aba95c-9e84-4996-b727-2fbd3113ce06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:43.711527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aba95c-9e84-4996-b727-2fbd3113ce06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:43.711846 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aba95c-9e84-4996-b727-2fbd3113ce06 admin admin] PATH_INFO: `/v3/projects/786037af44a748f29af341bda5ab67e1/users/d1b25cfb850941eba6166daf4b2c7667/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:43.729608 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aba95c-9e84-4996-b727-2fbd3113ce06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=786037af44a748f29af341bda5ab67e1, user_id=d1b25cfb850941eba6166daf4b2c7667, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:43.732422 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aba95c-9e84-4996-b727-2fbd3113ce06 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:43.752393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1339/2691] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:14:43 2022] PUT /identity/v3/projects/786037af44a748f29af341bda5ab67e1/users/d1b25cfb850941eba6166daf4b2c7667/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:43.760004 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cd2e8-2dd7-4762-bed8-1a13f780f859 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:43.760486 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cd2e8-2dd7-4762-bed8-1a13f780f859 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:43.761217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cd2e8-2dd7-4762-bed8-1a13f780f859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:43.786539 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-154cd2e8-2dd7-4762-bed8-1a13f780f859 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:43.788043 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-154cd2e8-2dd7-4762-bed8-1a13f780f859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:43.866194 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1353/2692] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:43.879242 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aba95c-9e84-4996-b727-2fbd3113ce06 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:43.881780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-69aba95c-9e84-4996-b727-2fbd3113ce06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:43.920318 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:43.967187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aba95c-9e84-4996-b727-2fbd3113ce06 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:43.971250 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba53c3-6f9c-4776-9108-cd4c607694ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:43.971905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba53c3-6f9c-4776-9108-cd4c607694ae service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:43.972195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba53c3-6f9c-4776-9108-cd4c607694ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:43.972461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba53c3-6f9c-4776-9108-cd4c607694ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:43.986516 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba53c3-6f9c-4776-9108-cd4c607694ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:43.992924 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba53c3-6f9c-4776-9108-cd4c607694ae service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:44.004121 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1340/2693] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:44.401335 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cd2e8-2dd7-4762-bed8-1a13f780f859 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:44.423899 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cd2e8-2dd7-4762-bed8-1a13f780f859 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:44.431217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a7ce2-3399-4979-b2b3-223f4428b16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:44.433240 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a7ce2-3399-4979-b2b3-223f4428b16e service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:44.434032 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a7ce2-3399-4979-b2b3-223f4428b16e service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:44.435146 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a7ce2-3399-4979-b2b3-223f4428b16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:44.439049 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ab4a7ce2-3399-4979-b2b3-223f4428b16e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:44.464995 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a7ce2-3399-4979-b2b3-223f4428b16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:44.468459 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a7ce2-3399-4979-b2b3-223f4428b16e service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:44.490574 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1354/2694] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:44.832590 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dace16-6b43-4fbe-8df0-ac2e8a13b8a4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:44.833480 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dace16-6b43-4fbe-8df0-ac2e8a13b8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:44.833480 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dace16-6b43-4fbe-8df0-ac2e8a13b8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:44.867812 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e7dace16-6b43-4fbe-8df0-ac2e8a13b8a4 None None] MFA Rules not processed for user `d1b25cfb850941eba6166daf4b2c7667`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:44.869293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e7dace16-6b43-4fbe-8df0-ac2e8a13b8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:44.974403 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1341/2695] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:44.980773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a7ce2-3399-4979-b2b3-223f4428b16e service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:45.001410 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a7ce2-3399-4979-b2b3-223f4428b16e service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:45.011191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577e78e-0ca9-4aad-b21d-f2fd2cb347da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:45.014352 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577e78e-0ca9-4aad-b21d-f2fd2cb347da admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:45.015138 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577e78e-0ca9-4aad-b21d-f2fd2cb347da admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:45.015905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577e78e-0ca9-4aad-b21d-f2fd2cb347da admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:45.017488 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577e78e-0ca9-4aad-b21d-f2fd2cb347da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:45.021369 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577e78e-0ca9-4aad-b21d-f2fd2cb347da admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:45.075873 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1355/2696] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:14:44 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:14:45.080731 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dace16-6b43-4fbe-8df0-ac2e8a13b8a4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:45.100187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dace16-6b43-4fbe-8df0-ac2e8a13b8a4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:45.191930 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1a61c-2b7d-4fba-9553-574923526754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:45.192712 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a61c-2b7d-4fba-9553-574923526754 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:45.193049 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a61c-2b7d-4fba-9553-574923526754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:45.193379 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a61c-2b7d-4fba-9553-574923526754 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:45.194348 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1a61c-2b7d-4fba-9553-574923526754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:45.196486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1a61c-2b7d-4fba-9553-574923526754 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:45.229873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1342/2697] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:14:45 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:14:45.234439 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577e78e-0ca9-4aad-b21d-f2fd2cb347da admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:45.250253 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577e78e-0ca9-4aad-b21d-f2fd2cb347da admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:45.260351 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe3221-a3b7-43ba-b66a-825b7fc91e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:45.261166 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe3221-a3b7-43ba-b66a-825b7fc91e74 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:45.261533 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe3221-a3b7-43ba-b66a-825b7fc91e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:45.261933 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe3221-a3b7-43ba-b66a-825b7fc91e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:45.262752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe3221-a3b7-43ba-b66a-825b7fc91e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:45.264973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe3221-a3b7-43ba-b66a-825b7fc91e74 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:45.281136 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1356/2698] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:14:45.286123 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1a61c-2b7d-4fba-9553-574923526754 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:45.300990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1a61c-2b7d-4fba-9553-574923526754 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:45.306459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85860c1-25c3-4ea9-9bab-d0554ca432bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:45.307802 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85860c1-25c3-4ea9-9bab-d0554ca432bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:45.308173 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85860c1-25c3-4ea9-9bab-d0554ca432bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:45.308527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85860c1-25c3-4ea9-9bab-d0554ca432bf admin admin] PATH_INFO: `/v3/projects/884e110127d2437fbf32db11d4c9c56a/users/d14c409addb84525bb7547bfc29f61cf/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:45.338963 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85860c1-25c3-4ea9-9bab-d0554ca432bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=884e110127d2437fbf32db11d4c9c56a, user_id=d14c409addb84525bb7547bfc29f61cf, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:45.343022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85860c1-25c3-4ea9-9bab-d0554ca432bf admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:45.370587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1343/2699] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:14:45 2022] PUT /identity/v3/projects/884e110127d2437fbf32db11d4c9c56a/users/d14c409addb84525bb7547bfc29f61cf/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:45.378194 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe3221-a3b7-43ba-b66a-825b7fc91e74 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:45.390805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe3221-a3b7-43ba-b66a-825b7fc91e74 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:45.482200 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc782a1c-d25a-4d11-8200-488ef3420057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:45.482921 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc782a1c-d25a-4d11-8200-488ef3420057 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:45.483261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc782a1c-d25a-4d11-8200-488ef3420057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:45.483599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc782a1c-d25a-4d11-8200-488ef3420057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:45.484566 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc782a1c-d25a-4d11-8200-488ef3420057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:45.486935 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc782a1c-d25a-4d11-8200-488ef3420057 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:45.489684 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:45.509947 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1357/2700] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:14:45.511676 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85860c1-25c3-4ea9-9bab-d0554ca432bf admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:45.525942 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85860c1-25c3-4ea9-9bab-d0554ca432bf admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:45.532396 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1291fa-050a-43e3-acd9-5304b75407b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:45.533449 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1291fa-050a-43e3-acd9-5304b75407b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:45.533945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1291fa-050a-43e3-acd9-5304b75407b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:45.534359 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1291fa-050a-43e3-acd9-5304b75407b5 admin admin] PATH_INFO: `/v3/projects/884e110127d2437fbf32db11d4c9c56a/users/d14c409addb84525bb7547bfc29f61cf/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:45.536820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1291fa-050a-43e3-acd9-5304b75407b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884e110127d2437fbf32db11d4c9c56a, user_id=d14c409addb84525bb7547bfc29f61cf, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:45.540094 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1291fa-050a-43e3-acd9-5304b75407b5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:45.559945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1344/2701] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:14:45 2022] PUT /identity/v3/projects/884e110127d2437fbf32db11d4c9c56a/users/d14c409addb84525bb7547bfc29f61cf/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:46.546970 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33a0c-6640-4409-a7e4-64f99ec18304 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:46.548426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33a0c-6640-4409-a7e4-64f99ec18304 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:46.549171 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33a0c-6640-4409-a7e4-64f99ec18304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:46.612072 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-5da33a0c-6640-4409-a7e4-64f99ec18304 None None] MFA Rules not processed for user `d14c409addb84525bb7547bfc29f61cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:46.612948 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5da33a0c-6640-4409-a7e4-64f99ec18304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:46.796662 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1358/2702] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:46.810299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32173ab5-ec69-4e48-8c36-0258429fc7b5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:46.810798 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32173ab5-ec69-4e48-8c36-0258429fc7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:46.811354 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32173ab5-ec69-4e48-8c36-0258429fc7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:46.837789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:46.847761 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-32173ab5-ec69-4e48-8c36-0258429fc7b5 None None] MFA Rules not processed for user `d1b25cfb850941eba6166daf4b2c7667`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:46.856047 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-32173ab5-ec69-4e48-8c36-0258429fc7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:46.945715 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1345/2703] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:46.964803 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da33a0c-6640-4409-a7e4-64f99ec18304 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:46.968744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5da33a0c-6640-4409-a7e4-64f99ec18304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:47.133012 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da33a0c-6640-4409-a7e4-64f99ec18304 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:47.144034 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc923eeb-5b86-492b-b1a2-1456be8ff8a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:47.144823 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc923eeb-5b86-492b-b1a2-1456be8ff8a7 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:47.145323 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc923eeb-5b86-492b-b1a2-1456be8ff8a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:47.145915 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc923eeb-5b86-492b-b1a2-1456be8ff8a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:47.161699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc923eeb-5b86-492b-b1a2-1456be8ff8a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:47.165173 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc923eeb-5b86-492b-b1a2-1456be8ff8a7 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:47.183300 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1359/2704] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:49.473489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32173ab5-ec69-4e48-8c36-0258429fc7b5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:49.475687 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-32173ab5-ec69-4e48-8c36-0258429fc7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:49.605535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32173ab5-ec69-4e48-8c36-0258429fc7b5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:49.605535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651de4c-9040-4848-bdce-17b0fa79ccb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:49.605535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651de4c-9040-4848-bdce-17b0fa79ccb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:49.605535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651de4c-9040-4848-bdce-17b0fa79ccb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:49.606205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651de4c-9040-4848-bdce-17b0fa79ccb9 admin admin] PATH_INFO: `/v3/users/5cec6311f0fb4d908877ebdb7236ef21` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:49.606205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651de4c-9040-4848-bdce-17b0fa79ccb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cec6311f0fb4d908877ebdb7236ef21)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:49.606498 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651de4c-9040-4848-bdce-17b0fa79ccb9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:49.671585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a651de4c-9040-4848-bdce-17b0fa79ccb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cec6311f0fb4d908877ebdb7236ef21'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:49.672410 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a651de4c-9040-4848-bdce-17b0fa79ccb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cec6311f0fb4d908877ebdb7236ef21'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:49.688602 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a651de4c-9040-4848-bdce-17b0fa79ccb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cec6311f0fb4d908877ebdb7236ef21'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:49.717442 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a651de4c-9040-4848-bdce-17b0fa79ccb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cec6311f0fb4d908877ebdb7236ef21'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:49.729949 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a651de4c-9040-4848-bdce-17b0fa79ccb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cec6311f0fb4d908877ebdb7236ef21'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:49.746561 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1346/2705] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:14:49 2022] DELETE /identity/v3/users/5cec6311f0fb4d908877ebdb7236ef21 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:14:49.995945 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc923eeb-5b86-492b-b1a2-1456be8ff8a7 service nova] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:50.027469 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc923eeb-5b86-492b-b1a2-1456be8ff8a7 service nova] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:50.120879 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee67e6a-b4c6-43a2-825b-25dee8c1d598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:50.122406 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee67e6a-b4c6-43a2-825b-25dee8c1d598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:50.123356 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee67e6a-b4c6-43a2-825b-25dee8c1d598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:50.123764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee67e6a-b4c6-43a2-825b-25dee8c1d598 admin admin] PATH_INFO: `/v3/projects/ae4a43af89f642c5a2b0985fdbf8305b` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:50.125668 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee67e6a-b4c6-43a2-825b-25dee8c1d598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4a43af89f642c5a2b0985fdbf8305b)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:50.128276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee67e6a-b4c6-43a2-825b-25dee8c1d598 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:50.137008 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:50.209991 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4ee67e6a-b4c6-43a2-825b-25dee8c1d598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4a43af89f642c5a2b0985fdbf8305b', 'request_id': 'req-4ee67e6a-b4c6-43a2-825b-25dee8c1d598'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:50.218145 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4ee67e6a-b4c6-43a2-825b-25dee8c1d598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4a43af89f642c5a2b0985fdbf8305b', 'request_id': 'req-4ee67e6a-b4c6-43a2-825b-25dee8c1d598'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:50.226214 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4ee67e6a-b4c6-43a2-825b-25dee8c1d598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4a43af89f642c5a2b0985fdbf8305b', 'request_id': 'req-4ee67e6a-b4c6-43a2-825b-25dee8c1d598'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:50.245542 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4ee67e6a-b4c6-43a2-825b-25dee8c1d598 admin admin] The token cache is being invalidate because project ae4a43af89f642c5a2b0985fdbf8305b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:14:50.246117 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4ee67e6a-b4c6-43a2-825b-25dee8c1d598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:50.247233 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4ee67e6a-b4c6-43a2-825b-25dee8c1d598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:14:50.255154 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1360/2706] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:14:49 2022] DELETE /identity/v3/projects/ae4a43af89f642c5a2b0985fdbf8305b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:14:50.257819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e89dc-99d8-4198-a353-45301a80756e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:50.258212 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e89dc-99d8-4198-a353-45301a80756e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:50.258551 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e89dc-99d8-4198-a353-45301a80756e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:50.284436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4e6e89dc-99d8-4198-a353-45301a80756e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:50.286766 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4e6e89dc-99d8-4198-a353-45301a80756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:50.337636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:50.399455 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1347/2707] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:50.408934 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a881b08-fc89-4be3-8f74-af7d33a1ec98 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:50.409553 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a881b08-fc89-4be3-8f74-af7d33a1ec98 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:50.410228 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a881b08-fc89-4be3-8f74-af7d33a1ec98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:50.437870 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0a881b08-fc89-4be3-8f74-af7d33a1ec98 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:50.440189 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0a881b08-fc89-4be3-8f74-af7d33a1ec98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:50.454408 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1361/2708] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:14:50.463208 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e89dc-99d8-4198-a353-45301a80756e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:50.474739 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e89dc-99d8-4198-a353-45301a80756e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:50.482776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd1546-9c25-49d8-8862-fef118583163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:50.483691 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd1546-9c25-49d8-8862-fef118583163 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:50.484076 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd1546-9c25-49d8-8862-fef118583163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:50.484443 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd1546-9c25-49d8-8862-fef118583163 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:50.485609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd1546-9c25-49d8-8862-fef118583163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:14:50.486280 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd1546-9c25-49d8-8862-fef118583163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:50.488621 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd1546-9c25-49d8-8862-fef118583163 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:50.502957 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1348/2709] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:14:50.508079 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a881b08-fc89-4be3-8f74-af7d33a1ec98 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:50.520680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a881b08-fc89-4be3-8f74-af7d33a1ec98 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:50.528213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea11250-ab0c-48d0-a8d7-b002ee07671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:50.529508 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea11250-ab0c-48d0-a8d7-b002ee07671a admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:50.529780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea11250-ab0c-48d0-a8d7-b002ee07671a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:50.530114 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea11250-ab0c-48d0-a8d7-b002ee07671a admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:50.530795 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea11250-ab0c-48d0-a8d7-b002ee07671a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:50.532784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea11250-ab0c-48d0-a8d7-b002ee07671a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:50.569548 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1362/2710] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:14:50 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:14:50.575211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd1546-9c25-49d8-8862-fef118583163 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:50.589008 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd1546-9c25-49d8-8862-fef118583163 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:50.716627 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2a8e7-00e3-4817-a932-d4463eba011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:50.717776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2a8e7-00e3-4817-a932-d4463eba011a admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:50.718281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2a8e7-00e3-4817-a932-d4463eba011a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:50.718861 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2a8e7-00e3-4817-a932-d4463eba011a admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:50.720704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2a8e7-00e3-4817-a932-d4463eba011a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:50.731140 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2a8e7-00e3-4817-a932-d4463eba011a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:50.793366 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1349/2711] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:14:50 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:14:50.796375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea11250-ab0c-48d0-a8d7-b002ee07671a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:50.805602 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17350be-3336-4158-9831-f68a78377f55 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:50.806320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17350be-3336-4158-9831-f68a78377f55 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:50.806856 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17350be-3336-4158-9831-f68a78377f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:50.826114 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea11250-ab0c-48d0-a8d7-b002ee07671a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:50.834349 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05386e9-f924-4530-beba-0f4bf6d9400b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:50.835797 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05386e9-f924-4530-beba-0f4bf6d9400b admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:50.836479 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05386e9-f924-4530-beba-0f4bf6d9400b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:50.837288 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05386e9-f924-4530-beba-0f4bf6d9400b admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:50.838765 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05386e9-f924-4530-beba-0f4bf6d9400b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:50.842685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05386e9-f924-4530-beba-0f4bf6d9400b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:50.843936 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f17350be-3336-4158-9831-f68a78377f55 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:50.846844 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f17350be-3336-4158-9831-f68a78377f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:50.860322 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1350/2712] 10.222.0.67 () {58 vars in 1016 bytes} [Thu May 26 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:50.876147 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1363/2713] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:14:50.882649 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17350be-3336-4158-9831-f68a78377f55 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:50.890267 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05386e9-f924-4530-beba-0f4bf6d9400b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:50.894868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17350be-3336-4158-9831-f68a78377f55 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:50.898142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a05386e9-f924-4530-beba-0f4bf6d9400b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:50.908894 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567f63c-18c0-440a-9dce-bae139872c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:50.910325 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567f63c-18c0-440a-9dce-bae139872c82 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:50.910601 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567f63c-18c0-440a-9dce-bae139872c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:50.910882 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567f63c-18c0-440a-9dce-bae139872c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:50.911828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567f63c-18c0-440a-9dce-bae139872c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:50.913515 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567f63c-18c0-440a-9dce-bae139872c82 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:50.927797 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1351/2714] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:14:50.933302 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567f63c-18c0-440a-9dce-bae139872c82 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:50.951708 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567f63c-18c0-440a-9dce-bae139872c82 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:50.959283 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08af60b-361f-48aa-b9c7-fdc7e978eee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:50.962110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08af60b-361f-48aa-b9c7-fdc7e978eee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:50.962761 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08af60b-361f-48aa-b9c7-fdc7e978eee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:50.963219 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08af60b-361f-48aa-b9c7-fdc7e978eee0 admin admin] PATH_INFO: `/v3/projects/8e1404d0985a4a9596153664c3c0fa8e/users/fa4fe3e86944454d8cf6793fd857907f/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:50.987743 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08af60b-361f-48aa-b9c7-fdc7e978eee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1404d0985a4a9596153664c3c0fa8e, user_id=fa4fe3e86944454d8cf6793fd857907f, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:50.992886 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08af60b-361f-48aa-b9c7-fdc7e978eee0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:51.023368 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1352/2715] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:14:50 2022] PUT /identity/v3/projects/8e1404d0985a4a9596153664c3c0fa8e/users/fa4fe3e86944454d8cf6793fd857907f/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:14:51.031150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a4d15-b180-4a18-9c24-6326006caca3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:51.031594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a4d15-b180-4a18-9c24-6326006caca3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:51.032530 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a4d15-b180-4a18-9c24-6326006caca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:51.036175 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05386e9-f924-4530-beba-0f4bf6d9400b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:51.064920 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ce4a4d15-b180-4a18-9c24-6326006caca3 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:51.067728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ce4a4d15-b180-4a18-9c24-6326006caca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:51.105483 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:51.137673 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75389d0e-0845-4716-b727-c007c5de6ca7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:51.139178 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75389d0e-0845-4716-b727-c007c5de6ca7 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:51.139820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75389d0e-0845-4716-b727-c007c5de6ca7 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:51.140399 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75389d0e-0845-4716-b727-c007c5de6ca7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:51.176203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1353/2716] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:14:51.186430 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a4d15-b180-4a18-9c24-6326006caca3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:51.189716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ce4a4d15-b180-4a18-9c24-6326006caca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:51.208503 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:51.256715 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75389d0e-0845-4716-b727-c007c5de6ca7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:51.258410 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75389d0e-0845-4716-b727-c007c5de6ca7 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:51.274872 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1364/2717] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:51.282983 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a4d15-b180-4a18-9c24-6326006caca3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:51.288413 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c34030-fd5a-4bb5-a9bb-d24f4adf4ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:51.289465 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c34030-fd5a-4bb5-a9bb-d24f4adf4ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:51.289945 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c34030-fd5a-4bb5-a9bb-d24f4adf4ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:51.290544 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c34030-fd5a-4bb5-a9bb-d24f4adf4ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:51.305269 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c34030-fd5a-4bb5-a9bb-d24f4adf4ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:51.307485 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c34030-fd5a-4bb5-a9bb-d24f4adf4ba4 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:51.322144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1354/2718] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:14:57.993599 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a95707-8369-435a-a1f8-bb73313cef32 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:57.994611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a95707-8369-435a-a1f8-bb73313cef32 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:57.994837 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a95707-8369-435a-a1f8-bb73313cef32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:58.042885 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-65a95707-8369-435a-a1f8-bb73313cef32 None None] MFA Rules not processed for user `fa4fe3e86944454d8cf6793fd857907f`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:14:58.044700 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-65a95707-8369-435a-a1f8-bb73313cef32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:58.125963 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1365/2719] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:14:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:14:58.147533 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c34030-fd5a-4bb5-a9bb-d24f4adf4ba4 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:58.149130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-22c34030-fd5a-4bb5-a9bb-d24f4adf4ba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:58.167432 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c34030-fd5a-4bb5-a9bb-d24f4adf4ba4 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:58.173090 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f71e2c-fe53-4a43-9f1d-2c2d24ab56ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:58.173776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f71e2c-fe53-4a43-9f1d-2c2d24ab56ff service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:58.174109 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f71e2c-fe53-4a43-9f1d-2c2d24ab56ff service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:58.174385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f71e2c-fe53-4a43-9f1d-2c2d24ab56ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:58.184344 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f71e2c-fe53-4a43-9f1d-2c2d24ab56ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:58.186364 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f71e2c-fe53-4a43-9f1d-2c2d24ab56ff service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:58.198027 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1355/2720] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:14:58.396886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a95707-8369-435a-a1f8-bb73313cef32 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:14:58.413498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a95707-8369-435a-a1f8-bb73313cef32 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:14:58.423412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795f1a5-abf0-4216-b197-232831012096 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:14:58.424196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795f1a5-abf0-4216-b197-232831012096 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:14:58.424520 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795f1a5-abf0-4216-b197-232831012096 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:14:58.424789 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795f1a5-abf0-4216-b197-232831012096 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:14:58.427335 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5795f1a5-abf0-4216-b197-232831012096 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:14:58.443071 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795f1a5-abf0-4216-b197-232831012096 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:14:58.444732 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795f1a5-abf0-4216-b197-232831012096 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:14:58.459323 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1366/2721] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:14:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:15:00.516152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecc58c-6951-4cc8-ad6c-1be6651f25ce None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:00.516675 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecc58c-6951-4cc8-ad6c-1be6651f25ce None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:00.516948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecc58c-6951-4cc8-ad6c-1be6651f25ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:00.539879 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-07ecc58c-6951-4cc8-ad6c-1be6651f25ce None None] MFA Rules not processed for user `fa4fe3e86944454d8cf6793fd857907f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:00.541473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-07ecc58c-6951-4cc8-ad6c-1be6651f25ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:00.550115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1356/2722] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:15:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:01.731683 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795f1a5-abf0-4216-b197-232831012096 service nova] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:01.800059 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795f1a5-abf0-4216-b197-232831012096 service nova] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:01.816098 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f93de7-dca7-4867-a6cb-d63aba619582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:01.817376 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f93de7-dca7-4867-a6cb-d63aba619582 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:01.817948 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f93de7-dca7-4867-a6cb-d63aba619582 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:01.818370 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f93de7-dca7-4867-a6cb-d63aba619582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:01.820526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f6f93de7-dca7-4867-a6cb-d63aba619582 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:01.853577 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f93de7-dca7-4867-a6cb-d63aba619582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:01.855955 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f93de7-dca7-4867-a6cb-d63aba619582 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:01.871845 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1367/2723] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:15:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:15:03.916746 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecc58c-6951-4cc8-ad6c-1be6651f25ce None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:03.918274 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-07ecc58c-6951-4cc8-ad6c-1be6651f25ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:04.008830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecc58c-6951-4cc8-ad6c-1be6651f25ce None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:04.016153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2affb8-e1a1-4168-9e01-5805eef97ae2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:04.016694 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2affb8-e1a1-4168-9e01-5805eef97ae2 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:04.017187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2affb8-e1a1-4168-9e01-5805eef97ae2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:04.017607 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2affb8-e1a1-4168-9e01-5805eef97ae2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:04.020691 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3f2affb8-e1a1-4168-9e01-5805eef97ae2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:04.116694 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2affb8-e1a1-4168-9e01-5805eef97ae2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:04.118246 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2affb8-e1a1-4168-9e01-5805eef97ae2 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:04.132450 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1357/2724] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:15:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:15:07.853867 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b77dc2-9d06-455d-837f-a5c4907f1c43 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:07.854814 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b77dc2-9d06-455d-837f-a5c4907f1c43 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:07.854814 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b77dc2-9d06-455d-837f-a5c4907f1c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:07.877768 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-56b77dc2-9d06-455d-837f-a5c4907f1c43 None None] MFA Rules not processed for user `a2bb05cbe5cc4cb4a5bf0f527904bd0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:07.879102 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-56b77dc2-9d06-455d-837f-a5c4907f1c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:07.971671 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:15:07.993003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1368/2725] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:15:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:15:14.128959 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=82 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:15:17.980919 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:15:21.812881 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffdfb3-45d1-4104-98d0-2cddb1a59d1e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:21.813474 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffdfb3-45d1-4104-98d0-2cddb1a59d1e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:21.813474 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffdfb3-45d1-4104-98d0-2cddb1a59d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:21.838178 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-96ffdfb3-45d1-4104-98d0-2cddb1a59d1e None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:21.839692 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-96ffdfb3-45d1-4104-98d0-2cddb1a59d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:21.854373 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1358/2726] 10.222.0.67 () {58 vars in 1016 bytes} [Thu May 26 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:21.876610 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b77dc2-9d06-455d-837f-a5c4907f1c43 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:21.890726 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b77dc2-9d06-455d-837f-a5c4907f1c43 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:21.897784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576117d2-3741-43f1-840e-b4452606a998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:21.898545 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576117d2-3741-43f1-840e-b4452606a998 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:21.898856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576117d2-3741-43f1-840e-b4452606a998 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:21.899202 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576117d2-3741-43f1-840e-b4452606a998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:21.917115 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576117d2-3741-43f1-840e-b4452606a998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:21.917115 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576117d2-3741-43f1-840e-b4452606a998 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:21.926393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1369/2727] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:15:25.143597 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca19b2-a983-408e-8d50-fa152ee226d4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:25.144320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca19b2-a983-408e-8d50-fa152ee226d4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:25.144320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca19b2-a983-408e-8d50-fa152ee226d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:25.164487 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2bca19b2-a983-408e-8d50-fa152ee226d4 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:25.165867 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2bca19b2-a983-408e-8d50-fa152ee226d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:25.177541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1359/2728] 10.222.0.67 () {58 vars in 1016 bytes} [Thu May 26 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:25.198499 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576117d2-3741-43f1-840e-b4452606a998 service nova] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:25.210911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576117d2-3741-43f1-840e-b4452606a998 service nova] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:25.221233 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63e2e2-ebac-4203-9803-e32035c06ff4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:25.222078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63e2e2-ebac-4203-9803-e32035c06ff4 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:25.222458 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63e2e2-ebac-4203-9803-e32035c06ff4 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:25.222806 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63e2e2-ebac-4203-9803-e32035c06ff4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:25.233978 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63e2e2-ebac-4203-9803-e32035c06ff4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:25.235724 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63e2e2-ebac-4203-9803-e32035c06ff4 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:25.246903 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1370/2729] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:15:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:15:25.567989 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca19b2-a983-408e-8d50-fa152ee226d4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:25.569696 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2bca19b2-a983-408e-8d50-fa152ee226d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:25.590663 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca19b2-a983-408e-8d50-fa152ee226d4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:25.596642 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62f752-e571-4fd7-a271-53a5b331f159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:25.597558 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62f752-e571-4fd7-a271-53a5b331f159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:25.597876 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62f752-e571-4fd7-a271-53a5b331f159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:25.598161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62f752-e571-4fd7-a271-53a5b331f159 admin admin] PATH_INFO: `/v3/users/d1b25cfb850941eba6166daf4b2c7667` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:25.599492 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62f752-e571-4fd7-a271-53a5b331f159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1b25cfb850941eba6166daf4b2c7667)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:25.601452 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62f752-e571-4fd7-a271-53a5b331f159 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:25.660445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fe62f752-e571-4fd7-a271-53a5b331f159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1b25cfb850941eba6166daf4b2c7667'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:25.661128 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fe62f752-e571-4fd7-a271-53a5b331f159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1b25cfb850941eba6166daf4b2c7667'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:25.669132 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fe62f752-e571-4fd7-a271-53a5b331f159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1b25cfb850941eba6166daf4b2c7667'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:25.683955 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fe62f752-e571-4fd7-a271-53a5b331f159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1b25cfb850941eba6166daf4b2c7667'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:25.695904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fe62f752-e571-4fd7-a271-53a5b331f159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1b25cfb850941eba6166daf4b2c7667'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:25.706991 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1360/2730] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:15:25 2022] DELETE /identity/v3/users/d1b25cfb850941eba6166daf4b2c7667 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:15:25.916243 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63e2e2-ebac-4203-9803-e32035c06ff4 service nova] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:25.927938 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63e2e2-ebac-4203-9803-e32035c06ff4 service nova] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:26.006411 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5c2ba-be13-48bd-9c09-0100233419bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:26.007856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5c2ba-be13-48bd-9c09-0100233419bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:26.008319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5c2ba-be13-48bd-9c09-0100233419bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:26.008788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5c2ba-be13-48bd-9c09-0100233419bc admin admin] PATH_INFO: `/v3/projects/786037af44a748f29af341bda5ab67e1` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:26.010865 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5c2ba-be13-48bd-9c09-0100233419bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=786037af44a748f29af341bda5ab67e1)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:26.014801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5c2ba-be13-48bd-9c09-0100233419bc admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:26.086989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2ad5c2ba-be13-48bd-9c09-0100233419bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786037af44a748f29af341bda5ab67e1', 'request_id': 'req-2ad5c2ba-be13-48bd-9c09-0100233419bc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:26.093129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2ad5c2ba-be13-48bd-9c09-0100233419bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786037af44a748f29af341bda5ab67e1', 'request_id': 'req-2ad5c2ba-be13-48bd-9c09-0100233419bc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:26.099941 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2ad5c2ba-be13-48bd-9c09-0100233419bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786037af44a748f29af341bda5ab67e1', 'request_id': 'req-2ad5c2ba-be13-48bd-9c09-0100233419bc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:26.115205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2ad5c2ba-be13-48bd-9c09-0100233419bc admin admin] The token cache is being invalidate because project 786037af44a748f29af341bda5ab67e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:15:26.115522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2ad5c2ba-be13-48bd-9c09-0100233419bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:26.116363 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2ad5c2ba-be13-48bd-9c09-0100233419bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:26.118045 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1371/2731] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:15:25 2022] DELETE /identity/v3/projects/786037af44a748f29af341bda5ab67e1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:15:26.122753 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62f752-e571-4fd7-a271-53a5b331f159 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:26.124489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fe62f752-e571-4fd7-a271-53a5b331f159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:26.140867 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62f752-e571-4fd7-a271-53a5b331f159 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:26.228276 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435318b-39ff-4c6c-a5d7-fa0ce2e8acae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:26.229399 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435318b-39ff-4c6c-a5d7-fa0ce2e8acae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:26.230067 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435318b-39ff-4c6c-a5d7-fa0ce2e8acae admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:26.230431 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435318b-39ff-4c6c-a5d7-fa0ce2e8acae admin admin] PATH_INFO: `/v3/users/d14c409addb84525bb7547bfc29f61cf` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:26.231935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435318b-39ff-4c6c-a5d7-fa0ce2e8acae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14c409addb84525bb7547bfc29f61cf)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:26.234029 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435318b-39ff-4c6c-a5d7-fa0ce2e8acae admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:26.301388 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b435318b-39ff-4c6c-a5d7-fa0ce2e8acae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14c409addb84525bb7547bfc29f61cf'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:26.301989 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b435318b-39ff-4c6c-a5d7-fa0ce2e8acae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14c409addb84525bb7547bfc29f61cf'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:26.312621 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b435318b-39ff-4c6c-a5d7-fa0ce2e8acae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14c409addb84525bb7547bfc29f61cf'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:26.320902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:15:26.331771 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b435318b-39ff-4c6c-a5d7-fa0ce2e8acae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14c409addb84525bb7547bfc29f61cf'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:26.340936 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b435318b-39ff-4c6c-a5d7-fa0ce2e8acae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14c409addb84525bb7547bfc29f61cf'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:26.348749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1361/2732] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:15:26 2022] DELETE /identity/v3/users/d14c409addb84525bb7547bfc29f61cf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:15:26.557211 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5c2ba-be13-48bd-9c09-0100233419bc admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:26.559098 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2ad5c2ba-be13-48bd-9c09-0100233419bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:26.581525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5c2ba-be13-48bd-9c09-0100233419bc admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:26.664584 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822ee72-6fc4-4548-85cb-81420e972121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:26.665906 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822ee72-6fc4-4548-85cb-81420e972121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:26.666397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822ee72-6fc4-4548-85cb-81420e972121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:26.666749 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822ee72-6fc4-4548-85cb-81420e972121 admin admin] PATH_INFO: `/v3/projects/884e110127d2437fbf32db11d4c9c56a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:26.668234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822ee72-6fc4-4548-85cb-81420e972121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=884e110127d2437fbf32db11d4c9c56a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:26.670310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822ee72-6fc4-4548-85cb-81420e972121 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:26.678777 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:15:26.741191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9822ee72-6fc4-4548-85cb-81420e972121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884e110127d2437fbf32db11d4c9c56a', 'request_id': 'req-9822ee72-6fc4-4548-85cb-81420e972121'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:26.750697 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9822ee72-6fc4-4548-85cb-81420e972121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884e110127d2437fbf32db11d4c9c56a', 'request_id': 'req-9822ee72-6fc4-4548-85cb-81420e972121'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:26.758972 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9822ee72-6fc4-4548-85cb-81420e972121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884e110127d2437fbf32db11d4c9c56a', 'request_id': 'req-9822ee72-6fc4-4548-85cb-81420e972121'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:26.776344 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9822ee72-6fc4-4548-85cb-81420e972121 admin admin] The token cache is being invalidate because project 884e110127d2437fbf32db11d4c9c56a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:15:26.776627 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9822ee72-6fc4-4548-85cb-81420e972121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:26.777313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9822ee72-6fc4-4548-85cb-81420e972121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:15:26.779577 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1372/2733] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:15:26 2022] DELETE /identity/v3/projects/884e110127d2437fbf32db11d4c9c56a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:15:26.784962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880be73-abd4-48d3-95b7-ee6c3f9929f4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:26.785251 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880be73-abd4-48d3-95b7-ee6c3f9929f4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:26.785583 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880be73-abd4-48d3-95b7-ee6c3f9929f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:26.807847 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1880be73-abd4-48d3-95b7-ee6c3f9929f4 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:26.809332 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1880be73-abd4-48d3-95b7-ee6c3f9929f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:26.887567 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1362/2734] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:15:26.899979 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69074f-2d50-4fbe-85b5-1ebf0ed1ec9d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:26.900283 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69074f-2d50-4fbe-85b5-1ebf0ed1ec9d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:26.900661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69074f-2d50-4fbe-85b5-1ebf0ed1ec9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:26.923166 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-7f69074f-2d50-4fbe-85b5-1ebf0ed1ec9d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:26.924505 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7f69074f-2d50-4fbe-85b5-1ebf0ed1ec9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:26.934827 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1373/2735] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:26.939769 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880be73-abd4-48d3-95b7-ee6c3f9929f4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:26.952873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880be73-abd4-48d3-95b7-ee6c3f9929f4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:26.958939 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267eb2f-6445-4ace-978e-a492ecc92b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:26.959813 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267eb2f-6445-4ace-978e-a492ecc92b85 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:26.960295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267eb2f-6445-4ace-978e-a492ecc92b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:26.960713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267eb2f-6445-4ace-978e-a492ecc92b85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:26.961961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267eb2f-6445-4ace-978e-a492ecc92b85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:15:26.962371 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267eb2f-6445-4ace-978e-a492ecc92b85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:26.964927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267eb2f-6445-4ace-978e-a492ecc92b85 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:26.983124 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1363/2736] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:15:26.984981 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69074f-2d50-4fbe-85b5-1ebf0ed1ec9d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:26.995675 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69074f-2d50-4fbe-85b5-1ebf0ed1ec9d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:27.000965 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f467a-5845-42f4-a460-a25eeedceaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:27.001847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f467a-5845-42f4-a460-a25eeedceaeb admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:27.002135 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f467a-5845-42f4-a460-a25eeedceaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:27.002451 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f467a-5845-42f4-a460-a25eeedceaeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:27.003201 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f467a-5845-42f4-a460-a25eeedceaeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:27.005313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f467a-5845-42f4-a460-a25eeedceaeb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:27.048095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1374/2737] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:15:26 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:15:27.052865 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267eb2f-6445-4ace-978e-a492ecc92b85 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:27.065657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267eb2f-6445-4ace-978e-a492ecc92b85 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:27.139597 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfe230-e8d4-4153-827d-45cf691c7bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:27.140419 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfe230-e8d4-4153-827d-45cf691c7bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:27.140571 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfe230-e8d4-4153-827d-45cf691c7bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:27.140850 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfe230-e8d4-4153-827d-45cf691c7bb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:27.141554 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfe230-e8d4-4153-827d-45cf691c7bb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:27.143518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfe230-e8d4-4153-827d-45cf691c7bb8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:27.167612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1364/2738] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:15:27 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:15:27.172540 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f467a-5845-42f4-a460-a25eeedceaeb admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:27.187652 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f467a-5845-42f4-a460-a25eeedceaeb admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:27.193744 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c5475-8740-4bd8-8789-e8b74e68e615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:27.194463 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c5475-8740-4bd8-8789-e8b74e68e615 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:27.194729 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c5475-8740-4bd8-8789-e8b74e68e615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:27.195010 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c5475-8740-4bd8-8789-e8b74e68e615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:27.195753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c5475-8740-4bd8-8789-e8b74e68e615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:27.197388 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c5475-8740-4bd8-8789-e8b74e68e615 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:27.210095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1375/2739] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:15:27.214790 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfe230-e8d4-4153-827d-45cf691c7bb8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:27.226042 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfe230-e8d4-4153-827d-45cf691c7bb8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:27.232136 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb410c9-5625-4415-9047-366040f67936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:27.232981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb410c9-5625-4415-9047-366040f67936 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:27.233130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb410c9-5625-4415-9047-366040f67936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:27.233363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb410c9-5625-4415-9047-366040f67936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:27.234150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb410c9-5625-4415-9047-366040f67936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:27.235794 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb410c9-5625-4415-9047-366040f67936 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:27.247607 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1365/2740] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:15:27.253705 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c5475-8740-4bd8-8789-e8b74e68e615 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:27.266379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c5475-8740-4bd8-8789-e8b74e68e615 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:27.272111 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0fef2-e7a4-4fcc-8f1a-ceeed11aa6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:27.273224 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0fef2-e7a4-4fcc-8f1a-ceeed11aa6d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:27.273612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0fef2-e7a4-4fcc-8f1a-ceeed11aa6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:27.273932 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0fef2-e7a4-4fcc-8f1a-ceeed11aa6d9 admin admin] PATH_INFO: `/v3/projects/efe5a4d2d45f4b9cab086eecd2f42a19/users/f42dab7a725646e8b9b61e59251ffa3c/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:27.296512 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0fef2-e7a4-4fcc-8f1a-ceeed11aa6d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe5a4d2d45f4b9cab086eecd2f42a19, user_id=f42dab7a725646e8b9b61e59251ffa3c, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:27.301012 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0fef2-e7a4-4fcc-8f1a-ceeed11aa6d9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:27.321832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1376/2741] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:15:27 2022] PUT /identity/v3/projects/efe5a4d2d45f4b9cab086eecd2f42a19/users/f42dab7a725646e8b9b61e59251ffa3c/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:15:27.327579 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4cac2-83ef-4296-b8a9-bce17fcef52a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:27.327877 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4cac2-83ef-4296-b8a9-bce17fcef52a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:27.328167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4cac2-83ef-4296-b8a9-bce17fcef52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:27.350935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bfe4cac2-83ef-4296-b8a9-bce17fcef52a None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:27.352321 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bfe4cac2-83ef-4296-b8a9-bce17fcef52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:27.405756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:15:27.431927 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1366/2742] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:27.447950 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0fef2-e7a4-4fcc-8f1a-ceeed11aa6d9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:27.450983 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ded0fef2-e7a4-4fcc-8f1a-ceeed11aa6d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:27.524263 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0fef2-e7a4-4fcc-8f1a-ceeed11aa6d9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:27.528852 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ff87a-eb23-4e04-afd1-c37d5106388b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:27.529528 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ff87a-eb23-4e04-afd1-c37d5106388b service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:27.529843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ff87a-eb23-4e04-afd1-c37d5106388b service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:27.530121 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ff87a-eb23-4e04-afd1-c37d5106388b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:27.540392 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ff87a-eb23-4e04-afd1-c37d5106388b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:27.541898 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ff87a-eb23-4e04-afd1-c37d5106388b service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:27.552593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1377/2743] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:15:28.238693 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81e700-5f3f-4944-965a-00411ce7c3fc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:28.239414 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81e700-5f3f-4944-965a-00411ce7c3fc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:28.239414 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81e700-5f3f-4944-965a-00411ce7c3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:28.261852 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cc81e700-5f3f-4944-965a-00411ce7c3fc None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:28.263202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cc81e700-5f3f-4944-965a-00411ce7c3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:28.274072 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1367/2744] 10.222.0.67 () {58 vars in 1016 bytes} [Thu May 26 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:28.298821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ff87a-eb23-4e04-afd1-c37d5106388b service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:28.301280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-508ff87a-eb23-4e04-afd1-c37d5106388b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:28.353317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:15:28.403493 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d902f-2df1-49e0-9b72-af2eaf97e4bc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:28.404006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d902f-2df1-49e0-9b72-af2eaf97e4bc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:28.404354 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d902f-2df1-49e0-9b72-af2eaf97e4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:28.429297 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ff87a-eb23-4e04-afd1-c37d5106388b service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:28.439154 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b58828-f747-4c45-b08f-238bc53c22b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:28.440290 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b58828-f747-4c45-b08f-238bc53c22b7 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:28.440649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b58828-f747-4c45-b08f-238bc53c22b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:28.441115 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b58828-f747-4c45-b08f-238bc53c22b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:28.445150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e34d902f-2df1-49e0-9b72-af2eaf97e4bc None None] MFA Rules not processed for user `f42dab7a725646e8b9b61e59251ffa3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:28.447286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e34d902f-2df1-49e0-9b72-af2eaf97e4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:28.457393 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b58828-f747-4c45-b08f-238bc53c22b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:28.459905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b58828-f747-4c45-b08f-238bc53c22b7 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:28.481737 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1378/2745] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:15:28.569605 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1368/2746] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:28.594071 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b58828-f747-4c45-b08f-238bc53c22b7 service nova] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:28.595323 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-51b58828-f747-4c45-b08f-238bc53c22b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:28.665481 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b58828-f747-4c45-b08f-238bc53c22b7 service nova] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:28.669336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b83a3-0986-4416-b65e-351586db9c0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:28.670038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b83a3-0986-4416-b65e-351586db9c0f service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:28.670321 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b83a3-0986-4416-b65e-351586db9c0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:28.670596 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b83a3-0986-4416-b65e-351586db9c0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:28.681081 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b83a3-0986-4416-b65e-351586db9c0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:28.682725 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b83a3-0986-4416-b65e-351586db9c0f service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:28.693006 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1379/2747] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:15:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:15:30.088094 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba1726-bae2-404c-b5d5-4f2153b6915f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:30.088668 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba1726-bae2-404c-b5d5-4f2153b6915f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:30.088668 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba1726-bae2-404c-b5d5-4f2153b6915f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:30.108262 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d5ba1726-bae2-404c-b5d5-4f2153b6915f None None] MFA Rules not processed for user `f42dab7a725646e8b9b61e59251ffa3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:30.109484 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d5ba1726-bae2-404c-b5d5-4f2153b6915f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:30.116591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1369/2748] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:15:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:31.449210 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a4309-44a2-47a7-876c-0dbcc70867f9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:31.449935 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a4309-44a2-47a7-876c-0dbcc70867f9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:31.450131 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a4309-44a2-47a7-876c-0dbcc70867f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:31.474242 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-184a4309-44a2-47a7-876c-0dbcc70867f9 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:31.476621 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-184a4309-44a2-47a7-876c-0dbcc70867f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:31.488530 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1380/2749] 10.222.0.67 () {58 vars in 1016 bytes} [Thu May 26 21:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:31.511105 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba1726-bae2-404c-b5d5-4f2153b6915f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:31.512932 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d5ba1726-bae2-404c-b5d5-4f2153b6915f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:31.530709 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba1726-bae2-404c-b5d5-4f2153b6915f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:31.537462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc15d8-5f37-4cc4-bbcf-3592708dd8af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:31.538185 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc15d8-5f37-4cc4-bbcf-3592708dd8af service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:31.538451 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc15d8-5f37-4cc4-bbcf-3592708dd8af service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:31.538721 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc15d8-5f37-4cc4-bbcf-3592708dd8af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:31.550462 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc15d8-5f37-4cc4-bbcf-3592708dd8af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:31.552066 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc15d8-5f37-4cc4-bbcf-3592708dd8af service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:31.563705 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1370/2750] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:15:34.665311 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76258f30-7c12-4cf1-a9ba-a409f1e1dfd7 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:34.666262 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76258f30-7c12-4cf1-a9ba-a409f1e1dfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:34.666262 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76258f30-7c12-4cf1-a9ba-a409f1e1dfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:34.691179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-76258f30-7c12-4cf1-a9ba-a409f1e1dfd7 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:34.692661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-76258f30-7c12-4cf1-a9ba-a409f1e1dfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:34.702577 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1381/2751] 10.222.0.67 () {58 vars in 1016 bytes} [Thu May 26 21:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:34.726078 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc15d8-5f37-4cc4-bbcf-3592708dd8af service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:15:34.743935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc15d8-5f37-4cc4-bbcf-3592708dd8af service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:15:34.754803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0eb9d-cb59-4e9b-baac-cb85eba58c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:15:34.755914 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0eb9d-cb59-4e9b-baac-cb85eba58c5a service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:34.756515 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0eb9d-cb59-4e9b-baac-cb85eba58c5a service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:34.757002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0eb9d-cb59-4e9b-baac-cb85eba58c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:34.777365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0eb9d-cb59-4e9b-baac-cb85eba58c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:15:34.780761 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0eb9d-cb59-4e9b-baac-cb85eba58c5a service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:15:34.795980 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1371/2752] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:15:44.684334 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=51 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:15:44.789135 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=57 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:15:50.702335 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5f9a2-6dfd-48b6-9a04-62aeb256d066 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:50.702935 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5f9a2-6dfd-48b6-9a04-62aeb256d066 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:50.703039 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5f9a2-6dfd-48b6-9a04-62aeb256d066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:50.723952 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b7c5f9a2-6dfd-48b6-9a04-62aeb256d066 None None] MFA Rules not processed for user `f42dab7a725646e8b9b61e59251ffa3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:50.725165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b7c5f9a2-6dfd-48b6-9a04-62aeb256d066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:50.733044 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1382/2753] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:15:59.814519 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cda117-ee1c-440d-879c-4cc0f366e234 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:15:59.815135 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cda117-ee1c-440d-879c-4cc0f366e234 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:15:59.815135 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cda117-ee1c-440d-879c-4cc0f366e234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:15:59.834700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-45cda117-ee1c-440d-879c-4cc0f366e234 None None] MFA Rules not processed for user `fa4fe3e86944454d8cf6793fd857907f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:15:59.835935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-45cda117-ee1c-440d-879c-4cc0f366e234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:15:59.901015 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1372/2754] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:16:00.718465 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:16:06.632901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5f9a2-6dfd-48b6-9a04-62aeb256d066 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:06.635200 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b7c5f9a2-6dfd-48b6-9a04-62aeb256d066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:16:06.653561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5f9a2-6dfd-48b6-9a04-62aeb256d066 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:06.659118 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cffd1c-6a90-4775-83ba-3ad5faf896c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:06.660029 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cffd1c-6a90-4775-83ba-3ad5faf896c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:06.660312 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cffd1c-6a90-4775-83ba-3ad5faf896c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:06.660586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cffd1c-6a90-4775-83ba-3ad5faf896c8 admin admin] PATH_INFO: `/v3/users/a2bb05cbe5cc4cb4a5bf0f527904bd0c` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:06.661933 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cffd1c-6a90-4775-83ba-3ad5faf896c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2bb05cbe5cc4cb4a5bf0f527904bd0c)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:06.663893 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cffd1c-6a90-4775-83ba-3ad5faf896c8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:06.745030 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e0cffd1c-6a90-4775-83ba-3ad5faf896c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2bb05cbe5cc4cb4a5bf0f527904bd0c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:06.760615 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e0cffd1c-6a90-4775-83ba-3ad5faf896c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2bb05cbe5cc4cb4a5bf0f527904bd0c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:06.761456 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e0cffd1c-6a90-4775-83ba-3ad5faf896c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2bb05cbe5cc4cb4a5bf0f527904bd0c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:06.777017 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e0cffd1c-6a90-4775-83ba-3ad5faf896c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2bb05cbe5cc4cb4a5bf0f527904bd0c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:06.788464 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e0cffd1c-6a90-4775-83ba-3ad5faf896c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2bb05cbe5cc4cb4a5bf0f527904bd0c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:06.795818 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1383/2755] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:16:06 2022] DELETE /identity/v3/users/a2bb05cbe5cc4cb4a5bf0f527904bd0c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:16:07.135734 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cda117-ee1c-440d-879c-4cc0f366e234 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:07.151635 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cda117-ee1c-440d-879c-4cc0f366e234 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:07.282246 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56010-a08f-4b95-8482-74337f0fc47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:07.284722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56010-a08f-4b95-8482-74337f0fc47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:07.284722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56010-a08f-4b95-8482-74337f0fc47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:07.284722 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56010-a08f-4b95-8482-74337f0fc47d admin admin] PATH_INFO: `/v3/projects/1e100d493507464ca9af4604fbd8aa66` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:07.286601 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd56010-a08f-4b95-8482-74337f0fc47d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e100d493507464ca9af4604fbd8aa66)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:07.290342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd56010-a08f-4b95-8482-74337f0fc47d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:07.363459 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bcd56010-a08f-4b95-8482-74337f0fc47d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e100d493507464ca9af4604fbd8aa66', 'request_id': 'req-bcd56010-a08f-4b95-8482-74337f0fc47d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:07.377278 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bcd56010-a08f-4b95-8482-74337f0fc47d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e100d493507464ca9af4604fbd8aa66', 'request_id': 'req-bcd56010-a08f-4b95-8482-74337f0fc47d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:07.389368 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bcd56010-a08f-4b95-8482-74337f0fc47d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e100d493507464ca9af4604fbd8aa66', 'request_id': 'req-bcd56010-a08f-4b95-8482-74337f0fc47d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:07.405423 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bcd56010-a08f-4b95-8482-74337f0fc47d admin admin] The token cache is being invalidate because project 1e100d493507464ca9af4604fbd8aa66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:16:07.405728 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bcd56010-a08f-4b95-8482-74337f0fc47d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:07.406398 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bcd56010-a08f-4b95-8482-74337f0fc47d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:07.408169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1373/2756] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:16:07 2022] DELETE /identity/v3/projects/1e100d493507464ca9af4604fbd8aa66 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:16:09.171049 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c5b49-aaa3-4554-b1b1-c09288de2c98 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:09.171635 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c5b49-aaa3-4554-b1b1-c09288de2c98 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:09.171868 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c5b49-aaa3-4554-b1b1-c09288de2c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:09.200257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-821c5b49-aaa3-4554-b1b1-c09288de2c98 None None] MFA Rules not processed for user `3953b14656774edb92da1ecdb4bbbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:16:09.202698 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-821c5b49-aaa3-4554-b1b1-c09288de2c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:16:09.287138 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1384/2757] 10.222.0.61 () {58 vars in 1009 bytes} [Thu May 26 21:16:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:16:09.360148 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56010-a08f-4b95-8482-74337f0fc47d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:09.361565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bcd56010-a08f-4b95-8482-74337f0fc47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:16:09.418342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:16:09.469723 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56010-a08f-4b95-8482-74337f0fc47d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:09.477757 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edf435-41ca-4e80-b602-522b1efb41f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a63879ec1242d08bba1ccad6212788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:09.478518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edf435-41ca-4e80-b602-522b1efb41f0 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:09.478799 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edf435-41ca-4e80-b602-522b1efb41f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:09.479075 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edf435-41ca-4e80-b602-522b1efb41f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:09.491387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86edf435-41ca-4e80-b602-522b1efb41f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:09.495844 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86edf435-41ca-4e80-b602-522b1efb41f0 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:09.507665 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1374/2758] 10.222.0.61 () {60 vars in 1384 bytes} [Thu May 26 21:16:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:16:19.277841 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:16:19.502250 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=16 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:16:26.103144 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5106d5d-de51-492f-9b1b-067b94a61777 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:26.103655 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5106d5d-de51-492f-9b1b-067b94a61777 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:26.103781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5106d5d-de51-492f-9b1b-067b94a61777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:26.123915 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a5106d5d-de51-492f-9b1b-067b94a61777 None None] MFA Rules not processed for user `3953b14656774edb92da1ecdb4bbbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:16:26.125161 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a5106d5d-de51-492f-9b1b-067b94a61777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:16:26.133472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1385/2759] 10.222.0.61 () {58 vars in 967 bytes} [Thu May 26 21:16:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:16:26.150362 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edf435-41ca-4e80-b602-522b1efb41f0 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:26.167629 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edf435-41ca-4e80-b602-522b1efb41f0 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:26.174176 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694815b-b5a5-4789-a896-f8a600e9e68a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a63879ec1242d08bba1ccad6212788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:26.174924 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694815b-b5a5-4789-a896-f8a600e9e68a service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:26.175203 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694815b-b5a5-4789-a896-f8a600e9e68a service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:26.175480 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694815b-b5a5-4789-a896-f8a600e9e68a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:26.186769 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694815b-b5a5-4789-a896-f8a600e9e68a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:26.188466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694815b-b5a5-4789-a896-f8a600e9e68a service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:26.197848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1375/2760] 10.222.0.61 () {60 vars in 1384 bytes} [Thu May 26 21:16:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 21:16:28.313748 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5106d5d-de51-492f-9b1b-067b94a61777 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:28.316140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a5106d5d-de51-492f-9b1b-067b94a61777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:16:28.414341 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5106d5d-de51-492f-9b1b-067b94a61777 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:28.419579 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331ff2d-8743-4600-98a7-baf095d4c61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:28.420480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331ff2d-8743-4600-98a7-baf095d4c61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:28.420766 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331ff2d-8743-4600-98a7-baf095d4c61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:28.421045 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331ff2d-8743-4600-98a7-baf095d4c61f admin admin] PATH_INFO: `/v3/users/f42dab7a725646e8b9b61e59251ffa3c` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:28.422363 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331ff2d-8743-4600-98a7-baf095d4c61f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f42dab7a725646e8b9b61e59251ffa3c)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:28.424323 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331ff2d-8743-4600-98a7-baf095d4c61f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:28.488172 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e331ff2d-8743-4600-98a7-baf095d4c61f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f42dab7a725646e8b9b61e59251ffa3c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:28.500958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e331ff2d-8743-4600-98a7-baf095d4c61f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f42dab7a725646e8b9b61e59251ffa3c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:28.501692 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e331ff2d-8743-4600-98a7-baf095d4c61f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f42dab7a725646e8b9b61e59251ffa3c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:28.512075 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e331ff2d-8743-4600-98a7-baf095d4c61f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f42dab7a725646e8b9b61e59251ffa3c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:28.521216 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e331ff2d-8743-4600-98a7-baf095d4c61f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f42dab7a725646e8b9b61e59251ffa3c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:28.527461 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1386/2761] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:16:28 2022] DELETE /identity/v3/users/f42dab7a725646e8b9b61e59251ffa3c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:16:28.742068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694815b-b5a5-4789-a896-f8a600e9e68a service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:28.764859 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694815b-b5a5-4789-a896-f8a600e9e68a service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:28.842182 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fad0c-d961-466f-9842-8cec6f687023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:28.843120 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fad0c-d961-466f-9842-8cec6f687023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:28.843405 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fad0c-d961-466f-9842-8cec6f687023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:28.843678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fad0c-d961-466f-9842-8cec6f687023 admin admin] PATH_INFO: `/v3/projects/efe5a4d2d45f4b9cab086eecd2f42a19` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:28.844922 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fad0c-d961-466f-9842-8cec6f687023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe5a4d2d45f4b9cab086eecd2f42a19)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:28.846885 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fad0c-d961-466f-9842-8cec6f687023 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:28.910276 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-426fad0c-d961-466f-9842-8cec6f687023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe5a4d2d45f4b9cab086eecd2f42a19', 'request_id': 'req-426fad0c-d961-466f-9842-8cec6f687023'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:28.921251 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-426fad0c-d961-466f-9842-8cec6f687023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe5a4d2d45f4b9cab086eecd2f42a19', 'request_id': 'req-426fad0c-d961-466f-9842-8cec6f687023'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:28.928316 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-426fad0c-d961-466f-9842-8cec6f687023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe5a4d2d45f4b9cab086eecd2f42a19', 'request_id': 'req-426fad0c-d961-466f-9842-8cec6f687023'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:28.940329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-426fad0c-d961-466f-9842-8cec6f687023 admin admin] The token cache is being invalidate because project efe5a4d2d45f4b9cab086eecd2f42a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:16:28.940601 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-426fad0c-d961-466f-9842-8cec6f687023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:28.941404 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-426fad0c-d961-466f-9842-8cec6f687023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:16:28.943123 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1376/2762] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:16:28 2022] DELETE /identity/v3/projects/efe5a4d2d45f4b9cab086eecd2f42a19 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:16:28.950679 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2af282-115c-4917-a4c0-6cece4385e75 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:28.951233 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2af282-115c-4917-a4c0-6cece4385e75 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:28.951767 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2af282-115c-4917-a4c0-6cece4385e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:28.975235 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3b2af282-115c-4917-a4c0-6cece4385e75 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:16:28.976484 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3b2af282-115c-4917-a4c0-6cece4385e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:16:29.047353 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1387/2763] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:16:29.058617 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70f369-a8a9-49cc-9aef-8108f67048c0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:29.058904 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70f369-a8a9-49cc-9aef-8108f67048c0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:29.059180 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70f369-a8a9-49cc-9aef-8108f67048c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:29.088078 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-be70f369-a8a9-49cc-9aef-8108f67048c0 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:16:29.090938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-be70f369-a8a9-49cc-9aef-8108f67048c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:16:29.097651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1377/2764] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:16:29.104284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2af282-115c-4917-a4c0-6cece4385e75 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:29.115257 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2af282-115c-4917-a4c0-6cece4385e75 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:29.120904 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdec677-4a55-4755-9dd6-87ec4ff14906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:29.121585 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdec677-4a55-4755-9dd6-87ec4ff14906 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:29.121897 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdec677-4a55-4755-9dd6-87ec4ff14906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:29.122221 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdec677-4a55-4755-9dd6-87ec4ff14906 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:29.123228 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdec677-4a55-4755-9dd6-87ec4ff14906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:16:29.123419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdec677-4a55-4755-9dd6-87ec4ff14906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:29.124881 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdec677-4a55-4755-9dd6-87ec4ff14906 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:29.134661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:16:29.144036 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1388/2765] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:16:29.147891 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70f369-a8a9-49cc-9aef-8108f67048c0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:29.158288 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70f369-a8a9-49cc-9aef-8108f67048c0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:29.164385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0ac5b-9902-46d1-b1be-8c10ba58de8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:29.165085 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0ac5b-9902-46d1-b1be-8c10ba58de8d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:29.165345 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0ac5b-9902-46d1-b1be-8c10ba58de8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:29.165631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0ac5b-9902-46d1-b1be-8c10ba58de8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:29.166425 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0ac5b-9902-46d1-b1be-8c10ba58de8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:29.168393 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0ac5b-9902-46d1-b1be-8c10ba58de8d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:29.200947 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1378/2766] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:16:29 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:16:29.205315 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdec677-4a55-4755-9dd6-87ec4ff14906 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:29.215892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdec677-4a55-4755-9dd6-87ec4ff14906 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:29.279833 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05cf19-9ae0-40a0-ad05-9c83efdc498d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:29.280535 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05cf19-9ae0-40a0-ad05-9c83efdc498d admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:29.280855 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05cf19-9ae0-40a0-ad05-9c83efdc498d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:29.281119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05cf19-9ae0-40a0-ad05-9c83efdc498d admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:29.281826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05cf19-9ae0-40a0-ad05-9c83efdc498d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:29.283810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05cf19-9ae0-40a0-ad05-9c83efdc498d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:29.306414 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1389/2767] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:16:29 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:16:29.310960 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0ac5b-9902-46d1-b1be-8c10ba58de8d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:29.321946 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0ac5b-9902-46d1-b1be-8c10ba58de8d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:29.328128 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc9103-3ec2-4ac2-8de3-a5ad4dc3087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:29.328821 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc9103-3ec2-4ac2-8de3-a5ad4dc3087f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:29.329110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc9103-3ec2-4ac2-8de3-a5ad4dc3087f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:29.329387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc9103-3ec2-4ac2-8de3-a5ad4dc3087f admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:29.330160 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc9103-3ec2-4ac2-8de3-a5ad4dc3087f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:29.331791 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc9103-3ec2-4ac2-8de3-a5ad4dc3087f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:29.344618 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1379/2768] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:16:29.348878 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05cf19-9ae0-40a0-ad05-9c83efdc498d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:29.360117 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05cf19-9ae0-40a0-ad05-9c83efdc498d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:29.365362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438aab2d-5c54-45da-bcee-a4cf36876b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:29.366097 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aab2d-5c54-45da-bcee-a4cf36876b01 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:29.366383 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aab2d-5c54-45da-bcee-a4cf36876b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:29.366680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aab2d-5c54-45da-bcee-a4cf36876b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:29.367426 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438aab2d-5c54-45da-bcee-a4cf36876b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:29.369067 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438aab2d-5c54-45da-bcee-a4cf36876b01 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:29.381413 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1390/2769] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:16:29.385962 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc9103-3ec2-4ac2-8de3-a5ad4dc3087f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:29.401349 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc9103-3ec2-4ac2-8de3-a5ad4dc3087f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:29.407651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56576045-110c-4dc1-bcb4-2365b893353b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:29.408601 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56576045-110c-4dc1-bcb4-2365b893353b admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:29.408893 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56576045-110c-4dc1-bcb4-2365b893353b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:29.409148 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56576045-110c-4dc1-bcb4-2365b893353b admin admin] PATH_INFO: `/v3/projects/4135c478b822402297fbb0a79f9a0b6b/users/d30be6d09e2e4256abfa1d563be6987a/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:29.426329 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56576045-110c-4dc1-bcb4-2365b893353b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4135c478b822402297fbb0a79f9a0b6b, user_id=d30be6d09e2e4256abfa1d563be6987a, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:29.429150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56576045-110c-4dc1-bcb4-2365b893353b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:29.445161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1380/2770] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:16:29 2022] PUT /identity/v3/projects/4135c478b822402297fbb0a79f9a0b6b/users/d30be6d09e2e4256abfa1d563be6987a/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:16:29.451499 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5061db8-d6d5-48d4-8b4e-fd155a88b876 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:29.451924 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5061db8-d6d5-48d4-8b4e-fd155a88b876 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:29.452321 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5061db8-d6d5-48d4-8b4e-fd155a88b876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:29.473299 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b5061db8-d6d5-48d4-8b4e-fd155a88b876 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:16:29.474560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b5061db8-d6d5-48d4-8b4e-fd155a88b876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:16:29.540488 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1391/2771] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:16:29.550683 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56576045-110c-4dc1-bcb4-2365b893353b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:29.552593 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-56576045-110c-4dc1-bcb4-2365b893353b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:16:29.570919 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:16:29.626053 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56576045-110c-4dc1-bcb4-2365b893353b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:29.629960 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b5629-1137-45e0-a5cc-02f76131acb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:29.630626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b5629-1137-45e0-a5cc-02f76131acb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:29.630913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b5629-1137-45e0-a5cc-02f76131acb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:29.631191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b5629-1137-45e0-a5cc-02f76131acb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:29.641075 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b5629-1137-45e0-a5cc-02f76131acb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:29.642549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b5629-1137-45e0-a5cc-02f76131acb2 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:29.653823 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1381/2772] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:16:34.105522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8122f7-af97-46bc-96f7-491e5355590b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:34.106154 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8122f7-af97-46bc-96f7-491e5355590b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:34.106154 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8122f7-af97-46bc-96f7-491e5355590b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:34.143716 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3b8122f7-af97-46bc-96f7-491e5355590b None None] MFA Rules not processed for user `d30be6d09e2e4256abfa1d563be6987a`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:16:34.144949 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3b8122f7-af97-46bc-96f7-491e5355590b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:16:34.221010 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1392/2773] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:16:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:16:34.226107 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b5629-1137-45e0-a5cc-02f76131acb2 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:34.238104 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b5629-1137-45e0-a5cc-02f76131acb2 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:34.244003 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a33dcc-27d2-4079-8821-18f7d32bb100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:34.244824 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33dcc-27d2-4079-8821-18f7d32bb100 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:34.245169 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33dcc-27d2-4079-8821-18f7d32bb100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:34.245505 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33dcc-27d2-4079-8821-18f7d32bb100 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:34.246402 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a33dcc-27d2-4079-8821-18f7d32bb100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:34.248536 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a33dcc-27d2-4079-8821-18f7d32bb100 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:34.279282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1382/2774] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:16:34 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:16:34.283524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8122f7-af97-46bc-96f7-491e5355590b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:34.296441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8122f7-af97-46bc-96f7-491e5355590b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:34.302127 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:16:34.363472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0384d-6c44-4306-a753-4409f02e3301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:34.364179 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0384d-6c44-4306-a753-4409f02e3301 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:34.364461 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0384d-6c44-4306-a753-4409f02e3301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:34.364735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0384d-6c44-4306-a753-4409f02e3301 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:34.365437 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0384d-6c44-4306-a753-4409f02e3301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:34.367454 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0384d-6c44-4306-a753-4409f02e3301 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:34.390791 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1393/2775] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:16:34 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:16:34.395185 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a33dcc-27d2-4079-8821-18f7d32bb100 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:34.408022 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a33dcc-27d2-4079-8821-18f7d32bb100 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:34.414122 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675639d8-c1cb-42de-8c9a-c7b02e4101c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:34.414819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675639d8-c1cb-42de-8c9a-c7b02e4101c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:34.415105 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675639d8-c1cb-42de-8c9a-c7b02e4101c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:34.415406 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675639d8-c1cb-42de-8c9a-c7b02e4101c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:34.416145 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675639d8-c1cb-42de-8c9a-c7b02e4101c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:34.417782 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675639d8-c1cb-42de-8c9a-c7b02e4101c3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:34.430488 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1383/2776] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:16:34.435269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0384d-6c44-4306-a753-4409f02e3301 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:34.448661 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0384d-6c44-4306-a753-4409f02e3301 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:34.455175 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d045d65-5726-4752-ac59-6c1e6a1b151b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:34.456310 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d045d65-5726-4752-ac59-6c1e6a1b151b admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:34.456734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d045d65-5726-4752-ac59-6c1e6a1b151b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:34.457150 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d045d65-5726-4752-ac59-6c1e6a1b151b admin admin] PATH_INFO: `/v3/projects/9de7367cec15412a8ce7f28a2323fe6e/users/130f583d64264f1c93be54bb43aa3ba7/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:34.477632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d045d65-5726-4752-ac59-6c1e6a1b151b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de7367cec15412a8ce7f28a2323fe6e, user_id=130f583d64264f1c93be54bb43aa3ba7, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:34.480374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d045d65-5726-4752-ac59-6c1e6a1b151b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:34.498378 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1394/2777] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:16:34 2022] PUT /identity/v3/projects/9de7367cec15412a8ce7f28a2323fe6e/users/130f583d64264f1c93be54bb43aa3ba7/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:16:34.502998 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675639d8-c1cb-42de-8c9a-c7b02e4101c3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:34.514700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675639d8-c1cb-42de-8c9a-c7b02e4101c3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:34.610685 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ff7bf-915a-41c5-a7ad-ba0d1d750656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:34.611408 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ff7bf-915a-41c5-a7ad-ba0d1d750656 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:34.611713 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ff7bf-915a-41c5-a7ad-ba0d1d750656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:34.611986 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ff7bf-915a-41c5-a7ad-ba0d1d750656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:34.612738 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ff7bf-915a-41c5-a7ad-ba0d1d750656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:34.616141 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ff7bf-915a-41c5-a7ad-ba0d1d750656 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:34.627239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1384/2778] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:16:34.631747 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d045d65-5726-4752-ac59-6c1e6a1b151b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:34.642707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d045d65-5726-4752-ac59-6c1e6a1b151b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:34.647849 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a39b8-1b42-48ee-a741-2bb52b6ed195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:34.648769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a39b8-1b42-48ee-a741-2bb52b6ed195 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:34.649046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a39b8-1b42-48ee-a741-2bb52b6ed195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:34.649321 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a39b8-1b42-48ee-a741-2bb52b6ed195 admin admin] PATH_INFO: `/v3/projects/9de7367cec15412a8ce7f28a2323fe6e/users/130f583d64264f1c93be54bb43aa3ba7/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:34.653352 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a39b8-1b42-48ee-a741-2bb52b6ed195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de7367cec15412a8ce7f28a2323fe6e, user_id=130f583d64264f1c93be54bb43aa3ba7, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:34.656791 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a39b8-1b42-48ee-a741-2bb52b6ed195 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:34.670979 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1395/2779] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:16:34 2022] PUT /identity/v3/projects/9de7367cec15412a8ce7f28a2323fe6e/users/130f583d64264f1c93be54bb43aa3ba7/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:16:39.582618 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa72e23-7056-4047-8af9-ac5c5a67d398 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:39.583170 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa72e23-7056-4047-8af9-ac5c5a67d398 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:39.583294 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa72e23-7056-4047-8af9-ac5c5a67d398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:39.618424 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-efa72e23-7056-4047-8af9-ac5c5a67d398 None None] MFA Rules not processed for user `130f583d64264f1c93be54bb43aa3ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:16:39.620632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-efa72e23-7056-4047-8af9-ac5c5a67d398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:16:39.731875 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1385/2780] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:16:39.751587 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a39b8-1b42-48ee-a741-2bb52b6ed195 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:16:39.756990 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ff3a39b8-1b42-48ee-a741-2bb52b6ed195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:16:39.877443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a39b8-1b42-48ee-a741-2bb52b6ed195 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:16:39.883301 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2301fd-10cf-4bb1-9b18-44ca43677a5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:16:39.883975 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2301fd-10cf-4bb1-9b18-44ca43677a5d service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:39.884258 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2301fd-10cf-4bb1-9b18-44ca43677a5d service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:39.884532 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2301fd-10cf-4bb1-9b18-44ca43677a5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:39.962498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2301fd-10cf-4bb1-9b18-44ca43677a5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:16:39.964206 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2301fd-10cf-4bb1-9b18-44ca43677a5d service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:16:39.968001 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:16:39.977949 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1396/2781] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:16:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:16:41.357505 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964f4a4-4fed-4e35-b764-d7a752af551f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:16:41.358191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964f4a4-4fed-4e35-b764-d7a752af551f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:16:41.358191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964f4a4-4fed-4e35-b764-d7a752af551f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:16:41.365553 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:16:41.379748 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f964f4a4-4fed-4e35-b764-d7a752af551f None None] MFA Rules not processed for user `d30be6d09e2e4256abfa1d563be6987a`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:16:41.381594 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f964f4a4-4fed-4e35-b764-d7a752af551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:16:41.389859 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1386/2782] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:16:49.978231 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:16:51.380873 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:17:05.207745 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197034a-6785-4ac0-9821-4461a9f7d854 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:05.208212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197034a-6785-4ac0-9821-4461a9f7d854 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:05.208342 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197034a-6785-4ac0-9821-4461a9f7d854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:05.230634 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e197034a-6785-4ac0-9821-4461a9f7d854 None None] MFA Rules not processed for user `fa4fe3e86944454d8cf6793fd857907f`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:17:05.231826 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e197034a-6785-4ac0-9821-4461a9f7d854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:17:05.305088 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1397/2783] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:17:07.091874 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964f4a4-4fed-4e35-b764-d7a752af551f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:17:07.094020 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f964f4a4-4fed-4e35-b764-d7a752af551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:17:07.170253 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964f4a4-4fed-4e35-b764-d7a752af551f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:17:07.174759 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf945301-47fb-4a33-9ca7-346794d37694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:17:07.175509 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf945301-47fb-4a33-9ca7-346794d37694 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:07.175795 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf945301-47fb-4a33-9ca7-346794d37694 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:07.176101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf945301-47fb-4a33-9ca7-346794d37694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:07.188175 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf945301-47fb-4a33-9ca7-346794d37694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:17:07.189700 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf945301-47fb-4a33-9ca7-346794d37694 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:17:07.203183 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1387/2784] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:17:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:17:15.294319 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=25 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:17:17.197490 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=26 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:17:29.090994 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197034a-6785-4ac0-9821-4461a9f7d854 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:17:29.092659 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e197034a-6785-4ac0-9821-4461a9f7d854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:17:29.189169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197034a-6785-4ac0-9821-4461a9f7d854 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:17:29.198065 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1af0d-f6e3-460d-b753-beddd96ea0c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8952f35c21c4a2eaf1fbc601fe76242', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:17:29.199470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1af0d-f6e3-460d-b753-beddd96ea0c6 service placement] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:17:29.200180 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1af0d-f6e3-460d-b753-beddd96ea0c6 service placement] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:17:29.200381 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1af0d-f6e3-460d-b753-beddd96ea0c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:17:29.203270 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a2a1af0d-f6e3-460d-b753-beddd96ea0c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:17:29.219939 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1af0d-f6e3-460d-b753-beddd96ea0c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:17:29.221587 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1af0d-f6e3-460d-b753-beddd96ea0c6 service placement] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:17:29.233558 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1398/2785] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:17:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:17:39.228658 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=32 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:18:04.648790 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e57e2-87c5-4c11-959d-d2bf43f20588 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:18:04.649369 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e57e2-87c5-4c11-959d-d2bf43f20588 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:18:04.649369 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e57e2-87c5-4c11-959d-d2bf43f20588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:18:04.667772 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-388e57e2-87c5-4c11-959d-d2bf43f20588 None None] MFA Rules not processed for user `fa4fe3e86944454d8cf6793fd857907f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:18:04.668878 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-388e57e2-87c5-4c11-959d-d2bf43f20588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:18:04.676633 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1388/2786] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:18:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:18:14.662427 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:18:52.498538 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1af0d-f6e3-460d-b753-beddd96ea0c6 service placement] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:18:52.500346 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a2a1af0d-f6e3-460d-b753-beddd96ea0c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:18:52.569203 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1af0d-f6e3-460d-b753-beddd96ea0c6 service placement] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:18:52.573821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b7bbf-2fd8-441e-90c3-f71f927c367f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:18:52.574493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b7bbf-2fd8-441e-90c3-f71f927c367f service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:18:52.574774 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b7bbf-2fd8-441e-90c3-f71f927c367f service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:18:52.575394 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b7bbf-2fd8-441e-90c3-f71f927c367f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:18:52.577360 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a00b7bbf-2fd8-441e-90c3-f71f927c367f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:18:52.597330 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b7bbf-2fd8-441e-90c3-f71f927c367f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:18:52.598837 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b7bbf-2fd8-441e-90c3-f71f927c367f service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:18:52.611872 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1399/2787] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:18:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:18:55.301610 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e57e2-87c5-4c11-959d-d2bf43f20588 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:18:55.312280 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e57e2-87c5-4c11-959d-d2bf43f20588 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:18:55.316912 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382147c-4c3f-400b-9266-542cab3250d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:18:55.317580 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382147c-4c3f-400b-9266-542cab3250d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:18:55.317935 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382147c-4c3f-400b-9266-542cab3250d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:18:55.318233 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382147c-4c3f-400b-9266-542cab3250d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:18:55.320097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6382147c-4c3f-400b-9266-542cab3250d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:18:55.337812 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382147c-4c3f-400b-9266-542cab3250d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:18:55.339272 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382147c-4c3f-400b-9266-542cab3250d8 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:18:55.353046 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1389/2788] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:18:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:02.605504 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=26 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:05.347074 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=6 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:08.374527 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b7bbf-2fd8-441e-90c3-f71f927c367f service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:08.387612 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b7bbf-2fd8-441e-90c3-f71f927c367f service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:08.394102 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce35a1-ce41-4d4c-b3b3-f95b86cbe7e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8952f35c21c4a2eaf1fbc601fe76242', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:08.395222 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce35a1-ce41-4d4c-b3b3-f95b86cbe7e9 service placement] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:08.395454 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce35a1-ce41-4d4c-b3b3-f95b86cbe7e9 service placement] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:08.396006 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce35a1-ce41-4d4c-b3b3-f95b86cbe7e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:08.398550 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-23ce35a1-ce41-4d4c-b3b3-f95b86cbe7e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:08.416743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce35a1-ce41-4d4c-b3b3-f95b86cbe7e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:08.418819 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce35a1-ce41-4d4c-b3b3-f95b86cbe7e9 service placement] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:08.432687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1400/2789] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:19:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:08.444222 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382147c-4c3f-400b-9266-542cab3250d8 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:08.448657 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6382147c-4c3f-400b-9266-542cab3250d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:08.522506 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382147c-4c3f-400b-9266-542cab3250d8 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:08.527582 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d70ec6-01f7-46df-b4c0-adf2b6155a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:08.528482 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d70ec6-01f7-46df-b4c0-adf2b6155a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:08.528767 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d70ec6-01f7-46df-b4c0-adf2b6155a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:08.529061 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d70ec6-01f7-46df-b4c0-adf2b6155a68 admin admin] PATH_INFO: `/v3/users/fa4fe3e86944454d8cf6793fd857907f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:08.530606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d70ec6-01f7-46df-b4c0-adf2b6155a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4fe3e86944454d8cf6793fd857907f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:08.532578 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d70ec6-01f7-46df-b4c0-adf2b6155a68 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:08.614915 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-37d70ec6-01f7-46df-b4c0-adf2b6155a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4fe3e86944454d8cf6793fd857907f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:08.615770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-37d70ec6-01f7-46df-b4c0-adf2b6155a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4fe3e86944454d8cf6793fd857907f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:08.627248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-37d70ec6-01f7-46df-b4c0-adf2b6155a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4fe3e86944454d8cf6793fd857907f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:08.643306 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-37d70ec6-01f7-46df-b4c0-adf2b6155a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4fe3e86944454d8cf6793fd857907f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:08.654507 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-37d70ec6-01f7-46df-b4c0-adf2b6155a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4fe3e86944454d8cf6793fd857907f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:08.661186 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1390/2790] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:19:08 2022] DELETE /identity/v3/users/fa4fe3e86944454d8cf6793fd857907f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:08.911814 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce35a1-ce41-4d4c-b3b3-f95b86cbe7e9 service placement] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:08.929905 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce35a1-ce41-4d4c-b3b3-f95b86cbe7e9 service placement] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:09.013021 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1003fdb-18e4-4be8-aadb-e6631f53b904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:09.013938 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1003fdb-18e4-4be8-aadb-e6631f53b904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:09.014220 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1003fdb-18e4-4be8-aadb-e6631f53b904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:09.014493 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1003fdb-18e4-4be8-aadb-e6631f53b904 admin admin] PATH_INFO: `/v3/projects/8e1404d0985a4a9596153664c3c0fa8e` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:09.015717 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1003fdb-18e4-4be8-aadb-e6631f53b904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1404d0985a4a9596153664c3c0fa8e)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:09.017813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1003fdb-18e4-4be8-aadb-e6631f53b904 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:09.090419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b1003fdb-18e4-4be8-aadb-e6631f53b904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1404d0985a4a9596153664c3c0fa8e', 'request_id': 'req-b1003fdb-18e4-4be8-aadb-e6631f53b904'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:09.099832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b1003fdb-18e4-4be8-aadb-e6631f53b904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1404d0985a4a9596153664c3c0fa8e', 'request_id': 'req-b1003fdb-18e4-4be8-aadb-e6631f53b904'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:09.109077 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b1003fdb-18e4-4be8-aadb-e6631f53b904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1404d0985a4a9596153664c3c0fa8e', 'request_id': 'req-b1003fdb-18e4-4be8-aadb-e6631f53b904'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:09.131041 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b1003fdb-18e4-4be8-aadb-e6631f53b904 admin admin] The token cache is being invalidate because project 8e1404d0985a4a9596153664c3c0fa8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:19:09.131614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b1003fdb-18e4-4be8-aadb-e6631f53b904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:09.132307 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b1003fdb-18e4-4be8-aadb-e6631f53b904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:09.134930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1401/2791] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:19:08 2022] DELETE /identity/v3/projects/8e1404d0985a4a9596153664c3c0fa8e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:09.141633 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac275811-8d2b-4ac3-8f6d-f02f8fe41586 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:09.142229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac275811-8d2b-4ac3-8f6d-f02f8fe41586 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:09.142707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac275811-8d2b-4ac3-8f6d-f02f8fe41586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:09.171373 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ac275811-8d2b-4ac3-8f6d-f02f8fe41586 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:09.172780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ac275811-8d2b-4ac3-8f6d-f02f8fe41586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:09.253058 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1391/2792] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:09.263582 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69005575-5ecc-4d66-8870-707e22687220 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:09.263907 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69005575-5ecc-4d66-8870-707e22687220 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:09.264139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69005575-5ecc-4d66-8870-707e22687220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:09.284717 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-69005575-5ecc-4d66-8870-707e22687220 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:09.286024 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-69005575-5ecc-4d66-8870-707e22687220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:09.294776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1402/2793] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:09.299776 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac275811-8d2b-4ac3-8f6d-f02f8fe41586 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:09.311071 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac275811-8d2b-4ac3-8f6d-f02f8fe41586 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:09.316062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d10336-9b88-422a-adb6-afc09b476ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:09.316794 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d10336-9b88-422a-adb6-afc09b476ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:09.317092 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d10336-9b88-422a-adb6-afc09b476ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:09.317360 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d10336-9b88-422a-adb6-afc09b476ac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:09.318364 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d10336-9b88-422a-adb6-afc09b476ac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:19:09.318707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d10336-9b88-422a-adb6-afc09b476ac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:09.320415 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d10336-9b88-422a-adb6-afc09b476ac5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:09.336445 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1392/2794] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:19:09.341047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69005575-5ecc-4d66-8870-707e22687220 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:09.350899 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69005575-5ecc-4d66-8870-707e22687220 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:09.365620 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760790f4-594a-4775-a9d4-1f607df48002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:09.366323 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760790f4-594a-4775-a9d4-1f607df48002 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:09.366610 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760790f4-594a-4775-a9d4-1f607df48002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:09.366893 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760790f4-594a-4775-a9d4-1f607df48002 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:09.367618 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760790f4-594a-4775-a9d4-1f607df48002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:09.369597 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760790f4-594a-4775-a9d4-1f607df48002 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:09.399958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1403/2795] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:19:09 2022] POST /identity/v3/projects => generated 363 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:19:09.406316 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d10336-9b88-422a-adb6-afc09b476ac5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:09.417503 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d10336-9b88-422a-adb6-afc09b476ac5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:09.421754 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:09.493977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2321f3-64d9-4f62-b029-f2fb8029c668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:09.494710 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2321f3-64d9-4f62-b029-f2fb8029c668 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:09.494944 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2321f3-64d9-4f62-b029-f2fb8029c668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:09.495217 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2321f3-64d9-4f62-b029-f2fb8029c668 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:09.495929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2321f3-64d9-4f62-b029-f2fb8029c668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:09.506205 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2321f3-64d9-4f62-b029-f2fb8029c668 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:09.532458 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1393/2796] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:19:09 2022] POST /identity/v3/users => generated 282 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:19:09.538978 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760790f4-594a-4775-a9d4-1f607df48002 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:09.555838 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760790f4-594a-4775-a9d4-1f607df48002 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:09.565949 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef046e-21b3-4286-8701-22228a6e17aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:09.568629 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef046e-21b3-4286-8701-22228a6e17aa admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:09.569056 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef046e-21b3-4286-8701-22228a6e17aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:09.569470 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef046e-21b3-4286-8701-22228a6e17aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:09.570706 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef046e-21b3-4286-8701-22228a6e17aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:09.573576 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef046e-21b3-4286-8701-22228a6e17aa admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:09.588406 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1404/2797] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:19:09.592642 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2321f3-64d9-4f62-b029-f2fb8029c668 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:09.604211 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2321f3-64d9-4f62-b029-f2fb8029c668 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:09.610822 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a68d87-9a77-4c73-97b5-795b080915f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:09.611930 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a68d87-9a77-4c73-97b5-795b080915f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:09.612229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a68d87-9a77-4c73-97b5-795b080915f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:09.612518 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a68d87-9a77-4c73-97b5-795b080915f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:09.613336 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a68d87-9a77-4c73-97b5-795b080915f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:09.615134 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a68d87-9a77-4c73-97b5-795b080915f3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:09.626605 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1394/2798] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:19:09.631369 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef046e-21b3-4286-8701-22228a6e17aa admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:09.646489 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef046e-21b3-4286-8701-22228a6e17aa admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:09.652906 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa780806-0ee0-4bac-b585-fd4aae9219fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:09.653877 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa780806-0ee0-4bac-b585-fd4aae9219fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:09.654165 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa780806-0ee0-4bac-b585-fd4aae9219fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:09.654441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa780806-0ee0-4bac-b585-fd4aae9219fd admin admin] PATH_INFO: `/v3/projects/95b556ea664b413fbfee9213e4e2fda7/users/c5711fb27c2a48fa9fe1a5a185c15913/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:09.672023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa780806-0ee0-4bac-b585-fd4aae9219fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b556ea664b413fbfee9213e4e2fda7, user_id=c5711fb27c2a48fa9fe1a5a185c15913, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:09.676637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa780806-0ee0-4bac-b585-fd4aae9219fd admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:09.696033 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1405/2799] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:19:09 2022] PUT /identity/v3/projects/95b556ea664b413fbfee9213e4e2fda7/users/c5711fb27c2a48fa9fe1a5a185c15913/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:09.707133 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5645bb-0fb8-4248-8f6a-06d55c6772a4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:09.707527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5645bb-0fb8-4248-8f6a-06d55c6772a4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:09.707686 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5645bb-0fb8-4248-8f6a-06d55c6772a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:09.739848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0a5645bb-0fb8-4248-8f6a-06d55c6772a4 None None] MFA Rules not processed for user `c5711fb27c2a48fa9fe1a5a185c15913`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:09.741833 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0a5645bb-0fb8-4248-8f6a-06d55c6772a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:09.839814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1395/2800] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:09.845377 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa780806-0ee0-4bac-b585-fd4aae9219fd admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:09.875513 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:09.962820 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa780806-0ee0-4bac-b585-fd4aae9219fd admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:09.971156 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9ec77-71cc-4337-ba5a-46671647180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:09.971864 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9ec77-71cc-4337-ba5a-46671647180c admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:09.972144 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9ec77-71cc-4337-ba5a-46671647180c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:09.972407 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9ec77-71cc-4337-ba5a-46671647180c admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:09.973115 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9ec77-71cc-4337-ba5a-46671647180c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:09.975688 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9ec77-71cc-4337-ba5a-46671647180c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:10.012730 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1406/2801] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:19:09 2022] POST /identity/v3/projects => generated 363 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:19:10.016878 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5645bb-0fb8-4248-8f6a-06d55c6772a4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:10.029089 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5645bb-0fb8-4248-8f6a-06d55c6772a4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:10.108316 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1642d-0629-4cc4-bbf5-09c15c793844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:10.109065 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1642d-0629-4cc4-bbf5-09c15c793844 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:10.109404 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1642d-0629-4cc4-bbf5-09c15c793844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:10.109757 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1642d-0629-4cc4-bbf5-09c15c793844 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:10.110726 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1642d-0629-4cc4-bbf5-09c15c793844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:10.113339 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1642d-0629-4cc4-bbf5-09c15c793844 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:10.140380 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1396/2802] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:19:10 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:19:10.144647 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9ec77-71cc-4337-ba5a-46671647180c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:10.156235 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9ec77-71cc-4337-ba5a-46671647180c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:10.161601 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb00abb-6fc9-4d5d-af08-fca54cfaf46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:10.162533 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb00abb-6fc9-4d5d-af08-fca54cfaf46b admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:10.162821 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb00abb-6fc9-4d5d-af08-fca54cfaf46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:10.163099 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb00abb-6fc9-4d5d-af08-fca54cfaf46b admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:10.163853 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb00abb-6fc9-4d5d-af08-fca54cfaf46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:10.165991 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb00abb-6fc9-4d5d-af08-fca54cfaf46b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:10.178607 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1407/2803] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:19:10.185514 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1642d-0629-4cc4-bbf5-09c15c793844 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:10.196589 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:10.201352 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1642d-0629-4cc4-bbf5-09c15c793844 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:10.216984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25078b31-de49-4857-bd34-a0e39879d023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:10.218065 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25078b31-de49-4857-bd34-a0e39879d023 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:10.218426 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25078b31-de49-4857-bd34-a0e39879d023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:10.218708 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25078b31-de49-4857-bd34-a0e39879d023 admin admin] PATH_INFO: `/v3/projects/71b01f8d47c947dd9320d157f8056a70/users/26749fc19ede4fb7897c6ba452ee33ef/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:10.243218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25078b31-de49-4857-bd34-a0e39879d023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71b01f8d47c947dd9320d157f8056a70, user_id=26749fc19ede4fb7897c6ba452ee33ef, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:10.245984 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25078b31-de49-4857-bd34-a0e39879d023 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:10.263286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1397/2804] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:19:10 2022] PUT /identity/v3/projects/71b01f8d47c947dd9320d157f8056a70/users/26749fc19ede4fb7897c6ba452ee33ef/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:10.271374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb00abb-6fc9-4d5d-af08-fca54cfaf46b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:10.285848 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb00abb-6fc9-4d5d-af08-fca54cfaf46b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:10.358123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef0528-6198-4389-be96-e82cfef6ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:10.358832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef0528-6198-4389-be96-e82cfef6ad49 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:10.359127 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef0528-6198-4389-be96-e82cfef6ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:10.359396 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef0528-6198-4389-be96-e82cfef6ad49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:10.360142 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef0528-6198-4389-be96-e82cfef6ad49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:10.361782 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef0528-6198-4389-be96-e82cfef6ad49 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:10.373578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1408/2805] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:19:10.378016 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25078b31-de49-4857-bd34-a0e39879d023 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:10.389834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25078b31-de49-4857-bd34-a0e39879d023 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:10.394920 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62525c4d-4eb9-44cf-8a79-94f9d51bc3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:10.395859 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62525c4d-4eb9-44cf-8a79-94f9d51bc3a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:10.396137 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62525c4d-4eb9-44cf-8a79-94f9d51bc3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:10.396411 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62525c4d-4eb9-44cf-8a79-94f9d51bc3a0 admin admin] PATH_INFO: `/v3/projects/71b01f8d47c947dd9320d157f8056a70/users/26749fc19ede4fb7897c6ba452ee33ef/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:10.398785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62525c4d-4eb9-44cf-8a79-94f9d51bc3a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71b01f8d47c947dd9320d157f8056a70, user_id=26749fc19ede4fb7897c6ba452ee33ef, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:10.401471 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62525c4d-4eb9-44cf-8a79-94f9d51bc3a0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:10.414622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1398/2806] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:19:10 2022] PUT /identity/v3/projects/71b01f8d47c947dd9320d157f8056a70/users/26749fc19ede4fb7897c6ba452ee33ef/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:19:10.426958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3c8f2-5889-4765-a237-f3dbb2c7eadb None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:10.428136 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3c8f2-5889-4765-a237-f3dbb2c7eadb None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:10.428446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3c8f2-5889-4765-a237-f3dbb2c7eadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:10.466349 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-56d3c8f2-5889-4765-a237-f3dbb2c7eadb None None] MFA Rules not processed for user `26749fc19ede4fb7897c6ba452ee33ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:10.467588 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-56d3c8f2-5889-4765-a237-f3dbb2c7eadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:10.574078 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1409/2807] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:10 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:10.586805 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62525c4d-4eb9-44cf-8a79-94f9d51bc3a0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:10.589239 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-62525c4d-4eb9-44cf-8a79-94f9d51bc3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:10.666860 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62525c4d-4eb9-44cf-8a79-94f9d51bc3a0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:10.671672 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a1c02-cad2-413d-b5aa-af21a98dd13b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:10.672353 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a1c02-cad2-413d-b5aa-af21a98dd13b service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:10.672636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a1c02-cad2-413d-b5aa-af21a98dd13b service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:10.672952 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a1c02-cad2-413d-b5aa-af21a98dd13b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:10.683783 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a1c02-cad2-413d-b5aa-af21a98dd13b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:10.685372 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a1c02-cad2-413d-b5aa-af21a98dd13b service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:10.695667 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1399/2808] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:19:10 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:10.786963 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3c8f2-5889-4765-a237-f3dbb2c7eadb None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:10.804198 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3c8f2-5889-4765-a237-f3dbb2c7eadb None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:10.808579 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b3ffa-9419-4801-b1f1-5afc2b4b925b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:10.809252 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b3ffa-9419-4801-b1f1-5afc2b4b925b service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:10.809540 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b3ffa-9419-4801-b1f1-5afc2b4b925b service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:10.810090 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b3ffa-9419-4801-b1f1-5afc2b4b925b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:10.815784 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:10.876307 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b3ffa-9419-4801-b1f1-5afc2b4b925b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:10.877694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b3ffa-9419-4801-b1f1-5afc2b4b925b service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:10.887602 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1410/2809] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:19:10 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:15.163818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a1c02-cad2-413d-b5aa-af21a98dd13b service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:15.165585 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c30a1c02-cad2-413d-b5aa-af21a98dd13b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:15.233851 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a1c02-cad2-413d-b5aa-af21a98dd13b service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:15.238220 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a913f-51f6-422f-8bae-75daf8c645e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:15.238901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a913f-51f6-422f-8bae-75daf8c645e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:15.239188 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a913f-51f6-422f-8bae-75daf8c645e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:15.239500 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a913f-51f6-422f-8bae-75daf8c645e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:15.241547 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-846a913f-51f6-422f-8bae-75daf8c645e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:15.252513 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a913f-51f6-422f-8bae-75daf8c645e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:15.254011 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a913f-51f6-422f-8bae-75daf8c645e3 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:15.263444 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1400/2810] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:19:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:19:17.246069 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b3ffa-9419-4801-b1f1-5afc2b4b925b service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:17.315164 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b3ffa-9419-4801-b1f1-5afc2b4b925b service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:17.320602 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be93227-f43e-42dd-9d08-e59e8c799369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:17.321277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be93227-f43e-42dd-9d08-e59e8c799369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:17.321560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be93227-f43e-42dd-9d08-e59e8c799369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:17.321861 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be93227-f43e-42dd-9d08-e59e8c799369 admin admin] PATH_INFO: `/v3/users/c5711fb27c2a48fa9fe1a5a185c15913` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:17.323122 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be93227-f43e-42dd-9d08-e59e8c799369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5711fb27c2a48fa9fe1a5a185c15913)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:17.325119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be93227-f43e-42dd-9d08-e59e8c799369 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:17.379348 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5be93227-f43e-42dd-9d08-e59e8c799369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5711fb27c2a48fa9fe1a5a185c15913'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:17.391619 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5be93227-f43e-42dd-9d08-e59e8c799369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5711fb27c2a48fa9fe1a5a185c15913'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:17.392337 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5be93227-f43e-42dd-9d08-e59e8c799369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5711fb27c2a48fa9fe1a5a185c15913'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:17.402151 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5be93227-f43e-42dd-9d08-e59e8c799369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5711fb27c2a48fa9fe1a5a185c15913'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:17.416162 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5be93227-f43e-42dd-9d08-e59e8c799369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5711fb27c2a48fa9fe1a5a185c15913'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:17.418610 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1411/2811] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:19:17 2022] DELETE /identity/v3/users/c5711fb27c2a48fa9fe1a5a185c15913 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:17.423294 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c841f-f6bf-475c-ba74-1907e1da8fdb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:17.423841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c841f-f6bf-475c-ba74-1907e1da8fdb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:17.423841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c841f-f6bf-475c-ba74-1907e1da8fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:17.441435 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b45c841f-f6bf-475c-ba74-1907e1da8fdb None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:17.442774 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b45c841f-f6bf-475c-ba74-1907e1da8fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:17.515508 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1401/2812] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:17.525842 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be93227-f43e-42dd-9d08-e59e8c799369 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:17.527658 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5be93227-f43e-42dd-9d08-e59e8c799369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:17.576578 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:17.614997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be93227-f43e-42dd-9d08-e59e8c799369 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:17.619018 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece47af4-cf9c-48ec-afee-125b3824a20d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:17.619692 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece47af4-cf9c-48ec-afee-125b3824a20d service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:17.619973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece47af4-cf9c-48ec-afee-125b3824a20d service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:17.620220 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece47af4-cf9c-48ec-afee-125b3824a20d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:17.635574 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece47af4-cf9c-48ec-afee-125b3824a20d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:17.637066 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece47af4-cf9c-48ec-afee-125b3824a20d service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:17.648781 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1412/2813] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:17.980968 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c841f-f6bf-475c-ba74-1907e1da8fdb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:17.983477 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b45c841f-f6bf-475c-ba74-1907e1da8fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:18.001155 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c841f-f6bf-475c-ba74-1907e1da8fdb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:18.010931 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714ed7b-7c31-4269-a41e-feba73c63961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:18.013325 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714ed7b-7c31-4269-a41e-feba73c63961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:18.013730 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714ed7b-7c31-4269-a41e-feba73c63961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:18.014318 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714ed7b-7c31-4269-a41e-feba73c63961 admin admin] PATH_INFO: `/v3/projects/95b556ea664b413fbfee9213e4e2fda7` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:18.016491 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714ed7b-7c31-4269-a41e-feba73c63961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95b556ea664b413fbfee9213e4e2fda7)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:18.018958 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714ed7b-7c31-4269-a41e-feba73c63961 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:18.033929 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:18.086130 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f714ed7b-7c31-4269-a41e-feba73c63961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95b556ea664b413fbfee9213e4e2fda7', 'request_id': 'req-f714ed7b-7c31-4269-a41e-feba73c63961'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:18.096126 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f714ed7b-7c31-4269-a41e-feba73c63961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95b556ea664b413fbfee9213e4e2fda7', 'request_id': 'req-f714ed7b-7c31-4269-a41e-feba73c63961'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:18.106473 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f714ed7b-7c31-4269-a41e-feba73c63961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95b556ea664b413fbfee9213e4e2fda7', 'request_id': 'req-f714ed7b-7c31-4269-a41e-feba73c63961'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:18.120803 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f714ed7b-7c31-4269-a41e-feba73c63961 admin admin] The token cache is being invalidate because project 95b556ea664b413fbfee9213e4e2fda7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:19:18.121232 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f714ed7b-7c31-4269-a41e-feba73c63961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:18.122039 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f714ed7b-7c31-4269-a41e-feba73c63961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:18.123888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1402/2814] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:19:17 2022] DELETE /identity/v3/projects/95b556ea664b413fbfee9213e4e2fda7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:18.128707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece47af4-cf9c-48ec-afee-125b3824a20d service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:18.139128 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece47af4-cf9c-48ec-afee-125b3824a20d service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:18.209038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478dcee-f3a4-4bd4-bef9-9d762aca709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:18.210171 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478dcee-f3a4-4bd4-bef9-9d762aca709b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:18.210480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478dcee-f3a4-4bd4-bef9-9d762aca709b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:18.210730 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478dcee-f3a4-4bd4-bef9-9d762aca709b admin admin] PATH_INFO: `/v3/users/26749fc19ede4fb7897c6ba452ee33ef` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:18.212241 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478dcee-f3a4-4bd4-bef9-9d762aca709b admin admin] RBAC: Authorizing `identity:delete_user(user_id=26749fc19ede4fb7897c6ba452ee33ef)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:18.214432 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478dcee-f3a4-4bd4-bef9-9d762aca709b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:18.268967 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-0478dcee-f3a4-4bd4-bef9-9d762aca709b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26749fc19ede4fb7897c6ba452ee33ef'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:18.282119 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-0478dcee-f3a4-4bd4-bef9-9d762aca709b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26749fc19ede4fb7897c6ba452ee33ef'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:18.282856 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-0478dcee-f3a4-4bd4-bef9-9d762aca709b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26749fc19ede4fb7897c6ba452ee33ef'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:18.292720 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-0478dcee-f3a4-4bd4-bef9-9d762aca709b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26749fc19ede4fb7897c6ba452ee33ef'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:18.300466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-0478dcee-f3a4-4bd4-bef9-9d762aca709b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26749fc19ede4fb7897c6ba452ee33ef'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:18.307170 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1413/2815] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:19:18 2022] DELETE /identity/v3/users/26749fc19ede4fb7897c6ba452ee33ef => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:18.635202 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714ed7b-7c31-4269-a41e-feba73c63961 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:18.637723 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f714ed7b-7c31-4269-a41e-feba73c63961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:18.643718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478dcee-f3a4-4bd4-bef9-9d762aca709b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:18.646157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0478dcee-f3a4-4bd4-bef9-9d762aca709b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:18.714633 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:18.731166 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714ed7b-7c31-4269-a41e-feba73c63961 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:18.740776 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478dcee-f3a4-4bd4-bef9-9d762aca709b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:18.746038 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5689e-0d66-47c0-a785-5194c857fca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:18.747524 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5689e-0d66-47c0-a785-5194c857fca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:18.747813 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5689e-0d66-47c0-a785-5194c857fca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:18.748095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5689e-0d66-47c0-a785-5194c857fca4 admin admin] PATH_INFO: `/v3/projects/71b01f8d47c947dd9320d157f8056a70` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:18.749839 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5689e-0d66-47c0-a785-5194c857fca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71b01f8d47c947dd9320d157f8056a70)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:18.751323 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5689e-0d66-47c0-a785-5194c857fca4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:18.801724 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8a4df-375a-4766-9f26-151a83f99cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:18.802550 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8a4df-375a-4766-9f26-151a83f99cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:18.803026 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8a4df-375a-4766-9f26-151a83f99cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:18.803303 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8a4df-375a-4766-9f26-151a83f99cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:18.805296 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7cf8a4df-375a-4766-9f26-151a83f99cf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:18.819187 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8a4df-375a-4766-9f26-151a83f99cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:18.820743 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8a4df-375a-4766-9f26-151a83f99cf0 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:18.822787 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-faa5689e-0d66-47c0-a785-5194c857fca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71b01f8d47c947dd9320d157f8056a70', 'request_id': 'req-faa5689e-0d66-47c0-a785-5194c857fca4'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:18.829193 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-faa5689e-0d66-47c0-a785-5194c857fca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71b01f8d47c947dd9320d157f8056a70', 'request_id': 'req-faa5689e-0d66-47c0-a785-5194c857fca4'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:18.830412 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1403/2816] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:19:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:18.839815 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-faa5689e-0d66-47c0-a785-5194c857fca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71b01f8d47c947dd9320d157f8056a70', 'request_id': 'req-faa5689e-0d66-47c0-a785-5194c857fca4'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:18.855805 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-faa5689e-0d66-47c0-a785-5194c857fca4 admin admin] The token cache is being invalidate because project 71b01f8d47c947dd9320d157f8056a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:19:18.856184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-faa5689e-0d66-47c0-a785-5194c857fca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:18.856895 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-faa5689e-0d66-47c0-a785-5194c857fca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:18.858586 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1414/2817] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:19:18 2022] DELETE /identity/v3/projects/71b01f8d47c947dd9320d157f8056a70 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:18.863914 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb051f8-d7c5-406e-9d18-eb0bba0271bf None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:18.864276 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb051f8-d7c5-406e-9d18-eb0bba0271bf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:18.864677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb051f8-d7c5-406e-9d18-eb0bba0271bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:18.884366 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0fb051f8-d7c5-406e-9d18-eb0bba0271bf None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:18.885925 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0fb051f8-d7c5-406e-9d18-eb0bba0271bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:18.912441 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5689e-0d66-47c0-a785-5194c857fca4 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:18.914032 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-faa5689e-0d66-47c0-a785-5194c857fca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:18.944943 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:18.968375 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1404/2818] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:19:18.970442 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bec607-8225-4988-ad81-18ea84b6337d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:18.971094 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bec607-8225-4988-ad81-18ea84b6337d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:18.971457 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bec607-8225-4988-ad81-18ea84b6337d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:18.982215 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5689e-0d66-47c0-a785-5194c857fca4 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:18.986058 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1ef7b-a871-41e3-bb9a-b6c2142dda2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:18.986720 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1ef7b-a871-41e3-bb9a-b6c2142dda2e service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:18.987003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1ef7b-a871-41e3-bb9a-b6c2142dda2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:18.987276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1ef7b-a871-41e3-bb9a-b6c2142dda2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:18.989512 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3ca1ef7b-a871-41e3-bb9a-b6c2142dda2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:18.991985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-55bec607-8225-4988-ad81-18ea84b6337d None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:18.993160 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-55bec607-8225-4988-ad81-18ea84b6337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:19.001661 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1405/2819] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:19.005784 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bec607-8225-4988-ad81-18ea84b6337d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:19.015192 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bec607-8225-4988-ad81-18ea84b6337d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:19.020254 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57436eb-a896-4945-802b-2a396c037680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:19.021299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57436eb-a896-4945-802b-2a396c037680 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:19.021582 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57436eb-a896-4945-802b-2a396c037680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:19.021884 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57436eb-a896-4945-802b-2a396c037680 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:19.022610 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57436eb-a896-4945-802b-2a396c037680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:19:19.022916 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57436eb-a896-4945-802b-2a396c037680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:19.024535 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57436eb-a896-4945-802b-2a396c037680 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:19.040914 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1406/2820] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 21:19:19.042664 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57436eb-a896-4945-802b-2a396c037680 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:19.054186 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57436eb-a896-4945-802b-2a396c037680 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:19.059681 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b88b5-ccb5-428b-bb85-a3d089c36fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:19.060541 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b88b5-ccb5-428b-bb85-a3d089c36fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:19.060919 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b88b5-ccb5-428b-bb85-a3d089c36fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:19.061291 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b88b5-ccb5-428b-bb85-a3d089c36fb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:19.062178 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b88b5-ccb5-428b-bb85-a3d089c36fb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:19.064168 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b88b5-ccb5-428b-bb85-a3d089c36fb5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:19.066317 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1ef7b-a871-41e3-bb9a-b6c2142dda2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:19.067854 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1ef7b-a871-41e3-bb9a-b6c2142dda2e service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:19.079722 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1415/2821] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:19:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:19:19.097619 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1407/2822] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:19:19 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:19:19.103653 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1ef7b-a871-41e3-bb9a-b6c2142dda2e service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:19.117187 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1ef7b-a871-41e3-bb9a-b6c2142dda2e service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:19.143286 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:19.158789 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b88b5-ccb5-428b-bb85-a3d089c36fb5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:19.161132 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5d6b88b5-ccb5-428b-bb85-a3d089c36fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:19.195093 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afa113-9e27-4ea3-a031-42ac3c03a5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:19.195909 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afa113-9e27-4ea3-a031-42ac3c03a5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:19.196220 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afa113-9e27-4ea3-a031-42ac3c03a5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:19.196495 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afa113-9e27-4ea3-a031-42ac3c03a5f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:19.197210 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afa113-9e27-4ea3-a031-42ac3c03a5f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:19.199285 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afa113-9e27-4ea3-a031-42ac3c03a5f2 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:19.221421 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1416/2823] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:19:19 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:19:19.226101 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afa113-9e27-4ea3-a031-42ac3c03a5f2 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:19.236932 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afa113-9e27-4ea3-a031-42ac3c03a5f2 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:19.243249 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376554c-58be-4bcb-9614-a0ebaaf1baaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:19.244172 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b88b5-ccb5-428b-bb85-a3d089c36fb5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:19.244328 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376554c-58be-4bcb-9614-a0ebaaf1baaf admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:19.244328 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376554c-58be-4bcb-9614-a0ebaaf1baaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:19.244676 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376554c-58be-4bcb-9614-a0ebaaf1baaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:19.245694 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376554c-58be-4bcb-9614-a0ebaaf1baaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:19.247295 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376554c-58be-4bcb-9614-a0ebaaf1baaf admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:19.250318 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbe0a8-dec7-4f7b-accc-7baefb1038c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8952f35c21c4a2eaf1fbc601fe76242', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:19.251001 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbe0a8-dec7-4f7b-accc-7baefb1038c3 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:19.251283 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbe0a8-dec7-4f7b-accc-7baefb1038c3 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:19.251557 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbe0a8-dec7-4f7b-accc-7baefb1038c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:19.253611 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4cfbe0a8-dec7-4f7b-accc-7baefb1038c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:19.260230 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1417/2824] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:19:19.265103 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376554c-58be-4bcb-9614-a0ebaaf1baaf admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:19.268448 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbe0a8-dec7-4f7b-accc-7baefb1038c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:19.270375 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbe0a8-dec7-4f7b-accc-7baefb1038c3 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:19.275876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376554c-58be-4bcb-9614-a0ebaaf1baaf admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:19.281116 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe123c-ec40-4f9b-aada-d6b279bf72d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:19.281840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe123c-ec40-4f9b-aada-d6b279bf72d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:19.282131 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe123c-ec40-4f9b-aada-d6b279bf72d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:19.282416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe123c-ec40-4f9b-aada-d6b279bf72d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:19.282549 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1408/2825] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:19:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:19.283163 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe123c-ec40-4f9b-aada-d6b279bf72d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:19.284801 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe123c-ec40-4f9b-aada-d6b279bf72d6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:19.296147 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1418/2826] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:19:19.300640 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbe0a8-dec7-4f7b-accc-7baefb1038c3 service placement] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:19.314281 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbe0a8-dec7-4f7b-accc-7baefb1038c3 service placement] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:19.319701 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc16dc-18e5-4fec-8626-de9ea780c5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:19.320651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc16dc-18e5-4fec-8626-de9ea780c5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:19.320930 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc16dc-18e5-4fec-8626-de9ea780c5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:19.321297 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc16dc-18e5-4fec-8626-de9ea780c5a9 admin admin] PATH_INFO: `/v3/projects/4f436029a27c4bdb9e2042943d961ecc/users/b9d0002842ad4856b6015612e0648bc7/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:19.340864 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc16dc-18e5-4fec-8626-de9ea780c5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f436029a27c4bdb9e2042943d961ecc, user_id=b9d0002842ad4856b6015612e0648bc7, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:19.343669 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc16dc-18e5-4fec-8626-de9ea780c5a9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:19.360770 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1409/2827] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:19:19 2022] PUT /identity/v3/projects/4f436029a27c4bdb9e2042943d961ecc/users/b9d0002842ad4856b6015612e0648bc7/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 21:19:19.373170 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc4b31-92d8-4766-9533-d03f2daba3c7 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:19.373521 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc4b31-92d8-4766-9533-d03f2daba3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:19.373727 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc4b31-92d8-4766-9533-d03f2daba3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:19.404783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-83dc4b31-92d8-4766-9533-d03f2daba3c7 None None] MFA Rules not processed for user `b9d0002842ad4856b6015612e0648bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:19.406091 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-83dc4b31-92d8-4766-9533-d03f2daba3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:19.486505 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1419/2828] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:19.491320 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc16dc-18e5-4fec-8626-de9ea780c5a9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:19.584587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc16dc-18e5-4fec-8626-de9ea780c5a9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:19.591460 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e346a-192c-43d8-9564-a6b24dc1bfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:19.592158 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e346a-192c-43d8-9564-a6b24dc1bfe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:19.592437 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e346a-192c-43d8-9564-a6b24dc1bfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:19.592717 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e346a-192c-43d8-9564-a6b24dc1bfe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:19.593427 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e346a-192c-43d8-9564-a6b24dc1bfe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:19.595436 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e346a-192c-43d8-9564-a6b24dc1bfe8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:19.626627 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1410/2829] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:19:19 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:19:19.630992 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc4b31-92d8-4766-9533-d03f2daba3c7 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:19.643983 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc4b31-92d8-4766-9533-d03f2daba3c7 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:19.712483 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25633b-d24c-49f2-bae4-cb0a88a085e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:19.713196 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25633b-d24c-49f2-bae4-cb0a88a085e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:19.713480 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25633b-d24c-49f2-bae4-cb0a88a085e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:19.713754 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25633b-d24c-49f2-bae4-cb0a88a085e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:19.714538 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25633b-d24c-49f2-bae4-cb0a88a085e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:19.716499 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25633b-d24c-49f2-bae4-cb0a88a085e0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:19.741976 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1420/2830] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:19:19 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:19:19.743486 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e346a-192c-43d8-9564-a6b24dc1bfe8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:19.750961 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:19.756693 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e346a-192c-43d8-9564-a6b24dc1bfe8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:19.771869 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacd115-a472-4d55-bcc8-afa0ddf61951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:19.772734 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacd115-a472-4d55-bcc8-afa0ddf61951 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:19.773019 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacd115-a472-4d55-bcc8-afa0ddf61951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:19.773285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacd115-a472-4d55-bcc8-afa0ddf61951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:19.774095 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacd115-a472-4d55-bcc8-afa0ddf61951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:19.775823 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacd115-a472-4d55-bcc8-afa0ddf61951 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:19.789692 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1411/2831] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:19:19.794191 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25633b-d24c-49f2-bae4-cb0a88a085e0 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:19.805336 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25633b-d24c-49f2-bae4-cb0a88a085e0 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:19.813275 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e519040-1a61-4a9a-a629-ce2f71bccf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:19.814026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e519040-1a61-4a9a-a629-ce2f71bccf81 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:19.814495 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e519040-1a61-4a9a-a629-ce2f71bccf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:19.814779 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e519040-1a61-4a9a-a629-ce2f71bccf81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:19.815591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e519040-1a61-4a9a-a629-ce2f71bccf81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:19.817221 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e519040-1a61-4a9a-a629-ce2f71bccf81 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:19.819273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:19.835062 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1421/2832] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:19:19.835975 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacd115-a472-4d55-bcc8-afa0ddf61951 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:19.849152 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacd115-a472-4d55-bcc8-afa0ddf61951 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:19.854480 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a21d4-3204-49a6-b6ef-27e44fa283ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:19.855409 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a21d4-3204-49a6-b6ef-27e44fa283ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:19.855698 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a21d4-3204-49a6-b6ef-27e44fa283ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:19.856131 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a21d4-3204-49a6-b6ef-27e44fa283ca admin admin] PATH_INFO: `/v3/projects/a5f32cefe36d43f1a5aea03ec9919365/users/3700a111ac314b77bb61193e6114b038/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:19.873784 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a21d4-3204-49a6-b6ef-27e44fa283ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f32cefe36d43f1a5aea03ec9919365, user_id=3700a111ac314b77bb61193e6114b038, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:19.876540 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a21d4-3204-49a6-b6ef-27e44fa283ca admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:19.891950 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1412/2833] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:19:19 2022] PUT /identity/v3/projects/a5f32cefe36d43f1a5aea03ec9919365/users/3700a111ac314b77bb61193e6114b038/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:19.903747 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aacdf6-9c5c-4e40-a2ba-706b51e45feb None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:19.903969 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aacdf6-9c5c-4e40-a2ba-706b51e45feb None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:19.904253 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aacdf6-9c5c-4e40-a2ba-706b51e45feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:19.936858 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d9aacdf6-9c5c-4e40-a2ba-706b51e45feb None None] MFA Rules not processed for user `3700a111ac314b77bb61193e6114b038`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:19.938180 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d9aacdf6-9c5c-4e40-a2ba-706b51e45feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:20.044892 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1422/2834] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:20.049565 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a21d4-3204-49a6-b6ef-27e44fa283ca admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:20.129646 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a21d4-3204-49a6-b6ef-27e44fa283ca admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:20.138018 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90e875-c659-483f-a778-02b2a281aad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:20.138716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90e875-c659-483f-a778-02b2a281aad4 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:20.138994 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90e875-c659-483f-a778-02b2a281aad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:20.139264 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90e875-c659-483f-a778-02b2a281aad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:20.139974 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90e875-c659-483f-a778-02b2a281aad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:20.141905 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90e875-c659-483f-a778-02b2a281aad4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:20.172631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1413/2835] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:19:20 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:19:20.176997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aacdf6-9c5c-4e40-a2ba-706b51e45feb None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:20.189088 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aacdf6-9c5c-4e40-a2ba-706b51e45feb None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:20.262183 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e2643-99f9-483f-838a-76d91fd5216c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:20.263269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2643-99f9-483f-838a-76d91fd5216c admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:20.263269 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2643-99f9-483f-838a-76d91fd5216c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:20.263537 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2643-99f9-483f-838a-76d91fd5216c admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:20.264243 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e2643-99f9-483f-838a-76d91fd5216c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:20.266225 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e2643-99f9-483f-838a-76d91fd5216c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:20.297280 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1423/2836] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:19:20 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:19:20.302784 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90e875-c659-483f-a778-02b2a281aad4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:20.318054 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90e875-c659-483f-a778-02b2a281aad4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:20.322947 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b62c4-f9f4-411a-9cf8-5a623b5f1654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:20.324286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b62c4-f9f4-411a-9cf8-5a623b5f1654 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:20.324286 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b62c4-f9f4-411a-9cf8-5a623b5f1654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:20.324897 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b62c4-f9f4-411a-9cf8-5a623b5f1654 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:20.325179 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b62c4-f9f4-411a-9cf8-5a623b5f1654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:20.327331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b62c4-f9f4-411a-9cf8-5a623b5f1654 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:20.339212 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1414/2837] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:19:20.344761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e2643-99f9-483f-838a-76d91fd5216c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:20.355824 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e2643-99f9-483f-838a-76d91fd5216c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:20.360568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cb825-d62f-4937-8cbd-2ea80b8ac38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:20.361528 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cb825-d62f-4937-8cbd-2ea80b8ac38c admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:20.361778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cb825-d62f-4937-8cbd-2ea80b8ac38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:20.362083 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cb825-d62f-4937-8cbd-2ea80b8ac38c admin admin] PATH_INFO: `/v3/projects/31dd878009494787ba87a0fab66894d1/users/460803f7914f4a879c1da76a40dca997/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:20.378491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cb825-d62f-4937-8cbd-2ea80b8ac38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=31dd878009494787ba87a0fab66894d1, user_id=460803f7914f4a879c1da76a40dca997, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:20.382522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cb825-d62f-4937-8cbd-2ea80b8ac38c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:20.401323 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1424/2838] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:19:20 2022] PUT /identity/v3/projects/31dd878009494787ba87a0fab66894d1/users/460803f7914f4a879c1da76a40dca997/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:20.405583 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b62c4-f9f4-411a-9cf8-5a623b5f1654 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:20.417280 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b62c4-f9f4-411a-9cf8-5a623b5f1654 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:20.484866 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e8f36-7f06-48a4-bd38-25fd6f21e511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:20.485651 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e8f36-7f06-48a4-bd38-25fd6f21e511 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:20.485977 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e8f36-7f06-48a4-bd38-25fd6f21e511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:20.486258 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e8f36-7f06-48a4-bd38-25fd6f21e511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:20.487115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e8f36-7f06-48a4-bd38-25fd6f21e511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:20.489658 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e8f36-7f06-48a4-bd38-25fd6f21e511 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:20.504106 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1415/2839] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:19:20.505533 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cb825-d62f-4937-8cbd-2ea80b8ac38c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:20.516736 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cb825-d62f-4937-8cbd-2ea80b8ac38c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:20.521876 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb9ecf-0749-4d6d-b71d-1b1d7e549c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:20.522974 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb9ecf-0749-4d6d-b71d-1b1d7e549c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:20.523260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb9ecf-0749-4d6d-b71d-1b1d7e549c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:20.523561 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb9ecf-0749-4d6d-b71d-1b1d7e549c0e admin admin] PATH_INFO: `/v3/projects/31dd878009494787ba87a0fab66894d1/users/460803f7914f4a879c1da76a40dca997/roles/aefba81d87bf47258c17064af7d9a05f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:20.525718 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb9ecf-0749-4d6d-b71d-1b1d7e549c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31dd878009494787ba87a0fab66894d1, user_id=460803f7914f4a879c1da76a40dca997, role_id=aefba81d87bf47258c17064af7d9a05f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:20.528473 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb9ecf-0749-4d6d-b71d-1b1d7e549c0e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:20.540775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1425/2840] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:19:20 2022] PUT /identity/v3/projects/31dd878009494787ba87a0fab66894d1/users/460803f7914f4a879c1da76a40dca997/roles/aefba81d87bf47258c17064af7d9a05f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:20.551577 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d1727-fece-4885-a668-49ff15907040 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:20.552061 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d1727-fece-4885-a668-49ff15907040 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:20.553005 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d1727-fece-4885-a668-49ff15907040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:20.586738 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-226d1727-fece-4885-a668-49ff15907040 None None] MFA Rules not processed for user `460803f7914f4a879c1da76a40dca997`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:20.587985 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-226d1727-fece-4885-a668-49ff15907040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:20.621163 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:20.665738 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1416/2841] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 21:19:20.678462 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb9ecf-0749-4d6d-b71d-1b1d7e549c0e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:20.680649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3acb9ecf-0749-4d6d-b71d-1b1d7e549c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:20.727067 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:20.745591 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb9ecf-0749-4d6d-b71d-1b1d7e549c0e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:20.749731 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b4fe1-02db-4a79-afb7-93ce9f53adef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:20.750421 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b4fe1-02db-4a79-afb7-93ce9f53adef service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:20.750702 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b4fe1-02db-4a79-afb7-93ce9f53adef service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:20.750974 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b4fe1-02db-4a79-afb7-93ce9f53adef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:20.760851 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b4fe1-02db-4a79-afb7-93ce9f53adef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:20.762365 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b4fe1-02db-4a79-afb7-93ce9f53adef service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:20.773154 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1426/2842] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:19:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:20.818188 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d1727-fece-4885-a668-49ff15907040 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:20.819772 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-226d1727-fece-4885-a668-49ff15907040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:20.836042 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d1727-fece-4885-a668-49ff15907040 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:20.840374 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63113996-3c6b-4217-8ebe-d3ad6f7fb279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:20.841127 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63113996-3c6b-4217-8ebe-d3ad6f7fb279 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:20.841461 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63113996-3c6b-4217-8ebe-d3ad6f7fb279 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:20.841996 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63113996-3c6b-4217-8ebe-d3ad6f7fb279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:20.907802 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63113996-3c6b-4217-8ebe-d3ad6f7fb279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:20.909259 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63113996-3c6b-4217-8ebe-d3ad6f7fb279 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:20.919191 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1417/2843] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:19:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:23.873086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b4fe1-02db-4a79-afb7-93ce9f53adef service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:23.951341 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b4fe1-02db-4a79-afb7-93ce9f53adef service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:23.956542 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0dd11-f188-491f-b289-f4a0090ffdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:23.957448 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0dd11-f188-491f-b289-f4a0090ffdce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:23.957734 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0dd11-f188-491f-b289-f4a0090ffdce admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:23.958052 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0dd11-f188-491f-b289-f4a0090ffdce admin admin] PATH_INFO: `/v3/users/b9d0002842ad4856b6015612e0648bc7` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:23.959322 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0dd11-f188-491f-b289-f4a0090ffdce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d0002842ad4856b6015612e0648bc7)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:23.961298 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0dd11-f188-491f-b289-f4a0090ffdce admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:24.012566 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-12b0dd11-f188-491f-b289-f4a0090ffdce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d0002842ad4856b6015612e0648bc7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:24.026788 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-12b0dd11-f188-491f-b289-f4a0090ffdce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d0002842ad4856b6015612e0648bc7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:24.027651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-12b0dd11-f188-491f-b289-f4a0090ffdce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d0002842ad4856b6015612e0648bc7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:24.039100 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-12b0dd11-f188-491f-b289-f4a0090ffdce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d0002842ad4856b6015612e0648bc7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:24.047901 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-12b0dd11-f188-491f-b289-f4a0090ffdce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d0002842ad4856b6015612e0648bc7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:24.054157 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1427/2844] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:19:23 2022] DELETE /identity/v3/users/b9d0002842ad4856b6015612e0648bc7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:24.059002 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd84dc6-2702-418e-9d23-c61161c51f34 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:24.059506 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd84dc6-2702-418e-9d23-c61161c51f34 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:24.059604 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd84dc6-2702-418e-9d23-c61161c51f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:24.078502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bbd84dc6-2702-418e-9d23-c61161c51f34 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:24.079709 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bbd84dc6-2702-418e-9d23-c61161c51f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:24.153504 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1418/2845] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:24.163693 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0dd11-f188-491f-b289-f4a0090ffdce admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:24.165261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-12b0dd11-f188-491f-b289-f4a0090ffdce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:24.229220 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0dd11-f188-491f-b289-f4a0090ffdce admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:24.235401 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c52e0-f78c-4840-98f1-c7c5e4e603c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:24.236494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c52e0-f78c-4840-98f1-c7c5e4e603c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:24.236956 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c52e0-f78c-4840-98f1-c7c5e4e603c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:24.237491 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c52e0-f78c-4840-98f1-c7c5e4e603c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:24.254219 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c52e0-f78c-4840-98f1-c7c5e4e603c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:24.257083 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c52e0-f78c-4840-98f1-c7c5e4e603c1 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:24.275688 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1428/2846] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:19:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:24.583732 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd84dc6-2702-418e-9d23-c61161c51f34 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:24.585277 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bbd84dc6-2702-418e-9d23-c61161c51f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:24.598539 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd84dc6-2702-418e-9d23-c61161c51f34 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:24.604868 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:24.605786 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:24.606097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:24.606370 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad admin admin] PATH_INFO: `/v3/projects/4f436029a27c4bdb9e2042943d961ecc` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:24.607819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f436029a27c4bdb9e2042943d961ecc)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:24.611363 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:24.670475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f436029a27c4bdb9e2042943d961ecc', 'request_id': 'req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:24.681110 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f436029a27c4bdb9e2042943d961ecc', 'request_id': 'req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:24.684009 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:24.691897 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f436029a27c4bdb9e2042943d961ecc', 'request_id': 'req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:24.709164 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad admin admin] The token cache is being invalidate because project 4f436029a27c4bdb9e2042943d961ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:19:24.709164 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:24.709164 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:24.709756 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1419/2847] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:19:24 2022] DELETE /identity/v3/projects/4f436029a27c4bdb9e2042943d961ecc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:24.713754 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c52e0-f78c-4840-98f1-c7c5e4e603c1 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:24.719507 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:24.727052 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c52e0-f78c-4840-98f1-c7c5e4e603c1 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:24.796255 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0ce79-2275-4dad-9598-7606fa9a5492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:24.797367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0ce79-2275-4dad-9598-7606fa9a5492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:24.797654 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0ce79-2275-4dad-9598-7606fa9a5492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:24.797969 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0ce79-2275-4dad-9598-7606fa9a5492 admin admin] PATH_INFO: `/v3/users/3700a111ac314b77bb61193e6114b038` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:24.799234 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0ce79-2275-4dad-9598-7606fa9a5492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3700a111ac314b77bb61193e6114b038)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:24.801193 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0ce79-2275-4dad-9598-7606fa9a5492 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:24.855674 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-45e0ce79-2275-4dad-9598-7606fa9a5492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3700a111ac314b77bb61193e6114b038'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:24.869973 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-45e0ce79-2275-4dad-9598-7606fa9a5492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3700a111ac314b77bb61193e6114b038'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:24.870763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-45e0ce79-2275-4dad-9598-7606fa9a5492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3700a111ac314b77bb61193e6114b038'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:24.880843 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-45e0ce79-2275-4dad-9598-7606fa9a5492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3700a111ac314b77bb61193e6114b038'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:24.889141 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-45e0ce79-2275-4dad-9598-7606fa9a5492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3700a111ac314b77bb61193e6114b038'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:24.898032 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1429/2848] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:19:24 2022] DELETE /identity/v3/users/3700a111ac314b77bb61193e6114b038 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:25.219193 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:25.221372 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:25.244418 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69efdd-f7c0-47a5-a9a8-01c5560873ad admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:25.308908 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:25.309775 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:25.310223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:25.310559 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c admin admin] PATH_INFO: `/v3/projects/a5f32cefe36d43f1a5aea03ec9919365` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:25.312049 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f32cefe36d43f1a5aea03ec9919365)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:25.314007 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:25.400395 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f32cefe36d43f1a5aea03ec9919365', 'request_id': 'req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:25.412609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f32cefe36d43f1a5aea03ec9919365', 'request_id': 'req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:25.421417 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f32cefe36d43f1a5aea03ec9919365', 'request_id': 'req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:25.435717 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c admin admin] The token cache is being invalidate because project a5f32cefe36d43f1a5aea03ec9919365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:19:25.436006 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:25.437142 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:25.439832 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1420/2849] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:19:25 2022] DELETE /identity/v3/projects/a5f32cefe36d43f1a5aea03ec9919365 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:25.445499 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0ce79-2275-4dad-9598-7606fa9a5492 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:25.447182 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-45e0ce79-2275-4dad-9598-7606fa9a5492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:25.462118 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0ce79-2275-4dad-9598-7606fa9a5492 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:25.534016 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d03ec7-99fe-4db2-9564-e0bf57a35d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:25.534933 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d03ec7-99fe-4db2-9564-e0bf57a35d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:25.535217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d03ec7-99fe-4db2-9564-e0bf57a35d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:25.535490 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d03ec7-99fe-4db2-9564-e0bf57a35d7d admin admin] PATH_INFO: `/v3/users/460803f7914f4a879c1da76a40dca997` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:25.536835 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d03ec7-99fe-4db2-9564-e0bf57a35d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=460803f7914f4a879c1da76a40dca997)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:25.538842 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d03ec7-99fe-4db2-9564-e0bf57a35d7d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:25.565170 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:25.600610 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f7d03ec7-99fe-4db2-9564-e0bf57a35d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460803f7914f4a879c1da76a40dca997'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:25.618962 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f7d03ec7-99fe-4db2-9564-e0bf57a35d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460803f7914f4a879c1da76a40dca997'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:25.619847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f7d03ec7-99fe-4db2-9564-e0bf57a35d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460803f7914f4a879c1da76a40dca997'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:25.630404 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f7d03ec7-99fe-4db2-9564-e0bf57a35d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460803f7914f4a879c1da76a40dca997'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:25.637443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f7d03ec7-99fe-4db2-9564-e0bf57a35d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460803f7914f4a879c1da76a40dca997'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:25.646414 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1430/2850] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:19:25 2022] DELETE /identity/v3/users/460803f7914f4a879c1da76a40dca997 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:25.946365 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:25.948042 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:25.964383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2810c3-ac08-461b-b128-c8bc85f5bc6c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:26.029139 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bfe2d-dd96-4e2e-a5d6-3dc3e7330dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:26.030067 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bfe2d-dd96-4e2e-a5d6-3dc3e7330dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:26.030342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bfe2d-dd96-4e2e-a5d6-3dc3e7330dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:26.030609 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bfe2d-dd96-4e2e-a5d6-3dc3e7330dc8 admin admin] PATH_INFO: `/v3/projects/31dd878009494787ba87a0fab66894d1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:26.031908 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bfe2d-dd96-4e2e-a5d6-3dc3e7330dc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31dd878009494787ba87a0fab66894d1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:26.033842 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bfe2d-dd96-4e2e-a5d6-3dc3e7330dc8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:26.056471 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:26.086450 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-589bfe2d-dd96-4e2e-a5d6-3dc3e7330dc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31dd878009494787ba87a0fab66894d1', 'request_id': 'req-589bfe2d-dd96-4e2e-a5d6-3dc3e7330dc8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:26.095871 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-589bfe2d-dd96-4e2e-a5d6-3dc3e7330dc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31dd878009494787ba87a0fab66894d1', 'request_id': 'req-589bfe2d-dd96-4e2e-a5d6-3dc3e7330dc8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:26.103234 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-589bfe2d-dd96-4e2e-a5d6-3dc3e7330dc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31dd878009494787ba87a0fab66894d1', 'request_id': 'req-589bfe2d-dd96-4e2e-a5d6-3dc3e7330dc8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:26.114475 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-589bfe2d-dd96-4e2e-a5d6-3dc3e7330dc8 admin admin] The token cache is being invalidate because project 31dd878009494787ba87a0fab66894d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:19:26.114749 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-589bfe2d-dd96-4e2e-a5d6-3dc3e7330dc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:26.115485 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-589bfe2d-dd96-4e2e-a5d6-3dc3e7330dc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:26.117105 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1421/2851] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:19:25 2022] DELETE /identity/v3/projects/31dd878009494787ba87a0fab66894d1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:26.126178 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dd408-e1a6-4e39-ad6f-fcd80410049a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:26.127036 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dd408-e1a6-4e39-ad6f-fcd80410049a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:26.127036 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dd408-e1a6-4e39-ad6f-fcd80410049a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:26.149685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-c83dd408-e1a6-4e39-ad6f-fcd80410049a None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:26.150923 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c83dd408-e1a6-4e39-ad6f-fcd80410049a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:26.214174 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1431/2852] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:26.224466 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b758c98-d84a-4721-a95f-c6a68c034dff None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:26.224990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b758c98-d84a-4721-a95f-c6a68c034dff None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:26.224990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b758c98-d84a-4721-a95f-c6a68c034dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:26.243915 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0b758c98-d84a-4721-a95f-c6a68c034dff None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:26.245115 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0b758c98-d84a-4721-a95f-c6a68c034dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:26.253640 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1422/2853] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:26.258110 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dd408-e1a6-4e39-ad6f-fcd80410049a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:26.269355 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dd408-e1a6-4e39-ad6f-fcd80410049a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:26.275139 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f4443-977b-418d-852f-133a12807849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:26.275810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f4443-977b-418d-852f-133a12807849 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:26.276094 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f4443-977b-418d-852f-133a12807849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:26.276359 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f4443-977b-418d-852f-133a12807849 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:26.277353 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f4443-977b-418d-852f-133a12807849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:19:26.277668 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f4443-977b-418d-852f-133a12807849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:26.279335 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f4443-977b-418d-852f-133a12807849 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:26.292212 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1432/2854] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:19:26.298450 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b758c98-d84a-4721-a95f-c6a68c034dff None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:26.312589 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b758c98-d84a-4721-a95f-c6a68c034dff None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:26.318392 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88964a-c16d-4000-84f7-20e31e5cd42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:26.319053 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88964a-c16d-4000-84f7-20e31e5cd42f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:26.319327 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88964a-c16d-4000-84f7-20e31e5cd42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:26.319598 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88964a-c16d-4000-84f7-20e31e5cd42f admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:26.320289 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88964a-c16d-4000-84f7-20e31e5cd42f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:26.322223 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88964a-c16d-4000-84f7-20e31e5cd42f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:26.351489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1423/2855] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:19:26 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:19:26.355697 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f4443-977b-418d-852f-133a12807849 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:26.366680 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f4443-977b-418d-852f-133a12807849 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:26.426560 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945e2b2-15cf-42b1-a0ea-33fbf9895cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:26.427248 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945e2b2-15cf-42b1-a0ea-33fbf9895cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:26.427531 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945e2b2-15cf-42b1-a0ea-33fbf9895cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:26.427810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945e2b2-15cf-42b1-a0ea-33fbf9895cfb admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:26.428516 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945e2b2-15cf-42b1-a0ea-33fbf9895cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:26.430495 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945e2b2-15cf-42b1-a0ea-33fbf9895cfb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:26.451911 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1433/2856] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:19:26 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:19:26.457457 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88964a-c16d-4000-84f7-20e31e5cd42f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:26.473282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88964a-c16d-4000-84f7-20e31e5cd42f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:26.479831 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4cdb-a809-4f03-8c07-a637dd56e3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:26.480508 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4cdb-a809-4f03-8c07-a637dd56e3bb admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:26.480830 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4cdb-a809-4f03-8c07-a637dd56e3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:26.481067 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4cdb-a809-4f03-8c07-a637dd56e3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:26.481835 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d4cdb-a809-4f03-8c07-a637dd56e3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:26.483913 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d4cdb-a809-4f03-8c07-a637dd56e3bb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:26.494979 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1424/2857] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 21:19:26.499745 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945e2b2-15cf-42b1-a0ea-33fbf9895cfb admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:26.510536 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945e2b2-15cf-42b1-a0ea-33fbf9895cfb admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:26.516774 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311015a4-b13c-4d22-90b9-bffe193b436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:26.517450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311015a4-b13c-4d22-90b9-bffe193b436c admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:26.517735 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311015a4-b13c-4d22-90b9-bffe193b436c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:26.518050 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311015a4-b13c-4d22-90b9-bffe193b436c admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:26.518791 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311015a4-b13c-4d22-90b9-bffe193b436c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:26.520430 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311015a4-b13c-4d22-90b9-bffe193b436c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:26.531140 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1434/2858] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:19:26.535527 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4cdb-a809-4f03-8c07-a637dd56e3bb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:26.546265 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4cdb-a809-4f03-8c07-a637dd56e3bb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:26.551297 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa77f9-6cfb-434b-8747-96af18cb9705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:26.552190 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa77f9-6cfb-434b-8747-96af18cb9705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:26.552474 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa77f9-6cfb-434b-8747-96af18cb9705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:26.552744 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa77f9-6cfb-434b-8747-96af18cb9705 admin admin] PATH_INFO: `/v3/projects/9f9758b8401e45d9ad918e6aee3959d9/users/2efbde1f9c724e6489e5462e07fd56e0/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:26.570696 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa77f9-6cfb-434b-8747-96af18cb9705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9758b8401e45d9ad918e6aee3959d9, user_id=2efbde1f9c724e6489e5462e07fd56e0, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:26.574841 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa77f9-6cfb-434b-8747-96af18cb9705 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:26.593907 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1425/2859] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:19:26 2022] PUT /identity/v3/projects/9f9758b8401e45d9ad918e6aee3959d9/users/2efbde1f9c724e6489e5462e07fd56e0/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:26.606261 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d15b65-c58a-4c26-8b60-1faddd8ee53a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:26.606498 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d15b65-c58a-4c26-8b60-1faddd8ee53a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:26.606914 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d15b65-c58a-4c26-8b60-1faddd8ee53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:26.625730 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:26.642763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-61d15b65-c58a-4c26-8b60-1faddd8ee53a None None] MFA Rules not processed for user `2efbde1f9c724e6489e5462e07fd56e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:26.644687 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-61d15b65-c58a-4c26-8b60-1faddd8ee53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:26.713032 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1435/2860] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:26.728859 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa77f9-6cfb-434b-8747-96af18cb9705 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:26.730690 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cbaa77f9-6cfb-434b-8747-96af18cb9705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:26.797010 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa77f9-6cfb-434b-8747-96af18cb9705 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:26.799938 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dc31d-b72b-4101-bc58-1c0f11da1f9f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7e1c8c42cd4f6dab8b27829e5fc5ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:26.800603 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dc31d-b72b-4101-bc58-1c0f11da1f9f service glance] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:26.800876 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dc31d-b72b-4101-bc58-1c0f11da1f9f service glance] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:26.801160 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dc31d-b72b-4101-bc58-1c0f11da1f9f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:26.809727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dc31d-b72b-4101-bc58-1c0f11da1f9f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:26.811313 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dc31d-b72b-4101-bc58-1c0f11da1f9f service glance] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:26.821285 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1426/2861] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:19:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:36.709653 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=29 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:36.816219 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:41.386184 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d15b65-c58a-4c26-8b60-1faddd8ee53a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:41.452857 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d15b65-c58a-4c26-8b60-1faddd8ee53a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:41.457922 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00868a0c-02d6-49e8-be05-47b1b27e8cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:41.458810 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00868a0c-02d6-49e8-be05-47b1b27e8cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:41.459086 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00868a0c-02d6-49e8-be05-47b1b27e8cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:41.459356 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00868a0c-02d6-49e8-be05-47b1b27e8cd1 admin admin] PATH_INFO: `/v3/users/2efbde1f9c724e6489e5462e07fd56e0` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:41.460547 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00868a0c-02d6-49e8-be05-47b1b27e8cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2efbde1f9c724e6489e5462e07fd56e0)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:41.462526 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00868a0c-02d6-49e8-be05-47b1b27e8cd1 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:41.517046 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-00868a0c-02d6-49e8-be05-47b1b27e8cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2efbde1f9c724e6489e5462e07fd56e0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:41.529808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-00868a0c-02d6-49e8-be05-47b1b27e8cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2efbde1f9c724e6489e5462e07fd56e0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:41.530564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-00868a0c-02d6-49e8-be05-47b1b27e8cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2efbde1f9c724e6489e5462e07fd56e0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:41.539556 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-00868a0c-02d6-49e8-be05-47b1b27e8cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2efbde1f9c724e6489e5462e07fd56e0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:41.546983 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-00868a0c-02d6-49e8-be05-47b1b27e8cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2efbde1f9c724e6489e5462e07fd56e0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:41.552990 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1436/2862] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:19:41 2022] DELETE /identity/v3/users/2efbde1f9c724e6489e5462e07fd56e0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:41.557630 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de48f5c-814b-4ad0-aa41-43a0d5d54818 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:41.558185 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de48f5c-814b-4ad0-aa41-43a0d5d54818 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:41.558294 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de48f5c-814b-4ad0-aa41-43a0d5d54818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:41.576455 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3de48f5c-814b-4ad0-aa41-43a0d5d54818 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:41.577672 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3de48f5c-814b-4ad0-aa41-43a0d5d54818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:41.646331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1427/2863] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:41.657098 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00868a0c-02d6-49e8-be05-47b1b27e8cd1 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:41.658611 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-00868a0c-02d6-49e8-be05-47b1b27e8cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:41.726765 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00868a0c-02d6-49e8-be05-47b1b27e8cd1 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:41.730807 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572f526-b49e-4803-b73a-18feef20fbe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:41.731471 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572f526-b49e-4803-b73a-18feef20fbe2 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:41.731745 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572f526-b49e-4803-b73a-18feef20fbe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:41.732005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572f526-b49e-4803-b73a-18feef20fbe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:41.742753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572f526-b49e-4803-b73a-18feef20fbe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:41.744226 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572f526-b49e-4803-b73a-18feef20fbe2 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:41.755055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1437/2864] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:42.068933 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de48f5c-814b-4ad0-aa41-43a0d5d54818 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:42.070500 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3de48f5c-814b-4ad0-aa41-43a0d5d54818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:42.083853 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de48f5c-814b-4ad0-aa41-43a0d5d54818 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:42.094898 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb201a-afab-4746-bed4-9992306dd39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:42.096082 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb201a-afab-4746-bed4-9992306dd39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:42.097677 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb201a-afab-4746-bed4-9992306dd39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:42.098048 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb201a-afab-4746-bed4-9992306dd39a admin admin] PATH_INFO: `/v3/projects/9f9758b8401e45d9ad918e6aee3959d9` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:42.099331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb201a-afab-4746-bed4-9992306dd39a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f9758b8401e45d9ad918e6aee3959d9)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:42.101254 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb201a-afab-4746-bed4-9992306dd39a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:42.151780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c2fb201a-afab-4746-bed4-9992306dd39a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f9758b8401e45d9ad918e6aee3959d9', 'request_id': 'req-c2fb201a-afab-4746-bed4-9992306dd39a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:42.161467 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c2fb201a-afab-4746-bed4-9992306dd39a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f9758b8401e45d9ad918e6aee3959d9', 'request_id': 'req-c2fb201a-afab-4746-bed4-9992306dd39a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:42.168899 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c2fb201a-afab-4746-bed4-9992306dd39a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f9758b8401e45d9ad918e6aee3959d9', 'request_id': 'req-c2fb201a-afab-4746-bed4-9992306dd39a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:42.180820 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c2fb201a-afab-4746-bed4-9992306dd39a admin admin] The token cache is being invalidate because project 9f9758b8401e45d9ad918e6aee3959d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:19:42.181154 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c2fb201a-afab-4746-bed4-9992306dd39a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:42.181814 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c2fb201a-afab-4746-bed4-9992306dd39a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:42.183442 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1428/2865] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:19:42 2022] DELETE /identity/v3/projects/9f9758b8401e45d9ad918e6aee3959d9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:42.188649 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ad93b-6c01-400b-aa3c-27bad13593e1 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:42.188948 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ad93b-6c01-400b-aa3c-27bad13593e1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:42.189217 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ad93b-6c01-400b-aa3c-27bad13593e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:42.209003 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-876ad93b-6c01-400b-aa3c-27bad13593e1 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:42.210259 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-876ad93b-6c01-400b-aa3c-27bad13593e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:42.228213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:42.274962 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1438/2866] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:42.286553 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dd71b-c935-481d-996b-51979f8db7e3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:42.286840 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dd71b-c935-481d-996b-51979f8db7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:42.287143 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dd71b-c935-481d-996b-51979f8db7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:42.306153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-040dd71b-c935-481d-996b-51979f8db7e3 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:42.307399 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-040dd71b-c935-481d-996b-51979f8db7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:42.315664 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1429/2867] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:42.320793 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ad93b-6c01-400b-aa3c-27bad13593e1 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:42.332031 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ad93b-6c01-400b-aa3c-27bad13593e1 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:42.336764 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1d891-963a-444a-9af1-4d1aef2ac9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:42.337429 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1d891-963a-444a-9af1-4d1aef2ac9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:42.337752 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1d891-963a-444a-9af1-4d1aef2ac9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:42.338048 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1d891-963a-444a-9af1-4d1aef2ac9f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:42.338783 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1d891-963a-444a-9af1-4d1aef2ac9f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:19:42.339095 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1d891-963a-444a-9af1-4d1aef2ac9f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:42.340743 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1d891-963a-444a-9af1-4d1aef2ac9f9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:42.354699 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1439/2868] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:19:42.359091 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dd71b-c935-481d-996b-51979f8db7e3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:42.369902 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dd71b-c935-481d-996b-51979f8db7e3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:42.374848 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837c7db-969d-453a-87cf-2e59731f3886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:42.375523 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837c7db-969d-453a-87cf-2e59731f3886 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:42.375807 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837c7db-969d-453a-87cf-2e59731f3886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:42.376075 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837c7db-969d-453a-87cf-2e59731f3886 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:42.376782 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837c7db-969d-453a-87cf-2e59731f3886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:42.378925 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837c7db-969d-453a-87cf-2e59731f3886 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:42.408672 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1430/2869] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:19:42 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:19:42.414339 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1d891-963a-444a-9af1-4d1aef2ac9f9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:42.428465 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1d891-963a-444a-9af1-4d1aef2ac9f9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:42.492517 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8556dd-42fb-4f92-9709-7fd0a8a00c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:42.493209 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8556dd-42fb-4f92-9709-7fd0a8a00c55 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:42.493496 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8556dd-42fb-4f92-9709-7fd0a8a00c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:42.493773 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8556dd-42fb-4f92-9709-7fd0a8a00c55 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:42.494510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8556dd-42fb-4f92-9709-7fd0a8a00c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:42.496452 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8556dd-42fb-4f92-9709-7fd0a8a00c55 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:42.519696 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1440/2870] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:19:42 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:19:42.524342 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837c7db-969d-453a-87cf-2e59731f3886 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:42.539238 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837c7db-969d-453a-87cf-2e59731f3886 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:42.545884 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5c857-b337-4dd3-867f-65fe47d0b016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:42.546807 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5c857-b337-4dd3-867f-65fe47d0b016 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:42.547296 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5c857-b337-4dd3-867f-65fe47d0b016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:42.547727 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5c857-b337-4dd3-867f-65fe47d0b016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:42.548785 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5c857-b337-4dd3-867f-65fe47d0b016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:42.551017 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5c857-b337-4dd3-867f-65fe47d0b016 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:42.563028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1431/2871] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:19:42.567988 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8556dd-42fb-4f92-9709-7fd0a8a00c55 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:42.582842 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8556dd-42fb-4f92-9709-7fd0a8a00c55 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:42.589430 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff439384-743f-44d1-aa19-ab6f380235cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:42.590525 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff439384-743f-44d1-aa19-ab6f380235cd admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:42.590943 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff439384-743f-44d1-aa19-ab6f380235cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:42.591205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff439384-743f-44d1-aa19-ab6f380235cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:42.592333 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff439384-743f-44d1-aa19-ab6f380235cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:42.594637 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff439384-743f-44d1-aa19-ab6f380235cd admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:42.609416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1441/2872] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:19:42.614752 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5c857-b337-4dd3-867f-65fe47d0b016 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:42.630088 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5c857-b337-4dd3-867f-65fe47d0b016 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:42.635725 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291968ed-c8b7-4403-b006-9c364f85c367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:42.636623 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291968ed-c8b7-4403-b006-9c364f85c367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:42.636911 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291968ed-c8b7-4403-b006-9c364f85c367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:42.637209 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291968ed-c8b7-4403-b006-9c364f85c367 admin admin] PATH_INFO: `/v3/projects/d4f0fb63629b4191ab032e11944d2d67/users/079e36ff3dce4ab1bfed5d3160ceb39d/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:42.653153 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291968ed-c8b7-4403-b006-9c364f85c367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f0fb63629b4191ab032e11944d2d67, user_id=079e36ff3dce4ab1bfed5d3160ceb39d, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:42.655846 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291968ed-c8b7-4403-b006-9c364f85c367 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:42.673386 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1432/2873] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:19:42 2022] PUT /identity/v3/projects/d4f0fb63629b4191ab032e11944d2d67/users/079e36ff3dce4ab1bfed5d3160ceb39d/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:42.684893 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb05d4d-01c2-4825-a6f2-68a2eee2643e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:42.685320 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb05d4d-01c2-4825-a6f2-68a2eee2643e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:42.685593 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb05d4d-01c2-4825-a6f2-68a2eee2643e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:42.716712 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-5eb05d4d-01c2-4825-a6f2-68a2eee2643e None None] MFA Rules not processed for user `079e36ff3dce4ab1bfed5d3160ceb39d`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:42.718007 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5eb05d4d-01c2-4825-a6f2-68a2eee2643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:42.787375 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1442/2874] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:42.798150 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291968ed-c8b7-4403-b006-9c364f85c367 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:42.800085 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-291968ed-c8b7-4403-b006-9c364f85c367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:42.831075 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:42.869396 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291968ed-c8b7-4403-b006-9c364f85c367 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:42.873209 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168202b-5e99-4509-833c-1b68af2b2b4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:42.873900 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168202b-5e99-4509-833c-1b68af2b2b4e service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:42.874207 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168202b-5e99-4509-833c-1b68af2b2b4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:42.874632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168202b-5e99-4509-833c-1b68af2b2b4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:42.885135 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168202b-5e99-4509-833c-1b68af2b2b4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:42.886638 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168202b-5e99-4509-833c-1b68af2b2b4e service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:42.896140 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1433/2875] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:19:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:46.020180 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb05d4d-01c2-4825-a6f2-68a2eee2643e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:46.043420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:46.088794 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb05d4d-01c2-4825-a6f2-68a2eee2643e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:46.093372 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f24f69-c840-42a0-bded-17617707b7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:46.094287 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f24f69-c840-42a0-bded-17617707b7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:46.094566 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f24f69-c840-42a0-bded-17617707b7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:46.094840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f24f69-c840-42a0-bded-17617707b7a8 admin admin] PATH_INFO: `/v3/users/079e36ff3dce4ab1bfed5d3160ceb39d` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:46.096088 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f24f69-c840-42a0-bded-17617707b7a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=079e36ff3dce4ab1bfed5d3160ceb39d)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:46.098047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f24f69-c840-42a0-bded-17617707b7a8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:46.162084 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-82f24f69-c840-42a0-bded-17617707b7a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '079e36ff3dce4ab1bfed5d3160ceb39d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:46.176040 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-82f24f69-c840-42a0-bded-17617707b7a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '079e36ff3dce4ab1bfed5d3160ceb39d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:46.176778 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-82f24f69-c840-42a0-bded-17617707b7a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '079e36ff3dce4ab1bfed5d3160ceb39d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:46.185186 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-82f24f69-c840-42a0-bded-17617707b7a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '079e36ff3dce4ab1bfed5d3160ceb39d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:46.194420 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-82f24f69-c840-42a0-bded-17617707b7a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '079e36ff3dce4ab1bfed5d3160ceb39d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:46.202428 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1443/2876] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:19:46 2022] DELETE /identity/v3/users/079e36ff3dce4ab1bfed5d3160ceb39d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:46.207631 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb33e8-1683-40cf-b7fd-30538303effe None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:46.208160 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb33e8-1683-40cf-b7fd-30538303effe None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:46.208160 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb33e8-1683-40cf-b7fd-30538303effe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:46.228387 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b2bb33e8-1683-40cf-b7fd-30538303effe None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:46.229672 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b2bb33e8-1683-40cf-b7fd-30538303effe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:46.302293 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1434/2877] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:46.312494 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f24f69-c840-42a0-bded-17617707b7a8 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:46.314443 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-82f24f69-c840-42a0-bded-17617707b7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:46.374602 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f24f69-c840-42a0-bded-17617707b7a8 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:46.378636 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c62486-3bf3-4c3a-afc2-581ab289874c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:46.379276 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c62486-3bf3-4c3a-afc2-581ab289874c service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:46.379565 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c62486-3bf3-4c3a-afc2-581ab289874c service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:46.379840 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c62486-3bf3-4c3a-afc2-581ab289874c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:46.389412 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c62486-3bf3-4c3a-afc2-581ab289874c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:46.390912 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c62486-3bf3-4c3a-afc2-581ab289874c service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:46.400642 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1444/2878] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:19:46.685090 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb33e8-1683-40cf-b7fd-30538303effe None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:46.686618 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b2bb33e8-1683-40cf-b7fd-30538303effe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:46.701782 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb33e8-1683-40cf-b7fd-30538303effe None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:46.708590 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770536f5-55f1-4f37-9d7e-6537104a40e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:46.709579 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770536f5-55f1-4f37-9d7e-6537104a40e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:46.709899 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770536f5-55f1-4f37-9d7e-6537104a40e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:46.710380 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770536f5-55f1-4f37-9d7e-6537104a40e3 admin admin] PATH_INFO: `/v3/projects/d4f0fb63629b4191ab032e11944d2d67` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:46.711729 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770536f5-55f1-4f37-9d7e-6537104a40e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f0fb63629b4191ab032e11944d2d67)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:46.713908 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770536f5-55f1-4f37-9d7e-6537104a40e3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:46.779102 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-770536f5-55f1-4f37-9d7e-6537104a40e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f0fb63629b4191ab032e11944d2d67', 'request_id': 'req-770536f5-55f1-4f37-9d7e-6537104a40e3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:46.789069 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-770536f5-55f1-4f37-9d7e-6537104a40e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f0fb63629b4191ab032e11944d2d67', 'request_id': 'req-770536f5-55f1-4f37-9d7e-6537104a40e3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:46.797085 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-770536f5-55f1-4f37-9d7e-6537104a40e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f0fb63629b4191ab032e11944d2d67', 'request_id': 'req-770536f5-55f1-4f37-9d7e-6537104a40e3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:46.809477 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-770536f5-55f1-4f37-9d7e-6537104a40e3 admin admin] The token cache is being invalidate because project d4f0fb63629b4191ab032e11944d2d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:19:46.809711 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-770536f5-55f1-4f37-9d7e-6537104a40e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:46.810489 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-770536f5-55f1-4f37-9d7e-6537104a40e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:19:46.812156 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1435/2879] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:19:46 2022] DELETE /identity/v3/projects/d4f0fb63629b4191ab032e11944d2d67 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:46.817622 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b227d-6452-499d-a775-345f359fa0d7 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:46.817952 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b227d-6452-499d-a775-345f359fa0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:46.818229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b227d-6452-499d-a775-345f359fa0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:46.837977 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f11b227d-6452-499d-a775-345f359fa0d7 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:46.839379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f11b227d-6452-499d-a775-345f359fa0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:46.875977 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:46.910390 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1445/2880] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:46.918847 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de5dec-bbe5-4743-8435-71876c3edab2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:46.919135 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de5dec-bbe5-4743-8435-71876c3edab2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:46.919413 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de5dec-bbe5-4743-8435-71876c3edab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:46.939340 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-09de5dec-bbe5-4743-8435-71876c3edab2 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:46.940606 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-09de5dec-bbe5-4743-8435-71876c3edab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:46.950016 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1436/2881] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:46.954769 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b227d-6452-499d-a775-345f359fa0d7 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:46.967205 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b227d-6452-499d-a775-345f359fa0d7 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:46.972177 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcec718-4e36-462e-bcd8-2525ac17d69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:46.972847 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcec718-4e36-462e-bcd8-2525ac17d69a admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:46.973129 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcec718-4e36-462e-bcd8-2525ac17d69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:46.973404 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcec718-4e36-462e-bcd8-2525ac17d69a admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:46.974172 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcec718-4e36-462e-bcd8-2525ac17d69a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:19:46.974478 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcec718-4e36-462e-bcd8-2525ac17d69a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:46.976188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcec718-4e36-462e-bcd8-2525ac17d69a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:46.991054 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1446/2882] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:19:46.995576 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de5dec-bbe5-4743-8435-71876c3edab2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:47.005321 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de5dec-bbe5-4743-8435-71876c3edab2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:47.012101 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bf60d-b697-4630-933d-473efc465d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:47.013218 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bf60d-b697-4630-933d-473efc465d2f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:47.013704 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bf60d-b697-4630-933d-473efc465d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:47.014257 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bf60d-b697-4630-933d-473efc465d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:47.015305 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7bf60d-b697-4630-933d-473efc465d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:47.017418 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7bf60d-b697-4630-933d-473efc465d2f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:47.046049 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1437/2883] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:19:46 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:19:47.051430 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcec718-4e36-462e-bcd8-2525ac17d69a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:47.062770 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcec718-4e36-462e-bcd8-2525ac17d69a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:47.123083 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64e20f-2310-404b-b15f-70190243fabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:47.123780 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64e20f-2310-404b-b15f-70190243fabe admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:47.124055 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64e20f-2310-404b-b15f-70190243fabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:47.124362 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64e20f-2310-404b-b15f-70190243fabe admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:47.125084 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64e20f-2310-404b-b15f-70190243fabe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:47.127522 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64e20f-2310-404b-b15f-70190243fabe admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:47.149309 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1447/2884] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:19:47 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:19:47.153741 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bf60d-b697-4630-933d-473efc465d2f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:47.164642 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bf60d-b697-4630-933d-473efc465d2f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:47.176857 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75458a8-a577-4ea7-8fd6-4b62392ef125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:47.177636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75458a8-a577-4ea7-8fd6-4b62392ef125 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:47.177952 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75458a8-a577-4ea7-8fd6-4b62392ef125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:47.178229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75458a8-a577-4ea7-8fd6-4b62392ef125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:47.178971 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75458a8-a577-4ea7-8fd6-4b62392ef125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:47.180588 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75458a8-a577-4ea7-8fd6-4b62392ef125 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:47.192612 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1438/2885] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:19:47.197466 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64e20f-2310-404b-b15f-70190243fabe admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:47.213167 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64e20f-2310-404b-b15f-70190243fabe admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:47.218305 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4b673-55e7-4c95-b726-8291a837e099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:47.218983 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b673-55e7-4c95-b726-8291a837e099 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:47.219265 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b673-55e7-4c95-b726-8291a837e099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:47.219548 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b673-55e7-4c95-b726-8291a837e099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:47.220284 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4b673-55e7-4c95-b726-8291a837e099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:47.222210 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4b673-55e7-4c95-b726-8291a837e099 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:47.233313 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1448/2886] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:19:47.239065 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75458a8-a577-4ea7-8fd6-4b62392ef125 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:47.254878 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75458a8-a577-4ea7-8fd6-4b62392ef125 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:47.260385 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b19fb-2fdf-4ef8-b3e0-f5a83288ccc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:47.261282 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b19fb-2fdf-4ef8-b3e0-f5a83288ccc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:47.261562 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b19fb-2fdf-4ef8-b3e0-f5a83288ccc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:47.261867 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b19fb-2fdf-4ef8-b3e0-f5a83288ccc2 admin admin] PATH_INFO: `/v3/projects/3fccd0e6d3f145e2a68e32c88bd80a3e/users/1fa958d0759143409614ef107aa87af3/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:47.264524 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:47.284415 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b19fb-2fdf-4ef8-b3e0-f5a83288ccc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fccd0e6d3f145e2a68e32c88bd80a3e, user_id=1fa958d0759143409614ef107aa87af3, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:47.289706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b19fb-2fdf-4ef8-b3e0-f5a83288ccc2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:47.308662 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1439/2887] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:19:47 2022] PUT /identity/v3/projects/3fccd0e6d3f145e2a68e32c88bd80a3e/users/1fa958d0759143409614ef107aa87af3/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:19:47.320872 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432abf1-8044-4497-a492-60fd7013480f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:47.321092 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432abf1-8044-4497-a492-60fd7013480f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:47.321374 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432abf1-8044-4497-a492-60fd7013480f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:47.354271 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0432abf1-8044-4497-a492-60fd7013480f None None] MFA Rules not processed for user `1fa958d0759143409614ef107aa87af3`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:19:47.355632 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0432abf1-8044-4497-a492-60fd7013480f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:47.425306 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1449/2888] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:19:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:19:47.436828 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b19fb-2fdf-4ef8-b3e0-f5a83288ccc2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:19:47.438716 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-158b19fb-2fdf-4ef8-b3e0-f5a83288ccc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:19:47.501587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b19fb-2fdf-4ef8-b3e0-f5a83288ccc2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:19:47.505593 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba5d59-35e3-4c0a-804b-adec2e4e3a0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:19:47.506289 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba5d59-35e3-4c0a-804b-adec2e4e3a0c service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:19:47.506574 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba5d59-35e3-4c0a-804b-adec2e4e3a0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:19:47.506844 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba5d59-35e3-4c0a-804b-adec2e4e3a0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:19:47.515875 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba5d59-35e3-4c0a-804b-adec2e4e3a0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:19:47.517326 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba5d59-35e3-4c0a-804b-adec2e4e3a0c service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:19:47.527094 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1440/2889] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:19:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 21:19:57.422323 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:57.523048 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:16.771711 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432abf1-8044-4497-a492-60fd7013480f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:16.884639 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432abf1-8044-4497-a492-60fd7013480f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:16.890808 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f773df6-6214-453e-9c25-f0338c477114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:16.891712 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f773df6-6214-453e-9c25-f0338c477114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:16.891996 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f773df6-6214-453e-9c25-f0338c477114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:16.892273 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f773df6-6214-453e-9c25-f0338c477114 admin admin] PATH_INFO: `/v3/users/1fa958d0759143409614ef107aa87af3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:16.893546 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f773df6-6214-453e-9c25-f0338c477114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa958d0759143409614ef107aa87af3)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:16.895564 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f773df6-6214-453e-9c25-f0338c477114 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:16.951673 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6f773df6-6214-453e-9c25-f0338c477114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa958d0759143409614ef107aa87af3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:16.963761 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6f773df6-6214-453e-9c25-f0338c477114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa958d0759143409614ef107aa87af3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:16.964510 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6f773df6-6214-453e-9c25-f0338c477114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa958d0759143409614ef107aa87af3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:16.973467 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6f773df6-6214-453e-9c25-f0338c477114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa958d0759143409614ef107aa87af3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:16.981047 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6f773df6-6214-453e-9c25-f0338c477114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa958d0759143409614ef107aa87af3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:16.988200 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1450/2890] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:20:16 2022] DELETE /identity/v3/users/1fa958d0759143409614ef107aa87af3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:16.995589 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf2403-43a2-4636-90c9-3c467bb05bbb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:16.996161 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf2403-43a2-4636-90c9-3c467bb05bbb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:16.996615 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf2403-43a2-4636-90c9-3c467bb05bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:17.055736 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ccaf2403-43a2-4636-90c9-3c467bb05bbb None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:17.056958 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ccaf2403-43a2-4636-90c9-3c467bb05bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:17.122528 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1441/2891] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:17.133123 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f773df6-6214-453e-9c25-f0338c477114 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:17.135791 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6f773df6-6214-453e-9c25-f0338c477114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:17.184335 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:17.241103 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f773df6-6214-453e-9c25-f0338c477114 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:17.245169 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb330ebe-59f3-4b30-8a60-53229a63ee14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:17.245832 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb330ebe-59f3-4b30-8a60-53229a63ee14 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:17.246141 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb330ebe-59f3-4b30-8a60-53229a63ee14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:17.246419 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb330ebe-59f3-4b30-8a60-53229a63ee14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:17.256602 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb330ebe-59f3-4b30-8a60-53229a63ee14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:17.258013 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb330ebe-59f3-4b30-8a60-53229a63ee14 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:17.268562 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1451/2892] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:20:17.557229 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf2403-43a2-4636-90c9-3c467bb05bbb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:17.558765 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ccaf2403-43a2-4636-90c9-3c467bb05bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:17.571138 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf2403-43a2-4636-90c9-3c467bb05bbb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:17.577447 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f0847-d28c-4474-a117-f6ff2737a3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:17.578706 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f0847-d28c-4474-a117-f6ff2737a3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:17.578990 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f0847-d28c-4474-a117-f6ff2737a3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:17.579297 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f0847-d28c-4474-a117-f6ff2737a3ce admin admin] PATH_INFO: `/v3/projects/3fccd0e6d3f145e2a68e32c88bd80a3e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:17.580502 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f0847-d28c-4474-a117-f6ff2737a3ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fccd0e6d3f145e2a68e32c88bd80a3e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:17.583626 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f0847-d28c-4474-a117-f6ff2737a3ce admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:17.643271 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-307f0847-d28c-4474-a117-f6ff2737a3ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fccd0e6d3f145e2a68e32c88bd80a3e', 'request_id': 'req-307f0847-d28c-4474-a117-f6ff2737a3ce'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:17.652299 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-307f0847-d28c-4474-a117-f6ff2737a3ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fccd0e6d3f145e2a68e32c88bd80a3e', 'request_id': 'req-307f0847-d28c-4474-a117-f6ff2737a3ce'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:17.659112 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-307f0847-d28c-4474-a117-f6ff2737a3ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fccd0e6d3f145e2a68e32c88bd80a3e', 'request_id': 'req-307f0847-d28c-4474-a117-f6ff2737a3ce'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:17.669501 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-307f0847-d28c-4474-a117-f6ff2737a3ce admin admin] The token cache is being invalidate because project 3fccd0e6d3f145e2a68e32c88bd80a3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:20:17.669780 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-307f0847-d28c-4474-a117-f6ff2737a3ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:17.670450 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-307f0847-d28c-4474-a117-f6ff2737a3ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:17.672007 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1442/2893] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:20:17 2022] DELETE /identity/v3/projects/3fccd0e6d3f145e2a68e32c88bd80a3e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:17.676987 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cda36e-37a1-4cdc-8742-130a3e765be0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:17.677274 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cda36e-37a1-4cdc-8742-130a3e765be0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:17.677551 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cda36e-37a1-4cdc-8742-130a3e765be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:17.697026 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-01cda36e-37a1-4cdc-8742-130a3e765be0 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:17.698247 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-01cda36e-37a1-4cdc-8742-130a3e765be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:17.760676 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1452/2894] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:17.768806 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14624324-a7d7-47d2-b66a-719351cfce88 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:17.769097 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14624324-a7d7-47d2-b66a-719351cfce88 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:17.769378 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14624324-a7d7-47d2-b66a-719351cfce88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:17.788427 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-14624324-a7d7-47d2-b66a-719351cfce88 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:17.789616 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-14624324-a7d7-47d2-b66a-719351cfce88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:17.798887 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1443/2895] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:17.806023 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cda36e-37a1-4cdc-8742-130a3e765be0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:17.816152 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cda36e-37a1-4cdc-8742-130a3e765be0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:17.822516 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6bd6c-3093-4322-bf5c-cc334511d3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:17.823198 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6bd6c-3093-4322-bf5c-cc334511d3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:17.823507 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6bd6c-3093-4322-bf5c-cc334511d3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:17.823775 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6bd6c-3093-4322-bf5c-cc334511d3e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:17.824514 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6bd6c-3093-4322-bf5c-cc334511d3e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 21:20:17.824858 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6bd6c-3093-4322-bf5c-cc334511d3e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:17.827111 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6bd6c-3093-4322-bf5c-cc334511d3e4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:17.839230 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1453/2896] 10.222.0.61 () {58 vars in 1152 bytes} [Thu May 26 21:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 21:20:17.844505 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14624324-a7d7-47d2-b66a-719351cfce88 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:17.860315 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14624324-a7d7-47d2-b66a-719351cfce88 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:17.868871 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2a441-0cbe-4c3e-aa57-6018cf88bd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:17.869839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2a441-0cbe-4c3e-aa57-6018cf88bd4b admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:17.870233 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2a441-0cbe-4c3e-aa57-6018cf88bd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:17.870634 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2a441-0cbe-4c3e-aa57-6018cf88bd4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:17.871739 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2a441-0cbe-4c3e-aa57-6018cf88bd4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:17.874149 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2a441-0cbe-4c3e-aa57-6018cf88bd4b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:17.905901 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1444/2897] 10.222.0.61 () {60 vars in 1152 bytes} [Thu May 26 21:20:17 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 21:20:17.910204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6bd6c-3093-4322-bf5c-cc334511d3e4 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:17.920713 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6bd6c-3093-4322-bf5c-cc334511d3e4 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:17.980916 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848aab84-1976-431f-bfbc-12f807733159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:17.981850 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aab84-1976-431f-bfbc-12f807733159 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:17.982202 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aab84-1976-431f-bfbc-12f807733159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:17.982544 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aab84-1976-431f-bfbc-12f807733159 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:17.983373 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848aab84-1976-431f-bfbc-12f807733159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:17.985425 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848aab84-1976-431f-bfbc-12f807733159 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:18.010963 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1454/2898] 10.222.0.61 () {60 vars in 1143 bytes} [Thu May 26 21:20:17 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 21:20:18.012251 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2a441-0cbe-4c3e-aa57-6018cf88bd4b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:18.023625 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2a441-0cbe-4c3e-aa57-6018cf88bd4b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:18.029016 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e2699-3170-408e-899c-e04d1d02a52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:18.029699 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e2699-3170-408e-899c-e04d1d02a52b admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:18.030024 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e2699-3170-408e-899c-e04d1d02a52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:18.030302 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e2699-3170-408e-899c-e04d1d02a52b admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:18.031033 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e2699-3170-408e-899c-e04d1d02a52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:18.032636 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e2699-3170-408e-899c-e04d1d02a52b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:18.043751 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1445/2899] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:18.048306 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848aab84-1976-431f-bfbc-12f807733159 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:18.060945 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848aab84-1976-431f-bfbc-12f807733159 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:18.066277 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c6396-0da4-461f-a8ff-c4ecdc6eb87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:18.066956 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c6396-0da4-461f-a8ff-c4ecdc6eb87e admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:18.067231 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c6396-0da4-461f-a8ff-c4ecdc6eb87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:18.067568 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c6396-0da4-461f-a8ff-c4ecdc6eb87e admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:18.068260 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c6396-0da4-461f-a8ff-c4ecdc6eb87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:18.069930 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c6396-0da4-461f-a8ff-c4ecdc6eb87e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:18.084630 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1455/2900] 10.222.0.61 () {58 vars in 1121 bytes} [Thu May 26 21:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 21:20:18.091534 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e2699-3170-408e-899c-e04d1d02a52b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:18.106839 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e2699-3170-408e-899c-e04d1d02a52b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:18.113359 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48f996-8c13-48fd-9236-a057347f0d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:18.114312 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48f996-8c13-48fd-9236-a057347f0d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:18.114591 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48f996-8c13-48fd-9236-a057347f0d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:18.114862 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48f996-8c13-48fd-9236-a057347f0d64 admin admin] PATH_INFO: `/v3/projects/0ec2153fa2274ecaaf660c3d5c542906/users/fc6f3eaea83b470fa1aad55da212fcc3/roles/7f252cd3de7047e396a0daf6e7d4d2ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:18.131011 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48f996-8c13-48fd-9236-a057347f0d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec2153fa2274ecaaf660c3d5c542906, user_id=fc6f3eaea83b470fa1aad55da212fcc3, role_id=7f252cd3de7047e396a0daf6e7d4d2ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:18.133670 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48f996-8c13-48fd-9236-a057347f0d64 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:18.136040 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:18.151106 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1446/2901] 10.222.0.61 () {60 vars in 1482 bytes} [Thu May 26 21:20:18 2022] PUT /identity/v3/projects/0ec2153fa2274ecaaf660c3d5c542906/users/fc6f3eaea83b470fa1aad55da212fcc3/roles/7f252cd3de7047e396a0daf6e7d4d2ee => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:18.165859 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc2e22-cf6f-43b5-8ef3-0b78e46d4ac5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:18.166354 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc2e22-cf6f-43b5-8ef3-0b78e46d4ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:18.166762 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc2e22-cf6f-43b5-8ef3-0b78e46d4ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:18.189213 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:18.200394 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-34bc2e22-cf6f-43b5-8ef3-0b78e46d4ac5 None None] MFA Rules not processed for user `fc6f3eaea83b470fa1aad55da212fcc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:18.202741 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-34bc2e22-cf6f-43b5-8ef3-0b78e46d4ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:18.274651 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1456/2902] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:20:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:18.289496 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48f996-8c13-48fd-9236-a057347f0d64 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:18.292331 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6c48f996-8c13-48fd-9236-a057347f0d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:18.371394 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48f996-8c13-48fd-9236-a057347f0d64 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:18.377244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c8e9c-e06a-4bb7-97e6-2146c477a5f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e877e97dae064fe9ad3d378296b78ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:18.377948 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c8e9c-e06a-4bb7-97e6-2146c477a5f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:18.378233 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c8e9c-e06a-4bb7-97e6-2146c477a5f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:18.378508 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c8e9c-e06a-4bb7-97e6-2146c477a5f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:18.390446 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c8e9c-e06a-4bb7-97e6-2146c477a5f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:18.395420 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c8e9c-e06a-4bb7-97e6-2146c477a5f3 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:18.411075 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1447/2903] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:20:18 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:20:18.442763 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc2e22-cf6f-43b5-8ef3-0b78e46d4ac5 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:18.516672 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc2e22-cf6f-43b5-8ef3-0b78e46d4ac5 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:18.524507 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86af1bb-d7ef-4f95-a957-44cc4b8ee801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:18.525759 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86af1bb-d7ef-4f95-a957-44cc4b8ee801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:18.526258 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86af1bb-d7ef-4f95-a957-44cc4b8ee801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:18.526707 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86af1bb-d7ef-4f95-a957-44cc4b8ee801 admin admin] PATH_INFO: `/v3/users/fc6f3eaea83b470fa1aad55da212fcc3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:18.528281 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86af1bb-d7ef-4f95-a957-44cc4b8ee801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6f3eaea83b470fa1aad55da212fcc3)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:18.530465 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86af1bb-d7ef-4f95-a957-44cc4b8ee801 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:18.585505 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e86af1bb-d7ef-4f95-a957-44cc4b8ee801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6f3eaea83b470fa1aad55da212fcc3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:18.602087 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e86af1bb-d7ef-4f95-a957-44cc4b8ee801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6f3eaea83b470fa1aad55da212fcc3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:18.603614 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e86af1bb-d7ef-4f95-a957-44cc4b8ee801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6f3eaea83b470fa1aad55da212fcc3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:18.618989 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e86af1bb-d7ef-4f95-a957-44cc4b8ee801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6f3eaea83b470fa1aad55da212fcc3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:18.628358 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e86af1bb-d7ef-4f95-a957-44cc4b8ee801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6f3eaea83b470fa1aad55da212fcc3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:18.634723 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1457/2904] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:20:18 2022] DELETE /identity/v3/users/fc6f3eaea83b470fa1aad55da212fcc3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:18.639743 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77029af3-610a-47fc-a22e-13cd52526a77 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:18.640027 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77029af3-610a-47fc-a22e-13cd52526a77 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:18.640301 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77029af3-610a-47fc-a22e-13cd52526a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:18.660650 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-77029af3-610a-47fc-a22e-13cd52526a77 None None] MFA Rules not processed for user `83882af68d99499bbc81a5c6e9abb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 21:20:18.661925 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-77029af3-610a-47fc-a22e-13cd52526a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:18.738757 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1448/2905] 10.222.0.61 () {58 vars in 957 bytes} [Thu May 26 21:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 21:20:18.749229 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86af1bb-d7ef-4f95-a957-44cc4b8ee801 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:18.751421 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e86af1bb-d7ef-4f95-a957-44cc4b8ee801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:18.777133 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:18.817433 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86af1bb-d7ef-4f95-a957-44cc4b8ee801 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:18.821670 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0117bd1-570d-41fb-81be-674e661c57a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3514a1833104114894abe6c41ea30a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:18.822379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0117bd1-570d-41fb-81be-674e661c57a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:18.822792 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0117bd1-570d-41fb-81be-674e661c57a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:18.822934 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0117bd1-570d-41fb-81be-674e661c57a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:18.834512 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0117bd1-570d-41fb-81be-674e661c57a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:18.836198 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0117bd1-570d-41fb-81be-674e661c57a3 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:18.847105 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1458/2906] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:20:19.161493 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77029af3-610a-47fc-a22e-13cd52526a77 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:19.163073 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-77029af3-610a-47fc-a22e-13cd52526a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:19.175627 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77029af3-610a-47fc-a22e-13cd52526a77 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:19.181370 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebe769-679e-46ad-9681-091c2f33715c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:19.182302 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebe769-679e-46ad-9681-091c2f33715c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:19.182587 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebe769-679e-46ad-9681-091c2f33715c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:19.182818 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebe769-679e-46ad-9681-091c2f33715c admin admin] PATH_INFO: `/v3/projects/0ec2153fa2274ecaaf660c3d5c542906` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:19.185031 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebe769-679e-46ad-9681-091c2f33715c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec2153fa2274ecaaf660c3d5c542906)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:19.187447 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebe769-679e-46ad-9681-091c2f33715c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:19.254219 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ceebe769-679e-46ad-9681-091c2f33715c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec2153fa2274ecaaf660c3d5c542906', 'request_id': 'req-ceebe769-679e-46ad-9681-091c2f33715c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:19.265077 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ceebe769-679e-46ad-9681-091c2f33715c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec2153fa2274ecaaf660c3d5c542906', 'request_id': 'req-ceebe769-679e-46ad-9681-091c2f33715c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:19.271999 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ceebe769-679e-46ad-9681-091c2f33715c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec2153fa2274ecaaf660c3d5c542906', 'request_id': 'req-ceebe769-679e-46ad-9681-091c2f33715c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:19.284383 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ceebe769-679e-46ad-9681-091c2f33715c admin admin] The token cache is being invalidate because project 0ec2153fa2274ecaaf660c3d5c542906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:20:19.284665 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ceebe769-679e-46ad-9681-091c2f33715c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:19.285361 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ceebe769-679e-46ad-9681-091c2f33715c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:19.287028 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1449/2907] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:20:19 2022] DELETE /identity/v3/projects/0ec2153fa2274ecaaf660c3d5c542906 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:28.841825 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=17 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:29.281509 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:INSERT=2,keystone:SELECT=82,keystone:DELETE=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:37.521974 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0117bd1-570d-41fb-81be-674e661c57a3 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:37.524154 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b0117bd1-570d-41fb-81be-674e661c57a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:37.616379 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0117bd1-570d-41fb-81be-674e661c57a3 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:37.695367 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87b067-e766-4866-86c9-e51ee697ed12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99b767501244338bc48fb5428a589a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:37.695913 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87b067-e766-4866-86c9-e51ee697ed12 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:37.696188 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87b067-e766-4866-86c9-e51ee697ed12 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:37.696472 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87b067-e766-4866-86c9-e51ee697ed12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:37.698753 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cb87b067-e766-4866-86c9-e51ee697ed12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:37.713436 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87b067-e766-4866-86c9-e51ee697ed12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:37.715116 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87b067-e766-4866-86c9-e51ee697ed12 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:37.728192 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1459/2908] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:20:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:20:47.722944 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=62 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:48.011632 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebe769-679e-46ad-9681-091c2f33715c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:48.013167 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ceebe769-679e-46ad-9681-091c2f33715c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:48.084244 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebe769-679e-46ad-9681-091c2f33715c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:48.089220 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e46a8e-9653-415c-abea-2a1e91c06b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:48.090225 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46a8e-9653-415c-abea-2a1e91c06b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:48.090510 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46a8e-9653-415c-abea-2a1e91c06b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:48.090819 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46a8e-9653-415c-abea-2a1e91c06b7c admin admin] PATH_INFO: `/v3/users/d30be6d09e2e4256abfa1d563be6987a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:48.092068 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e46a8e-9653-415c-abea-2a1e91c06b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d30be6d09e2e4256abfa1d563be6987a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:48.094042 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e46a8e-9653-415c-abea-2a1e91c06b7c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:48.166272 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-99e46a8e-9653-415c-abea-2a1e91c06b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd30be6d09e2e4256abfa1d563be6987a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:48.167062 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-99e46a8e-9653-415c-abea-2a1e91c06b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd30be6d09e2e4256abfa1d563be6987a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:48.177834 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-99e46a8e-9653-415c-abea-2a1e91c06b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd30be6d09e2e4256abfa1d563be6987a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:48.192622 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-99e46a8e-9653-415c-abea-2a1e91c06b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd30be6d09e2e4256abfa1d563be6987a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:48.199893 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-99e46a8e-9653-415c-abea-2a1e91c06b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd30be6d09e2e4256abfa1d563be6987a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:48.206795 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1450/2909] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:20:48 2022] DELETE /identity/v3/users/d30be6d09e2e4256abfa1d563be6987a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:48.416958 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87b067-e766-4866-86c9-e51ee697ed12 service nova] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:48.429642 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87b067-e766-4866-86c9-e51ee697ed12 service nova] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:48.493685 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:48.494604 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:48.494888 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:48.495164 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a admin admin] PATH_INFO: `/v3/projects/4135c478b822402297fbb0a79f9a0b6b` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:48.496397 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4135c478b822402297fbb0a79f9a0b6b)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:48.498394 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:48.555698 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4135c478b822402297fbb0a79f9a0b6b', 'request_id': 'req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:48.561416 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4135c478b822402297fbb0a79f9a0b6b', 'request_id': 'req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:48.567938 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4135c478b822402297fbb0a79f9a0b6b', 'request_id': 'req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:48.581997 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a admin admin] The token cache is being invalidate because project 4135c478b822402297fbb0a79f9a0b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:20:48.582279 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:48.582886 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:48.584446 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1460/2910] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:20:48 2022] DELETE /identity/v3/projects/4135c478b822402297fbb0a79f9a0b6b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:48.588720 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e46a8e-9653-415c-abea-2a1e91c06b7c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:48.590438 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-99e46a8e-9653-415c-abea-2a1e91c06b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:48.605176 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e46a8e-9653-415c-abea-2a1e91c06b7c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:48.669195 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a75e81-c278-4ee4-abbf-317d372e6b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:48.670027 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a75e81-c278-4ee4-abbf-317d372e6b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:48.670308 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a75e81-c278-4ee4-abbf-317d372e6b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:48.670582 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a75e81-c278-4ee4-abbf-317d372e6b3b admin admin] PATH_INFO: `/v3/users/130f583d64264f1c93be54bb43aa3ba7` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:48.671793 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a75e81-c278-4ee4-abbf-317d372e6b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=130f583d64264f1c93be54bb43aa3ba7)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:48.673707 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a75e81-c278-4ee4-abbf-317d372e6b3b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:48.702391 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:48.736512 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-06a75e81-c278-4ee4-abbf-317d372e6b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '130f583d64264f1c93be54bb43aa3ba7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:48.737633 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-06a75e81-c278-4ee4-abbf-317d372e6b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '130f583d64264f1c93be54bb43aa3ba7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:48.746826 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-06a75e81-c278-4ee4-abbf-317d372e6b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '130f583d64264f1c93be54bb43aa3ba7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:48.760601 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-06a75e81-c278-4ee4-abbf-317d372e6b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '130f583d64264f1c93be54bb43aa3ba7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:48.772822 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-06a75e81-c278-4ee4-abbf-317d372e6b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '130f583d64264f1c93be54bb43aa3ba7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:48.780888 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1451/2911] 10.222.0.61 () {58 vars in 1223 bytes} [Thu May 26 21:20:48 2022] DELETE /identity/v3/users/130f583d64264f1c93be54bb43aa3ba7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:48.983148 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:20:48.984656 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:20:48.999451 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68153c06-eeb0-4f8e-99cf-4d25e2899c4a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:20:49.064417 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2b3ef-b2b4-483b-a2e9-236ba707580e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83882af68d99499bbc81a5c6e9abb2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b75eb758e320488d94c4fcec41d7e80a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:20:49.065425 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2b3ef-b2b4-483b-a2e9-236ba707580e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:20:49.065711 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2b3ef-b2b4-483b-a2e9-236ba707580e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:20:49.066027 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2b3ef-b2b4-483b-a2e9-236ba707580e admin admin] PATH_INFO: `/v3/projects/9de7367cec15412a8ce7f28a2323fe6e` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:20:49.067268 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2b3ef-b2b4-483b-a2e9-236ba707580e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de7367cec15412a8ce7f28a2323fe6e)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:20:49.069204 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2b3ef-b2b4-483b-a2e9-236ba707580e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:20:49.112019 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:49.133675 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-43d2b3ef-b2b4-483b-a2e9-236ba707580e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de7367cec15412a8ce7f28a2323fe6e', 'request_id': 'req-43d2b3ef-b2b4-483b-a2e9-236ba707580e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:49.139837 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-43d2b3ef-b2b4-483b-a2e9-236ba707580e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de7367cec15412a8ce7f28a2323fe6e', 'request_id': 'req-43d2b3ef-b2b4-483b-a2e9-236ba707580e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:49.147005 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-43d2b3ef-b2b4-483b-a2e9-236ba707580e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de7367cec15412a8ce7f28a2323fe6e', 'request_id': 'req-43d2b3ef-b2b4-483b-a2e9-236ba707580e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:49.161053 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-43d2b3ef-b2b4-483b-a2e9-236ba707580e admin admin] The token cache is being invalidate because project 9de7367cec15412a8ce7f28a2323fe6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 21:20:49.161332 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-43d2b3ef-b2b4-483b-a2e9-236ba707580e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:49.161985 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-43d2b3ef-b2b4-483b-a2e9-236ba707580e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 21:20:49.163569 dv-cinder-828806-3-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1461/2912] 10.222.0.61 () {58 vars in 1232 bytes} [Thu May 26 21:20:48 2022] DELETE /identity/v3/projects/9de7367cec15412a8ce7f28a2323fe6e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 21:20:58.776685 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:59.157450 dv-cinder-828806-3-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:32.051248 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a75e81-c278-4ee4-abbf-317d372e6b3b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 21:22:32.052851 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-06a75e81-c278-4ee4-abbf-317d372e6b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:32.178295 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a75e81-c278-4ee4-abbf-317d372e6b3b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 21:22:32.246879 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c494f-723b-429c-a041-2bac4d5b93b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8952f35c21c4a2eaf1fbc601fe76242', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c23678abd4f4dacaf35d73c5184e72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 21:22:32.247579 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c494f-723b-429c-a041-2bac4d5b93b8 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 21:22:32.247864 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c494f-723b-429c-a041-2bac4d5b93b8 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 21:22:32.248144 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c494f-723b-429c-a041-2bac4d5b93b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 21:22:32.250525 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4e0c494f-723b-429c-a041-2bac4d5b93b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 21:22:32.262829 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c494f-723b-429c-a041-2bac4d5b93b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 21:22:32.264769 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c494f-723b-429c-a041-2bac4d5b93b8 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 21:22:32.276981 dv-cinder-828806-3-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1452/2913] 10.222.0.61 () {60 vars in 1365 bytes} [Thu May 26 21:22:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 21:22:42.271678 dv-cinder-828806-3-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=67 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}